23 points | by sscaryterry 3 hours ago
4 comments
Is anyone making LLM-in-a-box for emergency supply kits yet?
I feel that would be handy in all sorts of situations when networks are down.
Can you expand what you mean?
99% of the model "work" (meaning the connection to your computer) is just spinning a spinner - something that makes me want to wrap it with a mosh shell so I can just keep moving from network to network.
Fascinating to wonder whether the bigger model finds fewer or more counterfeits than the on-device one.
Is anyone making LLM-in-a-box for emergency supply kits yet?
I feel that would be handy in all sorts of situations when networks are down.
Can you expand what you mean?
99% of the model "work" (meaning the connection to your computer) is just spinning a spinner - something that makes me want to wrap it with a mosh shell so I can just keep moving from network to network.
Fascinating to wonder whether the bigger model finds fewer or more counterfeits than the on-device one.