When I started password cracking in 1991, using all available computer resources of a small university I could manage about 200 guesses per second

Nowadays we do billions of guesses per second on modern laptops, not even particularly high-end ones; so when this person gets one token every four seconds for a 2.8 TRILLION parameter LLM, using AN OLD MACBOOK PRO, to me it suggests that local LLMs will soon be everywhere:

Fediverse reactions

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *