Run a 670 Billion parameter LLM at home for $6000 with no GPU required

$6000 sounds expensive and it won’t be very fast to start, but Moore’s Law suggests that it will be $3000 cheaper (or twice as fast) in a couple of years. Just wait a while, I know people who spend more on gaming rigs.

Regulators, national security wonks & online safety advocates must be… concerned.


Fediverse reactions

Comments

Leave a Reply

Your email address will not be published. Required fields are marked *