Discussion about this post

User's avatar
Jack Orenstein's avatar

From a comment I posted to r/LocalLLM on reddit, about why I am using AI that I run on my own computer, rather than models in the cloud. Local AI is far less capable, and slower. But I think that's temporary:

I don't want to use the frontier models for a few reasons. 1) I am retired, and this is a hobby. I don't want to put a lot of money into token fees. 2) My understanding is that frontier models are heavily subsidized. I don't want to get addicted to crack. 3) I think the future is local LLMs. They have to get better, in absolute and in relative terms. Models are so ridiculously expensive and resource-intensive to train and use, and its still very early days. There will have to be vast improvements in this area, just based on multiple financial incentives. 4) I view this as an updated version of the mainframe/PC battle from the 80s and 90s. PC-based architectures dominate except in a few places. PC descendents (by which I mean Intel/ARM based Linux systems) are vastly more powerful than they used to be. I think the same will happen with local models relative to frontier models. 5) Due to intense competition in the AI space, and the differing interests of different players, someone is always going to undercut competition by releasing a newer, more capable open source model. It's a race to the bottom.

Theophrastvs's avatar

Wait... the unspoken 'money saving' aspect of "A.I." is not [southpark]"they took our jebs!"? That is, it was presumed *the* plan was c-suite replaces everyone down to janitor with "A.I." and oh so much is saved in health care, pensions, ...yellow sticky notes; that's not how they intend to "use it"? they just don't want the existing hires to use it? [:confused cuttlefish emoji:]

4 more comments...

No posts

Ready for more?