OpenAI is hemorrhaging cash. It could lose about $5 billion this year and may have to raise more funding. [The Information, paywalled; Data Center Dynamics] The Information report is based on OpenA…
That’s completely true but the model that is beating OpenAI and Claude is 405b parameters. Those small models are catching up very fast and it’s impressive what can be run on consumer GPU but you need a monster rig to run the full 405b even at small quants.
That’s completely true but the model that is beating OpenAI and Claude is 405b parameters. Those small models are catching up very fast and it’s impressive what can be run on consumer GPU but you need a monster rig to run the full 405b even at small quants.