ChatGPT usage from the main site dwarfs API Usage for both Open AI and Anthropic so we're not really saying different things here.

The vast majority of people using LLMs just use ChatGPT directly. Anthropic is doing fine for technical or business customers looking to offer LLM services in a wrapper but that doesn't mean they register in the public consciousness.

>Anthropic is doing fine for technical or business customers looking to offer LLM services in a wrapper

If there's an actual business to be found in all this, that's where it's going to be.

The consumer side of this bleeds cash currently and I'm deeply skeptical of enough of the public being convinced to pay subscription fees high enough to cover running costs.

Especially when Google is good enough for most people. Most people just want information not someone to give them digested info at $x per month. All the fancy letter writing assistants they get for free via the corporate computer that likely has Microsoft Word

If inference cost is so cheap and negligible, then we'll be able to run the models on an average computer. Which means they have no business model (assuming generosity from Meta to keep publishing llma for free).

There is no way that running a data center full of any current or prospective offering from nvidia will be anything close to resembling negligible.

so... ad funded?

I think they mean running inference. Either more efficient/powerful hardware, or more efficient software.

No one thinks about the cost of a db query any more, but I'm sure people did back in the day (well, I suppose with cloud stuff, now people do need to think about it again haha)

Anybody with billions of database queries thinks about them.

Yeah, but GP said one.

nobody is paying for the training so you either pay for the inference or the ads do