It took me quite a while to come round to OpenRouter. Originally I didn't understand why anyone would put a proxy between them and an LLM, but it actually adds some quite significant value:
1. By far the lowest friction way to support and try out all the models.
2. They offer billing caps! Most model providers still don't do this [EDIT: maybe they do, see reply comment], but if you're going to run anything in public it's very useful to have hard limits so it doesn't cost you $1m overnight because someone started abusing it.
3. Their rankings are one of the more interesting signals for which models are popular, despite their flaws (most OpenAI and Anthropic users don't go via OpenRouter, it's currently not possible to tell the difference between many users switching v.s. one "whale" changing their preferred model)
Given how API costs are becoming meaningful for a lot of companies now, having a provider like OpenRouter to help measure your spend and easily experiment with and switch providers feels like a valuable service.
Another neat thing is, they publish hourly caching states for ALL model/provider combinations. I did some research on it to come up with a provider tiers and found a bunch of open-source 3rd party hosts are simply trash tier https://dirac.run/posts/cache-hit-rates-agents
Good points. The easy experimentation factor is helpful for development, though I would gently encourage everyone to migrate to the 1st party APIs for pricing at scale.
OpenRouter is also a good place to find free LLM access with a catch: You should expect that any inputs and outputs are going into someone's training database. Clearly anyone who can pay should be using paid models with privacy protections, but the free models have been great for learning and experimenting. Especially for younger people learning API programming and LLMs who may not have access to a credit card or funds.
It’s interesting all the focus on opt-out from training. Sometimes I worry there is an intentional focus on that so people don’t think about the other ways the company might be profiting off our data. Like I pay for Anthropic and they don’t train on that but are they selling my “anonymized” usage data in some other way?
The way how you manage the caps in OpenRouter is how every metered API provider should do it: keys have limits, and you can change the limits, and you set the limits to refill periodically, and you can create as many keys as you want.
Out of interest, why OpenRouter over a free option like Cloudflare’s AI gateway or another paid option like Vercel’s — any specific benefit to OpenRouter you’ve found, or just first you used that’s good enough?
The biggest benefit is that it creates competition among models. If more people use open weight models or models from other providers, it’ll be harder to ban them. Which is what OpenAI and Anthropic will try to accomplish. OpenAI by lobbying the Trump administration for favorable treatment (see Brockman’s MAGA PAC donations), Anthropic by using religious leaders and nonprofits to push “safety” justifications for difficult regulations.
As someone who uses OpenRouter extensively (and wrote an unintentional adjacent PR piece a few days ago: https://news.ycombinator.com/item?id=48317294 ), it's definitely the best way to try out new models without fiddling with each providers distinct APIs which is becoming a recurring concern as of late.
That said, I don't understand the people who use something a full agentic backbone with expensive models like Claude Opus with OpenRouter because that 5% surcharge is meaningful at that level of cost instead of going with the source API providers. But people are clearly doing it, and it's pure revenue.
There is a lot of dumb token spend right now - tokenmaxing and such. Economic cost of token is not being evaluated carefully because there is fomo and no one wants to be left behind. But folks are waking up to it, and dumb token spending is not sustainable and will revert.
>> it's definitely the best way to try out new models without fiddling with each providers distinct APIs which is becoming a recurring concern as of late
I was sort of hoping that they were bootstrapped or at least non-VC funded. I'm wary of them introducing consumer-unfriendly revenue-generating schemes.
I think that OpenRouter will continue to be very popular while there lots of experimentation in the LLM space, and while the "current favorite" model continues to change between various frontier labs.
After things begin to settle down, we'll probably see a consolidation of both frontier and open-source models - and then OpenRouter will become less useful, because that 5% overhead is well worth it when you want to try 20 models from 10 labs, but harder to stomach when you only need 5 models from 2 providers, and each of those providers has its own API knobs that you can tune to make things even cheaper.
Is the Open in OpenRouter the same as in Open AI? I couldn’t find any repository or hosted code. Thought it'd be a open source, self hostable tool with a cloud offering but seems its just the latter?
I assumed they were open source but now that I checked they are not, they say "Open" because they route to third-party open models. Yikes. Another VC crap layer?
OpenRouter’s biggest value to me is reducing switching costs between models. The markup matters at scale, but for exploration and early-stage development, the convenience is hard to beat.
An amazing service. I use its 20+ free LLM options to allow completely free usage of LibreOffice AI extension with no signup https://librethinker.com .
> ... with participation from NVentures (NVIDIA's venture capital arm), ServiceNow Ventures, MongoDB Ventures, Snowflake Ventures, Databricks Ventures ...
Are tech companies FOMOing so hard that they're now all running AI venture arms themselves instead of you know, developing their own products? Except for NVIDIA who needs to keep pumping the bubble I didn't expect the others.
Well, at least for them, investing into AI is actually developing their own product. The push to replace "Actually Indians" [1] with LLMs is huge because large Western companies want to save even the pittances they're paying Indian body shops.
It took me quite a while to come round to OpenRouter. Originally I didn't understand why anyone would put a proxy between them and an LLM, but it actually adds some quite significant value:
1. By far the lowest friction way to support and try out all the models.
2. They offer billing caps! Most model providers still don't do this [EDIT: maybe they do, see reply comment], but if you're going to run anything in public it's very useful to have hard limits so it doesn't cost you $1m overnight because someone started abusing it.
3. Their rankings are one of the more interesting signals for which models are popular, despite their flaws (most OpenAI and Anthropic users don't go via OpenRouter, it's currently not possible to tell the difference between many users switching v.s. one "whale" changing their preferred model)
Given how API costs are becoming meaningful for a lot of companies now, having a provider like OpenRouter to help measure your spend and easily experiment with and switch providers feels like a valuable service.
Another neat thing is, they publish hourly caching states for ALL model/provider combinations. I did some research on it to come up with a provider tiers and found a bunch of open-source 3rd party hosts are simply trash tier https://dirac.run/posts/cache-hit-rates-agents
Good points. The easy experimentation factor is helpful for development, though I would gently encourage everyone to migrate to the 1st party APIs for pricing at scale.
OpenRouter is also a good place to find free LLM access with a catch: You should expect that any inputs and outputs are going into someone's training database. Clearly anyone who can pay should be using paid models with privacy protections, but the free models have been great for learning and experimenting. Especially for younger people learning API programming and LLMs who may not have access to a credit card or funds.
It’s interesting all the focus on opt-out from training. Sometimes I worry there is an intentional focus on that so people don’t think about the other ways the company might be profiting off our data. Like I pay for Anthropic and they don’t train on that but are they selling my “anonymized” usage data in some other way?
At the moment for DeepSeek V4 it messes up caching and that's a key pricing feature for V4.
https://news.ycombinator.com/item?id=48319827
The way how you manage the caps in OpenRouter is how every metered API provider should do it: keys have limits, and you can change the limits, and you set the limits to refill periodically, and you can create as many keys as you want.
OpenRouter is merely only a proxy. They also host some open-weight models
I don't think they do. They proxy to a bunch of open-weight model hosts, but I've not seen that they host them themselves.
They don't list themselves on https://openrouter.ai/providers
OpenRouter has stealth models that are indicated as "by OpenRouter" but indicate an external provider.
https://openrouter.ai/openrouter/owl-alpha
Both OpenAI and Anthropic have billing caps… who doesn’t?
Huh, so they do.
Anthropic: https://support.claude.com/en/articles/8977456-how-do-i-pay-... - you can pre-pay and get a hard cutoff.
OpenAI: https://community.openai.com/t/how-to-set-billing-limits-and... - last time I looked OpenAI had a soft but not hard limit, I guess they fixed that last year.
I remember bugging them both about this last year, I need to update my mental model!
Based on experience, Google Cloud. No idea if that translates to Gemini usage billing.
Google Vertex
https://aistudio.google.com/spend ? Monthly spend cap
I spent two hours the other day trying to figure out how to manage spend on gcp, i gave up and used openrouter and cloudflare.
Out of interest, why OpenRouter over a free option like Cloudflare’s AI gateway or another paid option like Vercel’s — any specific benefit to OpenRouter you’ve found, or just first you used that’s good enough?
I'll be honest, I hadn't clocked that Cloudflare and Vercel were offering equivalent products.
Looks like Vercel even have their own leaderboard: https://vercel.com/ai-gateway/leaderboards/models
Surprising that they have Opus 4.8 and 4.6 listed on the leaderboard but not Opus 4.7.
The biggest benefit is that it creates competition among models. If more people use open weight models or models from other providers, it’ll be harder to ban them. Which is what OpenAI and Anthropic will try to accomplish. OpenAI by lobbying the Trump administration for favorable treatment (see Brockman’s MAGA PAC donations), Anthropic by using religious leaders and nonprofits to push “safety” justifications for difficult regulations.
As someone who uses OpenRouter extensively (and wrote an unintentional adjacent PR piece a few days ago: https://news.ycombinator.com/item?id=48317294 ), it's definitely the best way to try out new models without fiddling with each providers distinct APIs which is becoming a recurring concern as of late.
That said, I don't understand the people who use something a full agentic backbone with expensive models like Claude Opus with OpenRouter because that 5% surcharge is meaningful at that level of cost instead of going with the source API providers. But people are clearly doing it, and it's pure revenue.
There is a lot of dumb token spend right now - tokenmaxing and such. Economic cost of token is not being evaluated carefully because there is fomo and no one wants to be left behind. But folks are waking up to it, and dumb token spending is not sustainable and will revert.
Better uptime? Given it will be routed to one of Anthropic, Amazon Bedrock, Claude Platform on AWS, Google Vertex (Europe) or Google Vertex
>> it's definitely the best way to try out new models without fiddling with each providers distinct APIs which is becoming a recurring concern as of late
Why not... Cursor?
Convenience has a markup
I was sort of hoping that they were bootstrapped or at least non-VC funded. I'm wary of them introducing consumer-unfriendly revenue-generating schemes.
I think that OpenRouter will continue to be very popular while there lots of experimentation in the LLM space, and while the "current favorite" model continues to change between various frontier labs.
After things begin to settle down, we'll probably see a consolidation of both frontier and open-source models - and then OpenRouter will become less useful, because that 5% overhead is well worth it when you want to try 20 models from 10 labs, but harder to stomach when you only need 5 models from 2 providers, and each of those providers has its own API knobs that you can tune to make things even cheaper.
Every tech company now seems to be invested in every AI startup.
Using Tinfoil, Replicate, Cerebras, and OpenRouter. Competition is good.
Is the Open in OpenRouter the same as in Open AI? I couldn’t find any repository or hosted code. Thought it'd be a open source, self hostable tool with a cloud offering but seems its just the latter?
I assumed they were open source but now that I checked they are not, they say "Open" because they route to third-party open models. Yikes. Another VC crap layer?
tbh anyone can rig up something like openrouter in a few nights with claude code.
its just a proxy
OpenRouter’s biggest value to me is reducing switching costs between models. The markup matters at scale, but for exploration and early-stage development, the convenience is hard to beat.
An amazing service. I use its 20+ free LLM options to allow completely free usage of LibreOffice AI extension with no signup https://librethinker.com .
Too bad api use is like 100x more expensive than subscriptions for the big 3.
I honestly thought this was some kind of OpenWRT firmware for routers until I clicked the link. "Ahhh, AI. Of course."
Aren’t they totally dependent on the good will of the model providers?
> ... with participation from NVentures (NVIDIA's venture capital arm), ServiceNow Ventures, MongoDB Ventures, Snowflake Ventures, Databricks Ventures ...
Are tech companies FOMOing so hard that they're now all running AI venture arms themselves instead of you know, developing their own products? Except for NVIDIA who needs to keep pumping the bubble I didn't expect the others.
> ServiceNow Ventures
Well, at least for them, investing into AI is actually developing their own product. The push to replace "Actually Indians" [1] with LLMs is huge because large Western companies want to save even the pittances they're paying Indian body shops.
[1] for those OOTL: https://www.reddit.com/r/ProgrammerHumor/comments/1l3rpow/ac...