Great reminder to be using multiple providers (i.e. Anthropic 1P, Bedrock, Vertex AI, Azure) with auto-fallback.
Bedrock has been fine throughout today; just pick two providers and you have much more stable Claude :)
Also, sometimes older models work fine, Opus 4.8/4.6/4.5 are worth trying.
dr_kiszonka 6 hours ago [-]
>Also, sometimes older models work fine, Opus 4.8/4.6/4.5 are worth trying.
I would go as far as saying they are sometimes better than the newer ones! It is impressive that Opus 5 can one-shot a complex website, but it is very annoying if I only asked it to write tests.
Last week, I asked Sonnet 5 to add one line to the documentation, commit, and push. Ten minutes later, I discovered it embarked on a side quest of exploring my whole Git history, different branches, etc.
bob1029 11 hours ago [-]
It's fun to offer this advice but I think actually practicing it is nearly impossible in many settings.
If you are a solo developer who has the patience to tinker endlessly, this advice is probably fine.
If you are responsible for provisioning AI services in a team setting, this advice starts to fall apart rapidly. OAI and Anthropic might as well be oil and water when it comes to what tools and descriptions are most ideal.
Swapping the inference provider like it's some interchangeable module is a total fantasy in most real world settings.
> Also, sometimes older models work fine
> sometimes
My users are hoping for slightly more definitive results. "Usually" or even "often" would be much preferred.
ageitgey 10 hours ago [-]
You don't neccesarily have to fallback across models. Both Anthropic and AWS Bedrock provide the same models with the same API at different endpoints and different infra. So if you have a proxy endpoint to point users at, that specific fallback case is pretty easy.
I'm not saying that works in every business or billing scenario, though.
wartywhoa23 11 hours ago [-]
Never put all AI taxes in one basket!
renezander030 9 hours ago [-]
[dead]
virajk_31 9 hours ago [-]
I really love using Claude, but running its API in production was a constant headache (they hv most horrible status graph), switched to Gemini and didn't hit any major downtime since...
rvz 13 hours ago [-]
One of the Anthropic salesmen told everyone to use loops all over the place, auto mode and use Fable 5 and Opus 5 with multiple sub agents.
Then it seems they forgot about their own infrastructure which goes down once every two weeks.
Looks like most of all the engineering knowledge that was needed at Google was lost after the whole org at Anthropic is now vibing their work.
Rather than screaming “coding is solved!”, “AGI with a month” and spooking everyone with the bogus mysticism of “Mythos” which now everyone has an equivalent strong cyber model, maybe keep the lights on first before plotting the next doomsday story.
eru 12 hours ago [-]
> Looks like most of all the engineering knowledge that was needed at Google was lost after the whole org at Anthropic is now vibing their work.
Sorry, what does Google have to do with Anthropic's outage?
tcp_handshaker 11 hours ago [-]
They also serve inference from GCloud
eru 11 hours ago [-]
Oh, ok, thanks. It seems reasonably likely that maybe Google Cloud might be to blame.
How they go down globally? All regions use the same infra?
Iolaum 12 hours ago [-]
It was a configuration error ...
singularity2001 10 hours ago [-]
Are they really though? The graphic seems to be highly misleading. And marks a whole day as red when there was only a partial outage for one hour.
8 hours ago [-]
nullsanity 12 hours ago [-]
[dead]
vikrantrathore 14 hours ago [-]
Anthropic has constant failure since morning.
11 hours ago [-]
cromka 13 hours ago [-]
Anyone can explain why do they fail so often and so seriously? Is this inherent to managing LLMs or is their Ops really just that bad?
ifwinterco 12 hours ago [-]
Because coding is solved and there’s no need for software engineers any more.
Being charitable to Anthropic though: coding is sort of solved for a very limited definition of “solved”.
Software engineering of huge distributed systems at massive scale is very much not solved, and it seems Anthropic don’t have the human capital to do it particularly well
nixon_why69 12 hours ago [-]
If we want to be even more charitable to Anthropic, they're going from nothing to hyperscaler in like 3 years. I'm as happy as anyone to dunk on the general bubble situation and people claiming their technology is too dangerous to share, then something like this happens, it's hilarious. But it's still actually hard to build a service with that much usage and every org has had some outages on their way to figure it out.
ifwinterco 11 hours ago [-]
Yes I agree, I don't doubt they are dealing with some serious technical challenges.
It's not just the enormous rate of growth, LLMs and workflows are also evolving rapidly.
Whatever they planned for 1-2 years ago in terms of how they expected their stack to be used is probably already well out of date, so they'll be rearchitecting bits of a production system while it's being used
chrisjj 11 hours ago [-]
Anthropic's product is inherently unreliable even when operating at its best. Why would they bother with reliable delivery when their customers are the type clearly not interested in reliability?
Recursing 13 hours ago [-]
I think it's because customers don't seem to mind enough to switch.
I really want to support Anthropic because of their commitments to effective altruism, but it's getting harder and harder to justify on technical merits. Sol is just faster, cheaper, and more reliable, and as good as Opus for my use cases
lxgr 12 hours ago [-]
> I really want to support Anthropic because of their commitments to effective altruism
If you're really committed to the ideas of EA, shouldn't you dispassionately select whatever model works best for you, then make as much money as possible using that and donate it? :)
nullsanity 12 hours ago [-]
[dead]
jcfrei 12 hours ago [-]
I've recently started using codex for most of my coding. Haven't looked back so far: It seems to reason deeper about the code it writes and has much less downtime.
integricho 13 hours ago [-]
Do you actually believe in their altruistic goals?
tcp_handshaker 11 hours ago [-]
The goals are altruistic. The torrent client was purely instrumental.
wartywhoa23 11 hours ago [-]
Just like the coding is solved by redefining what solved means, so is the current iteration of "altruism".
nicce 12 hours ago [-]
> I really want to support Anthropic because of their commitments to effective altruism
They are doing the opposite while saying the other. Zero trust about that. They are using every malicious playbook tactic these days to increase users and be more profitable and lock-in the users. Even OpenAI feels better these days.
puelocesar 12 hours ago [-]
I mean, that’s exactly what “effective altruism” is about? Getting filthy rich and powerful no matter the methods and then the vague promise of doing something good?
nicce 12 hours ago [-]
Not really. They seems to chase IPO so that alone proves that they can’t hold any promise about doing something good. They would need to stay as private company to have any power to do some ”good” in the end.
therein 13 hours ago [-]
> commitments to effective altruism
That's a downside if anything.
eru 12 hours ago [-]
Different folks have different preferences.
KingMob 12 hours ago [-]
Yes, some people think effective altruism means helping people here and now as efficiently as possible.
Others think the sheer number of potential sentients in the future justify any amount of suffering tolerated in the here and now.
Notably, people in the latter group never assume THEY will be the ones suffering for the future.
eru 12 hours ago [-]
> Notably, people in the latter group never assume THEY will be the ones suffering for the future.
What makes you think so? What evidence do you have?
> Yes, some people think effective altruism means helping people here and now as efficiently as possible.
Most effective altruists seem pretty relaxed about the 'here' part, but you are right that the 'now' part receives different answers from different subgroups.
> Others think the sheer number of potential sentients in the future justify any amount of suffering tolerated in the here and now.
There's also the people who care a lot about shrimp. They are less crazy than it seems at first.
Smaug123 12 hours ago [-]
Estimate of the number of people in that latter group? Nick Beckstead is probably the cleanest example of an extreme longtermist, but even he has taken the GWWC pledge. Similarly, Nick Bostrom argues in a pretty longtermist way and is neither vegan nor has taken the pledge, but I don’t see any particular evidence that he has a morality that an average person would call evil. Toby Ord and Will MacAskill are both visibly mundanely extra-super-ethical despite their longtermist views.
chrisjj 11 hours ago [-]
> their commitments to effective altruism
I think you mistook their declamations for commitments.
vasco 12 hours ago [-]
Clearly they just want to be down all the time. They have the ability to throttle down traffic. I have no clue why they decide to throttle it down just enough to have the worst of both worlds, throttling and incidents. Throttle more and have zero incidents, what an incredible revelation.
Barbing 12 hours ago [-]
They didn’t want to be down so bad they rented capacity from Elon and uptime improved dramatically. Super flaky before that, they were even playing games with response quality to lighten their load nontransparently. Not sure what the issue is today. But on average, past 90 days, good availability and quality right?
slopinthebag 13 hours ago [-]
Everything is vibe coded, would you expect anything different?
alansaber 12 hours ago [-]
Quick, release a new claude product then depricate it after 90 days
vinni2 13 hours ago [-]
Because they can’t keep up with the demand?
12 hours ago [-]
tvbusy 13 hours ago [-]
Struggling with demands is a performance problem, not a reliability problem.
swe_dima 13 hours ago [-]
overly high demand can often put a system in an unstable state
therein 13 hours ago [-]
Only if you're incapable of throttling to assure quality of service. Are you saying they have so much demand that even their load balancers were overloaded?
lelanthran 11 hours ago [-]
Throttling helps to prevent a 30% failure rate (with a quick recovery time) turning into a 100% failure rate (with practically infinite recovery time), but some users are still going to see failures, and the news is still going to be "Anthropic is down again" because some users are seeing an outage.
I'm not really sure how they can avoid getting in the news with "Anthropic is down", TBH. Although, at least by throttling they might get "Anthropic is down for some requests" and not "Anthropic is down for all requests".
slopinthebag 13 hours ago [-]
There is no point having this discussion. Some people have had their brains genuinely broken by Anthropic and will defend them to the last breath, despite having no clue what they are talking about.
36799753298 12 hours ago [-]
[flagged]
chrisjj 11 hours ago [-]
Load is not demand.
ACCount37 12 hours ago [-]
It is a reliability problem - because if the API ends up rejecting 30% of the incoming queries, no one cares if it's 500 Internal Server Error or 529 Overloaded.
Having your infrastructure at the knife's edge of load to capacity also means you have no redundancy when something fails.
cherioo 12 hours ago [-]
If this incident had happened during the day I could buy that argument. But it is happening in the dead of the night. Are there really that much people scheduling claude runs over-night, taking more capacity than day-time? (assume most claude users are west coast programmers)
My other guess is they are scheduling training runs and their capacity isolation is bad.
cbg0 12 hours ago [-]
The world is more than just the Americas.
bob778 9 hours ago [-]
It wasn’t night for all of Asia or Europe?
alansaber 12 hours ago [-]
Yes yes it is key that we vibe code critical infrastructure. I can't wait to see a claude-ism in my next BIOS update.
tcp_handshaker 12 hours ago [-]
They cant solve the infrastructure problem until Claude is back up....
beredon 14 hours ago [-]
[dead]
cloveyxD 13 hours ago [-]
[dead]
gagan2020 13 hours ago [-]
Mind you, They use latest Anthropic Claude models for programming. /s
roschdal 12 hours ago [-]
It's a reminder to never depend of something as flaky as AI on the Internet for your important business processes.
UnfitFootprint 12 hours ago [-]
my senior suggested quoting prices based off an online LLM fed a rules table and what the customer did :thinking:
BoredomIsFun 9 hours ago [-]
Just buy 2x5060ti's and run local Qwen 3.8. Not Claude of course, but a good backup anyway.
hyperionultra 13 hours ago [-]
Lately Dario has to many bad news from customer side. Of course there is no bad or good news, just marketing, but still…
This was said recently lolol
https://x.com/bcherny/status/2090649326032945591
Bedrock has been fine throughout today; just pick two providers and you have much more stable Claude :)
Also, sometimes older models work fine, Opus 4.8/4.6/4.5 are worth trying.
I would go as far as saying they are sometimes better than the newer ones! It is impressive that Opus 5 can one-shot a complex website, but it is very annoying if I only asked it to write tests.
Last week, I asked Sonnet 5 to add one line to the documentation, commit, and push. Ten minutes later, I discovered it embarked on a side quest of exploring my whole Git history, different branches, etc.
If you are a solo developer who has the patience to tinker endlessly, this advice is probably fine.
If you are responsible for provisioning AI services in a team setting, this advice starts to fall apart rapidly. OAI and Anthropic might as well be oil and water when it comes to what tools and descriptions are most ideal.
Swapping the inference provider like it's some interchangeable module is a total fantasy in most real world settings.
> Also, sometimes older models work fine
> sometimes
My users are hoping for slightly more definitive results. "Usually" or even "often" would be much preferred.
I'm not saying that works in every business or billing scenario, though.
Then it seems they forgot about their own infrastructure which goes down once every two weeks.
Looks like most of all the engineering knowledge that was needed at Google was lost after the whole org at Anthropic is now vibing their work.
Rather than screaming “coding is solved!”, “AGI with a month” and spooking everyone with the bogus mysticism of “Mythos” which now everyone has an equivalent strong cyber model, maybe keep the lights on first before plotting the next doomsday story.
Sorry, what does Google have to do with Anthropic's outage?
Being charitable to Anthropic though: coding is sort of solved for a very limited definition of “solved”.
Software engineering of huge distributed systems at massive scale is very much not solved, and it seems Anthropic don’t have the human capital to do it particularly well
It's not just the enormous rate of growth, LLMs and workflows are also evolving rapidly.
Whatever they planned for 1-2 years ago in terms of how they expected their stack to be used is probably already well out of date, so they'll be rearchitecting bits of a production system while it's being used
I really want to support Anthropic because of their commitments to effective altruism, but it's getting harder and harder to justify on technical merits. Sol is just faster, cheaper, and more reliable, and as good as Opus for my use cases
If you're really committed to the ideas of EA, shouldn't you dispassionately select whatever model works best for you, then make as much money as possible using that and donate it? :)
They are doing the opposite while saying the other. Zero trust about that. They are using every malicious playbook tactic these days to increase users and be more profitable and lock-in the users. Even OpenAI feels better these days.
That's a downside if anything.
Others think the sheer number of potential sentients in the future justify any amount of suffering tolerated in the here and now.
Notably, people in the latter group never assume THEY will be the ones suffering for the future.
What makes you think so? What evidence do you have?
> Yes, some people think effective altruism means helping people here and now as efficiently as possible.
Most effective altruists seem pretty relaxed about the 'here' part, but you are right that the 'now' part receives different answers from different subgroups.
> Others think the sheer number of potential sentients in the future justify any amount of suffering tolerated in the here and now.
There's also the people who care a lot about shrimp. They are less crazy than it seems at first.
I think you mistook their declamations for commitments.
I'm not really sure how they can avoid getting in the news with "Anthropic is down", TBH. Although, at least by throttling they might get "Anthropic is down for some requests" and not "Anthropic is down for all requests".
Having your infrastructure at the knife's edge of load to capacity also means you have no redundancy when something fails.
My other guess is they are scheduling training runs and their capacity isolation is bad.