Reliability on Mengboy 技术笔记

Claude API Rate-Limit Storm Playbook: Adaptive Concurrency, Jittered Backoff, and Quota Isolation

Fri, 03 Apr 2026 01:15:05 +0000

When Claude API starts returning 429 under high load, most systems don’t just slow down—they collapse: queue buildup, retry storms, upstream timeout chains, and pager noise.

Claude API 高并发限流雪崩应对：自适应并发、退避抖动与配额隔离

Fri, 03 Apr 2026 01:15:05 +0000

当 Claude API 在高并发下开始返回 429，很多系统不是“慢一点”，而是直接雪崩：队列堆积、重试风暴、上游超时、下游告警连锁。

Claude + OpenAI Dual-Provider Gateway Failover: Health Probes, Circuit Breaking, and SLA Fallback

Mon, 30 Mar 2026 01:14:00 +0000

If your production stack calls both Claude and OpenAI, the hard part is not API integration. The hard part is keeping user experience stable when one provider starts throwing 429/5xx spikes, regional latency, or timeout storms.

This guide gives you a practical dual-provider gateway playbook: health probes, circuit breaking, SLA-aware fallback, and observability loops. The goal is not “never fail.” The goal is controlled failure with controlled cost and controlled latency.

Claude + OpenAI 双供应商网关容灾：健康探测、熔断切换与 SLA 回退策略

Mon, 30 Mar 2026 01:14:00 +0000

当你的生产系统同时接入 Claude 和 OpenAI，真正难的不是“接上 API”，而是在故障发生时还能稳态服务。一个供应商偶发 429/5xx、区域波动或模型超时，都会把下游体验打穿。

这篇给你一套可直接落地的双供应商网关方案：健康探测、熔断切换、SLA 分级回退、以及可观测性闭环。目标不是追求“永不失败”，而是失败可控、成本可控、体验可控。

OpenAI Responses Streaming in Production: Backpressure, Chunk Reassembly, and Timeout Budget

Fri, 27 Mar 2026 01:08:00 +0000

Most streaming failures are not about “can it stream”, but “does it stay stable under load”: broken chunks, stuck clients, timeout cascades, and retry storms.

OpenAI Responses 流式输出生产稳态：背压控制、分片重组与超时预算闭环

Fri, 27 Mar 2026 01:08:00 +0000

线上最容易把流式输出做坏的，不是“能不能流出来”，而是流量一上来就抖：token 断片、客户端卡死、超时雪崩、重试风暴。

Go 服务调用 OpenAI 的 429/5xx 风暴应对：令牌桶、指数退避与熔断恢复

Wed, 18 Mar 2026 01:14:00 +0000

你不是被 OpenAI API「偶尔报错」打败的；你是被并发放大后的重试风暴打败的。

Handling OpenAI 429/5xx Storms in Go: Token Bucket, Exponential Backoff, and Circuit Breakers

Wed, 18 Mar 2026 01:14:00 +0000

Most Go teams are not killed by a single API error. They are killed by a retry storm they created themselves.