Timeout Budget on Mengboy 技术笔记

OpenAI Responses Streaming in Production: Backpressure, Chunk Reassembly, and Timeout Budget

Fri, 27 Mar 2026 01:08:00 +0000

Most streaming failures are not about “can it stream”, but “does it stay stable under load”: broken chunks, stuck clients, timeout cascades, and retry storms.

OpenAI Responses 流式输出生产稳态：背压控制、分片重组与超时预算闭环

Fri, 27 Mar 2026 01:08:00 +0000

线上最容易把流式输出做坏的，不是“能不能流出来”，而是流量一上来就抖：token 断片、客户端卡死、超时雪崩、重试风暴。