Timeout Budget on Mengboy Tech Notes https://www.mfun.ink/en/tags/timeout-budget/ Recent content in Timeout Budget on Mengboy Tech Notes Hugo -- 0.156.0 en Fri, 27 Mar 2026 01:08:00 +0000 OpenAI Responses Streaming in Production: Backpressure, Chunk Reassembly, and Timeout Budget https://www.mfun.ink/en/2026/03/27/openai-responses-streaming-backpressure-chunk-reassembly-timeout-budget/ Fri, 27 Mar 2026 01:08:00 +0000 https://www.mfun.ink/en/2026/03/27/openai-responses-streaming-backpressure-chunk-reassembly-timeout-budget/ <p>Most streaming failures are not about “can it stream”, but “does it stay stable under load”: broken chunks, stuck clients, timeout cascades, and retry storms.</p>