All posts
Tag
#streaming
2 articles tagged streaming.
AI
Aug 31, 2026Event-Driven AI: How Kafka Streams Changed the Way We Run LLMs in Production
From blocking HTTP calls to async event streams — the architecture shift that halved user-visible latency, eliminated 3AM pages, and lets us process 2M AI requests a day without hitting rate limit walls.
Read article
Spring AI
Jul 6, 2026How to Stream LLM Responses in Spring AI (Server-Sent Events)
Stream tokens as they're generated with Spring AI's ChatClient — a practical guide to SSE with WebFlux and Spring MVC, consuming the stream on the frontend, and handling errors in production.
Read article