Loading…
17-18 September | Amsterdam, Netherlands
View More Details & Registration

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.
Type: Open Tooling clear filter
arrow_back View All Dates
Friday, September 18
 

15:45 CEST

The Serving Layer Is the Agent's Bottleneck - Swapnil Tiwari, AWS
Friday September 18, 2026 15:45 - 16:10 CEST
I've spent the past year tuning open-source inference stacks (vLLM, SGLang) for production agent systems. The same failure modes keep appearing, and they all live in the serving layer.

Biggest one: KV cache thrashing. Agents rebuild thousands of tokens of system prompt + tool schemas every turn. Prefix-aware caching fixes this in six lines of config. I've measured 55-65% latency reduction on turn 2+ across twelve deployments. Almost nobody enables it.

Second: batch-of-one paralysis during tool-calling loops. Each LLM call is a single request, GPU 80%+ idle. Disaggregated prefill/decode with continuous batching unlocks 3-5x throughput. Requires ~40 lines of change in most agent frameworks.

Third: agent latency is bimodal (short tool-selection turns vs long reasoning turns). A single timeout threshold wastes GPUs or kills valid turns. Two-tier serving handles both.

Open configs. Real numbers from workloads I instrumented. If you're building agents and haven't looked below the orchestrator, this fills the gap.
Speakers
avatar for Swapnil Tiwari

Swapnil Tiwari

GenAI Solutions Architect, AWS
GenAI Solutions Architect specializing in LLM inference optimization for agentic workloads. Helped 50+ teams redesign serving infrastructure, with documented 5-10x cost reductions. Built inferenceengineering.tech (open-source, 2K+ users). Conduct security assessments on MCP deployments... Read More →
Friday September 18, 2026 15:45 - 16:10 CEST
G102 + G103 (Level 1)

16:55 CEST

The Autonomous Enterprise – Scaling Computer Use With Holo3 and HoloTab - Pierre-Louis Cedoz, H Company
Friday September 18, 2026 16:55 - 17:20 CEST
H Company is the leading agentic AI startup in Europe, based in Paris, specialized in computer use.

The AI landscape is shifting rapidly from passive text generation to active execution. The frontier belongs to Agentic AI, systems that don't just chat, but autonomously navigate digital environments to complete complex workflows.

At H Company, we bridge this gap between frontier research and production-grade deployment. We will explore how H Company built Holo3, our state-of-the-art model family designed specifically for "Computer Use" (GUI perception, planning, and OS navigation). Moving from theory to practice, we will demonstrate how these compact, high-efficiency models power our latest enterprise tools—including HoloTab, our autonomous AI browser companion. Finally, we will unpack the unified infrastructure model required to train, deploy, and scale these agents securely across multi-cloud environments.
Speakers
avatar for Pierre-Louis Cedoz

Pierre-Louis Cedoz

CTO, H Company
Pierre-Louis Cedoz is CTO at H Company, where he leads the research and development of next-generation, action-oriented AI. With an extensive background spanning reinforcement learning, large action models, and advanced machine learning research at institutions like Stanford University... Read More →
Friday September 18, 2026 16:55 - 17:20 CEST
G104 + G105 (Level 1)
 
Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.
Filtered by Date -