Loading…
17-18 September | Amsterdam, Netherlands
View More Details & Registration

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.
Venue: G104 + G105 (Level 1) clear filter
arrow_back View All Dates
Friday, September 18
 

10:55 CEST

Outcome Engineering: Why Your Agentic Architecture Doesn't Matter (Yet) - Kierra Dotson, Further
Friday September 18, 2026 10:55 - 11:20 CEST
The open agentic ecosystem is technically brilliant and strategically incomplete. Engineers across the enterprise are deploying multi-agent systems, integrating MCP, and building sophisticated context infrastructure — and yet the majority of it never reaches production at scale, fails to earn sustained organizational investment, or generates no measurable competitive value. This stems from looking at model and tool selection as the outcome instead of business value produced.

Outcome Engineering is the discipline of designing agentic systems backward from competitive strategy, instead of forward from technical capability. It is the difference between building impressive infrastructure and building systems that are indispensable. It is the difference between an agent that gets demoed and an agent that gets shipped. And it is the difference between an engineer who just builds things and an engineer who changes what a business is capable of.

This session challenges a widely held belief in the engineering community: that deploying the most advanced agentic architecture is the end goal. It is not. The end goal is winning disproportionately because your AI systems are connected to proprietary data, embedded in proprietary workflows, and architected around prioritized business goals and competitive positions that cannot be replicated by any organization running the same off-the-shelf stack.

This session will expose the critical disconnect between how engineers build agentic systems and how those systems actually survive contact with business reality. We will cover how to map technical architecture directly to strategic outcomes — why proprietary data and institutional knowledge are the most defensible moats in the agentic era, and what it actually takes to build systems the business cannot afford to turn off.

Attendees will leave with a clear framework for reverse-engineering their agent architecture from the outcome back to the infrastructure. Ultimately, the engineers who define this era will be the ones who build systems so embedded in how the business wins that replacing them becomes a risk no one is willing to take.

Speakers
KD

Kierra Dotson

Director of AI Strategy and Governance, Further

Friday September 18, 2026 10:55 - 11:20 CEST
G104 + G105 (Level 1)

11:30 CEST

Agents Can Pay. Can They Prove It? - Diego Zuluaga & Saurabh Goyal, Open Mobile Hub
Friday September 18, 2026 11:30 - 11:55 CEST
This is the EUDI Wallet architecture, running inside an agent, 18 months before the Dec-2026 mandate.

Every "agent that verifies you" or "agent that pays" demo skips the hard part: how does an AI agent request a real, government- or bank-grade credential from your device, on any phone, any wallet, Android or iOS, and prove who authorized it?

We'll run the full chain live. An MCP server renders a verifier inside Claude and ChatGPT; the W3C Digital Credentials API requests a credential over OpenID4VP; FIDO caBLE carries it cross-device to your phone; the wallet returns an mdoc or SD-JWT credential held in hardware (StrongBox, TEE, Secure Enclave); an AP2 mandate binds your intent.

Identity is the headline, age, membership, passport, healthcare, with payments as one example. And it's not a stage trick: it's an open-source Digital Credential MCP server, soon to be released and donated, that you can clone, point at your own credential, and ship. Built on open standards, across every platform, with UCP & ACP conformance on the roadmap.

Here are some examples of the demos we're planning to showcase: https://github.com/dzuluaga/mcp-apps-shopping-demo
Speakers
avatar for Diego Zuluaga

Diego Zuluaga

Lead, Open Mobile Hub (Linux Foundation), Open Mobile Hub
Leads agentic commerce on Multipaz (OpenWallet Foundation's mdoc credential library, what Google Wallet runs on) and heads Open Mobile Hub under the Linux Foundation. Represents Futurewei in the Agentic AI Foundation (Agentic Commerce, Identity & Trust working groups), alongside Mastercard... Read More →
avatar for Saurabh Goyal

Saurabh Goyal

Senior Director, Open Mobile Hub, Open Mobile Hub
Saurabh is a Senior Director at OMH with 20 years of experience in the technology industry. In his current role, he is focused on developing the agentic ecosystem and contributing to Open Source Projects.
Prior to his current role, Saurabh worked with Google for 10.5 years, where... Read More →
Friday September 18, 2026 11:30 - 11:55 CEST
G104 + G105 (Level 1)

12:05 CEST

Testing Agents and Their Tools: Offline Evaluation, Synthetic Tasks, and A/B Experiments - Ksenia Bobrova, GitHub
Friday September 18, 2026 12:05 - 12:30 CEST
A three-layer evaluation strategy for AI agents and their tools, from experience operating across multiple LLM providers and runtimes.

Offline evaluation: designing benchmark suites with curated requests, expected tool selections, and arguments. Computing precision, recall, F1 scores, confusion matrices for tool mix-ups, and argument hallucination rates to pinpoint description problems.

End-to-end benchmarks: multi-tool flows where the agent chains several calls to complete a task, catching integration regressions that single-tool evaluation misses.

Production A/B experiments: a case study of tool search experiments across OpenAI and Anthropic through staged rollouts. Challenges we hit: caching bugs under real traffic, tool discovery failures, and data skew making early results inconclusive. How we decided whether to advance, pause, or roll back.

These layers compensate for each other's blind spots, forming a testing pyramid that enabled us to safely ship changes to MCP and agent across model providers. Attendees leave with a reusable playbook for testing MCP servers, agents, and running A/B experiments.
Speakers
avatar for Ksenia Bobrova

Ksenia Bobrova

Senior Software Engineer, GitHub
I'm currently focusing on building AI agents and tooling around it.
Friday September 18, 2026 12:05 - 12:30 CEST
G104 + G105 (Level 1)

12:40 CEST

Beyond Vibe-Testing: Engineering Deterministic Agent Skills - Shuva Jyoti Kar, Palo Alto Networks
Friday September 18, 2026 12:40 - 13:05 CEST
The AI ecosystem suffers from a critical engineering immaturity: deploying stochastic models via manual "vibe checks." Operating autonomous agents at enterprise scale requires abandoning ad-hoc observation for strict, distributed systems rigor. This session introduces a deterministic, CI/CD-native evaluation architecture for Agent Skills, shifting from indeterministic to reliable software execution.

By adhering to the formalized capability standards defined by agentskills.io, we will deconstruct the transition from subjective testing to hermetic, code-driven audits. Attendees will learn to engineer scenario matrices that enforce strict cognitive boundaries via negative testing—guaranteeing agents safely reject out-of-scope triggers. We will demonstrate isolating execution within sandboxed environments to capture pristine telemetry: deterministic tool-call structures, system exit codes, and exact token utilization.

Crucially, we address the anti-pattern of relying on "LLM-as-a-judge" for critical path assertions. Instead, we architect a framework grading system invariants via AST parsing and JSON Schema enforcement to achieve instantaneous, hallucination-immune evaluation.
Speakers
avatar for SHUVA JYOTI KAR

SHUVA JYOTI KAR

Principal Engineer, Palo Alto Networks
Shuva is a Principal Engineer at Palo Alto Networks building secure enterprise AI platforms. An author of two upcoming books: Engineering the Data Agent Control Plane (O'Reilly) and Agent Skills in Action (Manning), an open-source contributor and former OpenDaylight committer, his... Read More →
Friday September 18, 2026 12:40 - 13:05 CEST
G104 + G105 (Level 1)

13:15 CEST

From Vibes To Data: Evaluating Agents on Your Real Work - Ville Hellman, Datadog
Friday September 18, 2026 13:15 - 13:40 CEST
Frontier labs are spending billions making agents better at SWE-Bench. But how much of your engineering work actually looks like SWE-Bench? At Datadog we kept seeing agents that crushed public benchmarks fail on our codebase: missing our conventions, reaching for the wrong internal libraries, technically correct but doing the work the wrong way.

To get past demos and gut feel, we built an evaluation platform that measures agents on tasks drawn from our real work, and gave our platform teams a way to encode best practices as evals. Teams shipping skills, steering docs, agent harnesses, and MCP servers can now see whether their changes actually moved the needle.

In this talk I'll share how SOTA and open-weight models actually compare on real work, what their cost-performance profiles look like, tooling decisions that can shift token usage by 10% or more, and how a surprisingly small eval suite can produce stable signal.

You'll leave with a clearer way to think about model choice as a tradeoff between performance you actually need and tokens you're willing to spend, and a sharper sense of what makes an eval keep paying off over time instead of becoming a one-off exercise.
Speakers
avatar for Ville Hellman

Ville Hellman

Staff Engineer, Datadog
Ville is a Staff Engineer in Datadog's AI DevX group, where he builds evaluation infrastructure for the agents and tooling Datadog engineers use every day. He writes on AI-augmented engineering, AI literacy, and developer experience to make what's coming next easier for others to... Read More →
Friday September 18, 2026 13:15 - 13:40 CEST
G104 + G105 (Level 1)

15:45 CEST

Giving Your Agentic Coding AI a Security Brain - Liran Tal, Snyk
Friday September 18, 2026 15:45 - 16:10 CEST
AI can generate a week’s worth of code before lunch and just as quickly ship SSRF, RCE, and path traversal vulnerabilities into prod. Rules and “/security-review” prompts aren’t enough: they’re costly, brittle, and non-deterministic. Run them three times, get three answers. Meanwhile, who vets hallucinated npm packages as the agent installs them? Oh you’re running the agent with “--dangerously-skip-permissions”? Color me surprised, sigh.

Well the good news is you don’t have to trade speed for security, let me show you how. This talk shows a concrete, developer-first pattern: learn how to use MCPs & Hooks to give agents real security superpowers. We’ll wire in just-in-time package health checks and deterministic code reviews via pluggable AI components, with clear contextually engineered details for your agent. You’ll leave with a better understanding of the security dangers relying on agentic coding tools alone and a reliable and deterministic agentic workflow to make AI coding fast and safely shippable.
Speakers
avatar for Liran Tal

Liran Tal

Director of Developer Relations, Snyk
Liran Tal is an AI Security researcher, a seasoned Node.js developer, and a secure coding expert focused on hardening agentic workflows and the Model Context Protocol (MCP). He discovers and discloses CVEs in MCP servers and AI frameworks, and publishes research on tool poisoning... Read More →
Friday September 18, 2026 15:45 - 16:10 CEST
G104 + G105 (Level 1)

16:20 CEST

Autonomous Organisations: Starting Small - Floris Fok, Prosus
Friday September 18, 2026 16:20 - 16:45 CEST
What does it take to let AI agents run a real business? Before handing over an entire restaurant, our team started with something much smaller: a network of vending machines.

In this session, we'll share what we've learned by giving AI agents responsibility for real world operational decisions, including pricing, inventory management, and marketing. The vending machine serves as a practical testbed for exploring how autonomous organizations behave under real customer demand, where mistakes have real consequences but the risks remain manageable.

We'll discuss how this work evolved from simulated restaurant environments into live deployments, what worked, what failed, and why small scale experiments are the fastest path toward larger autonomous operations. We'll also look ahead to the next phase, including autonomous restaurants and the role robotics may play.

Attendees will leave with a practical framework for experimenting with autonomous organizations, along with lessons learned from taking AI agents out of the lab and into the real world.
Speakers
avatar for Floris Fok

Floris Fok

Staff AI Engineer, Prosus
Big hacker leading JetSki at Prosus here. JetSkis are smaller, more disruptive initiatives. Heavy AI/NLP backgrounds. Have coauthored Climate GPT: a Foundational Model. Have an engineering background and started with training LLMs the moment they were released many years ago.
Friday September 18, 2026 16:20 - 16:45 CEST
G104 + G105 (Level 1)

16:55 CEST

The Autonomous Enterprise – Scaling Computer Use With Holo3 and HoloTab - Pierre-Louis Cedoz, H Company
Friday September 18, 2026 16:55 - 17:20 CEST
H Company is the leading agentic AI startup in Europe, based in Paris, specialized in computer use.

The AI landscape is shifting rapidly from passive text generation to active execution. The frontier belongs to Agentic AI, systems that don't just chat, but autonomously navigate digital environments to complete complex workflows.

At H Company, we bridge this gap between frontier research and production-grade deployment. We will explore how H Company built Holo3, our state-of-the-art model family designed specifically for "Computer Use" (GUI perception, planning, and OS navigation). Moving from theory to practice, we will demonstrate how these compact, high-efficiency models power our latest enterprise tools—including HoloTab, our autonomous AI browser companion. Finally, we will unpack the unified infrastructure model required to train, deploy, and scale these agents securely across multi-cloud environments.
Speakers
avatar for Pierre-Louis Cedoz

Pierre-Louis Cedoz

CTO, H Company
Pierre-Louis Cedoz is CTO at H Company, where he leads the research and development of next-generation, action-oriented AI. With an extensive background spanning reinforcement learning, large action models, and advanced machine learning research at institutions like Stanford University... Read More →
Friday September 18, 2026 16:55 - 17:20 CEST
G104 + G105 (Level 1)
 
Share Modal

Share this link via

Or copy link

Filter sessions
Apply filters to sessions.
Filtered by Date -