1 of 29

Internet of Agents and the AGNTCY Project

2 of 29

An open-source collective for inter-agent collaboration. A project of the Linux Foundation

80+ collaborating organizations

Formative Members

3 of 29

A paradigm shift in computing is underway

Deterministic 🡪 Probabilistic

[ cloud computing 🡪 agentic computing ]

4 of 29

Agents must collaborate to solve problems

Like a team of subject matter experts

5 of 29

Agentic computing needs a collaboration framework

Agents

come from different vendors

use different development frameworks

run on different clouds

have different access controls

belong to different organizations

take on different profiles and personas

6 of 29

Evolving the OSI model

Internet of Agents

VM | Bare metal

SaaS | Cloud Native Services

Agentic Software

VM | Bare metal

SaaS | Cloud Native Services

Agentic Software

Cloud Internet

Internet

physical

data link

network

transport

session

presentation

application

semantic

syntactic

1

2

3

7

6

5

4

β

TCP, UDP, QUIC

IP, IPsec, OSPF

Ethernet frames, ARP

802.3 100G, DOCSIS

BSD Sockets

SSL, TLS

HTTPS, gRPC, Mesh

Agent-to-Agent Protocol

Model Context Protocol

Semantic Protocols

Secure Low-latency Interactive Messaging

7 of 29

Why do we need a new internet?

Agents have human-like attributes and communication needs

but operate at machine speeds and scale

a

a

a

embodied

mobile

edge

DC

cloud

h

m

a

a

a

semantic*

syntactic*

discover and identify

  • find agents for specific tasks? are they reputable?
  • identify them, give access on my behalf?
  • assemble them to collaborate on the job to be done?
  • interpret probabilistic / natural language inputs and outcomes?
  • efficiently & securely transfer text-video-image-audio state?
  • doing what they are supposed to do?
  • getting into conflicts, loops

securely connect

observe and evaluate

1

2

3

8 of 29

Ensembles of Agents need a secure collaboration layer

Scientific & Math

Agentic Apps

(e.g., GNoME)

Social or Personal

Agentic Apps

(e.g., Apple or Meta Avatars)

B2B Agents

(e.g., SFDC Agents)

Infrastructure

Agentic Apps

(e.g., Cisco AI Assistant)

Services

Agentic Apps

(e.g., ServiceNow, CX)

Embodied / Physical

Agentic Apps

(e.g., Physical Intelligence)

Internet of Agents

Workflow example A

Workflow example B

A: IT App Deployment & Management

(biz logic description) : (service-ticket generation) : (service-graph generation): (scale-checker) : (security-checker) : (cost-manager)

B: Drug discovery, Materials Discovery:

(protein-modeling) : (cost-modeling) : (protein-modify) : (efficacy-vector-search) : (safety-check) : (reaction-check)

Ex. Vendors: Open AI, ServiceNow, Salesforce, Microsoft, Cisco, …

Ex. Vendors: Anthropic, Evolutionary Scale, Physical Intelligence, …

9 of 29

Agent Directory

Agent Identity

Agent Messaging

Agent Observability

The open standards and foundational technologies being built by AGNTCY

A secure, scalable, decentralized technology that holds agent and MCP server records.

An identity framework that assigns, verifies and manages credentials for AI agents and MCP servers.

A messaging layer enabling real-time, multi-model state exchange among agents and models.

A framework that monitors and assesses multi-agent software performance.

10 of 29

11 of 29

MCP

A2A

SLIM

❤️

Protocols

12 of 29

Core

Identity

Observe-Eval

common

+ app-sdk

coffee-app-sdk

Working Groups

13 of 29

AGENT COMMUNICATION

Video intelligence monitoring

Legacy video monitoring systems lack real-time, actionable insights in complex environments, relying on isolated AI models or manual review. This results in missed events, delayed responses, and limited situational awareness, making them inadequate for today’s demand for scalable intelligence.

Problem

SoftServe partnered with AGNTCY to deploy a multi-agent video intelligence system powered by SLIM (Secure Low-latency Interactive Messaging). ��SLIM enables fast, secure communication between specialized agents handling tasks and ensures real-time responsiveness and coordination. This allows the system to scale efficiently while maintaining semantic clarity and operational trust.

Solution

Download the

whitepaper

14 of 29

AGENT COMMUNICATION

Autonomous network operations

Swisscom experienced a network outage caused by a misconfiguration that slipped through traditional lab testing, exposing the limits of manual change management and static environments.

Problem

Partnering with Outshift, they built a multi-agent system using Agentic Network Validator to simulate, verify, and prevent failures—transforming network operations from reactive to predictive.

Solution

AGENT OBSERVABILITY

Download the

whitepaper

15 of 29

Platform operations automation

Our Outshift platform engineering team was overwhelmed by cognitive load, fragmented tooling, and repetitive tasks across complex cloud-native environments. Traditional automation couldn’t scale across domains like CI/CD, Jira, Kubernetes, and GitHub—leaving engineers stuck in support queues and context-switching instead of innovating.

Problem

Outshift created CAIPE, a open-source multi-agent framework, that automates platform workflows through intelligent agent collaboration. Using semantic routing, agent identity, and protocols like SLIM (Secure, Low Latency, Interactive Messaging) and Agent Connect, it provides a unified communication fabric for scalable, extensible, and secure platform engineering.

Solution

AGENT COMMUNICATION

AGENT DISCOVERY

Read the blog

16 of 29

Distributed MAS deployment

Multi Agentic Systems are complex. Not only are we going from deterministic computing paradigm to non-deterministic, but we must also accomplish a similar refactoring effort of the technology stack as the on-premise to cloud transition. But instead of 7 - 10 years, we have 1 - 2 years. The Internet of Agents is upon us, and there needs to be a reference application that instantiates the vision.

Problem

Digital Realty and Cisco are leveraging coffeeAGNTCY to build and deploy a small POC network across multiple servers in different geographies. When you tightly couple an AI ready data center stack to agentic workloads, customers save money and achieve lower latency in their apps.

Solution

AGENT COMMUNICATION

AGENT OBSERVABILITY

AGENT IDENTITY

Read the blog

17 of 29

AI observability

As AI systems grow more complex—especially with multi-agent architectures—traditional observability tools fall short. They focus on infrastructure metrics like latency and error rates but fail to capture the semantic quality of AI outputs. This leaves businesses blind to critical issues like hallucinations, incoherence, or misalignment with user intent, making it difficult to trust and scale these systems in production.

Problem

AGNTCY and Splunk are redefining AI observability by embedding agentic semantic conventions into OpenTelemetry. Their Metrics Compute Engine (MCE) combines infrastructure metrics with LLM-based evaluations of output quality—like factual accuracy and coherence—giving teams a holistic view of system performance.

Solution

AGENT COMMUNICATION

AGENT DISCOVERY

Read the blog

18 of 29

Healthcare booking automation

Accessing healthcare is often a fragmented, frustrating experience. Patients must repeat their symptoms at every step, wait for insurance verification, and navigate disconnected systems—all while providers struggle with overloaded call centers and inefficient workflows.

Problem

Infermedica, Cisco, Webex, and Infinitus have teamed up to create a Healthcare Booking Multi-Agent System (MAS). This prototype uses specialized AI assistants to guide patients from symptom check to appointment scheduling—seamlessly and securely. Each agent handles a specific task, coordinated by Webex’s AI supervisor, creating a smooth, scalable, and collaborative healthcare experience.

Solution

AGENT IDENTITY

AGENT DISCOVERY

AGENT OBSERVABILITY

Watch the webinar

19 of 29

Take the next step

https://agntcy.org/

https://github.com/agntcy

https://github.com/agntcy/governance/blob/main/working-groups/WORKING-GROUPS.md

Join a working group

Learn more

Adopt & Contribute

20 of 29

Thank you!

21 of 29

Appendix

22 of 29

Industry examples of multi-agent systems

Healthcare

Monitor and coordinate responses to detected anomalies, ensuring timely and appropriate interventions.

Manufacturing

Automate responses to predicted production shortages, optimizing resource allocation and minimizing downtime.

Banking

Analyze and evaluate a consumer loan applications, streamlining the approval process and reducing manual effort.

Retail / E-commerce

Re-engage lost customers on social media platforms by tailoring advertising placements and promotional offers.

Transportation

Automate response to vehicle incidents or traffic accidents, speeding public safety responses and streamlining insurance claim processing.

23 of 29

Components

24 of 29

Agent Directory

A secure, scalable, decentralized service that holds agent and MCP server records

    • Publish and discover agent records across the network of decentralized directories
    • Provides a cryptographic trust model that ensures authenticity and provenance of each record
    • Leverages the Open Agentic Schema Framework (OASF) to describe agents
    • Available as open-source software, or try out the hosted SaaS (https://agent-directory.outshift.com/)

25 of 29

AGNTCY Agent Identity

Trusted identity for secure, accountable, autonomous systems

Assign, verify, and manage cryptographically verifiable identities for AI Agents (OASF, A2A), and MCP Servers

Tap into your trusted Identity Provider – Duo, Okta, Ory, or AGNTCY’s built-in decentralized identity provider

Create fine-grained (task-tool based) access control policies

Add human-in-the-loop approvals for sensitive actions

Establish trust across distributed agentic services

Enforce fine-grained access control

Build interoperable agentic systems

26 of 29

TBAC – Granular Access Controls​ for Agentic Services

Evolving RBAC, ABAC to support Access Controls

TBAC enables fine-grained, contextual, and auditable access controls, ensuring trust, compliance, and security across all AI-driven operations.

Tools

Agents can access which tools: APIs

 e.g., access to book_flight API

Tasks

Agents can perform what actions

→ e.g., ability to book a flight

Transactions

Agents can execute which specific requests

→ e.g., book flight SEA → NYC, 9/11-9/15, <$500

27 of 29

SLIM: Secure Low-latency Interactive Messaging

A messaging service enabling real-time, multi-modal state exchange between agents, models and tools

    • Extends gRPC to support pub/sub interactions in addition to request/reply, streaming, fire & forget, …
    • Employs authentication, authorization and end-to-end encryption to protect data privacy and integrity (TLS, MLS)
    • Enables agent group-based collaboration, human-in-the-loop interactions and large state exchange through low latency communication patterns
    • Supports MCP and A2A protocols
    • Provides decentralized, secure and scalable routing for distributed systems (agents, MCP servers, models)

28 of 29

Agent Observability & Evaluation

A framework that monitors and assesses multi-agent software performance

    • Capture traces, metrics and events from multi-agent software and export data to an OTel collector endpoint
    • Support agents from various frameworks by mapping and translating third-party schemas
    • Provide end-to-end visibility into multi-agent software by aggregating telemetry data across agents and components
    • Gain insight into derived evaluation and observability metrics
    • Engage the Metrics Compute Engine (MCE) providing comprehensive visibility into AI quality: accuracy, appropriateness, safety, and fairness—all computed automatically from standardized telemetry and delivered alongside your operational metrics.

Advancements in OpenTelemetry (OTel), the open source standard for observability, have been achieved through collaboration with Microsoft and Splunk.

Learn more

  1. Observability SDK
  2. A translator template

(3) A Telemetry hub for aggregation and recomposition of MAS sessions

(4) Metrics Compute Engine (MCE)

29 of 29

coffeeAGNTCY Reference App + AGNTCY SDK

See what AGNTCY can do and jumpstart your multi-agent software development

    • The OSS reference app ("coffeeAGNTCY" in Github) represents a fictional global coffee company but is easily modifiable for any multi-agent use case
    • Highlights best practices for using AGNTCY repos, architecture, components
    • Re-usable SDK capturing common AGNTCY patterns
    • Demonstrates agent-to-agent communication using SLIM, the Messaging Layer that is isolated from Semantics, multiprotocol (A2A, MCP), secure, reliable, low-latency, async, point-to-point ("Corto" demo) OR many-to-many ("Lungo" demo using Pub/Sub)
    • Coming Soon: End-to-end demonstration of all AGNTCY components including Directory, Identity, and Observability

Semantic Layer

Messaging Layer

Agent Directory

Syntactic Layer

Agentic Observability

Agentic Security

Agent Identity

coffeeAGNTCY Reference App

AGNTCY SDK