Concepts

Core concepts and architecture of the AgentOps platform.

AgentOps models AI agents as Kubernetes-native workloads. Six Custom Resource Definitions (CRDs) in the agents.agentops.io/v1alpha1 API group describe the entire platform:

CRDShort NamePurpose
AgentagDefines an agent’s model, tools, memory, identity, and lifecycle mode
AgentRunarTracks a single execution of an agent (prompt + response + metrics)
AgentToolagtoolCatalog entry for an MCP tool server, skill, or external endpoint
AgentResourcearesDeclares an external resource (repo, bucket, docs) agents can work with
ChannelchBridges external platforms (Slack, GitHub webhooks, GitLab) to agents
ProviderprovShared LLM provider configuration (type, credentials, endpoint, call defaults)

The operator reconciles these CRDs into standard Kubernetes primitives — Deployments, Jobs, Services, PVCs, ConfigMaps, NetworkPolicies, and RBAC — so agents run with the same operational model as any other workload.

Architecture overview

AgentOps Concepts Overview

Key design principles

Declarative-first. Agents, tools, and resources are defined as CRDs. The operator converges cluster state to match the declared spec. No imperative setup scripts.

Go-native runtime. The agent runtime is built on the Charm Fantasy SDK — a single statically-linked Go binary per agent pod. No Python, no Node.js, no container-in-container.

Three-layer memory. Working memory (in-process), short-term session summaries (deterministic, no LLM call), and long-term observations (FTS5 BM25-ranked). All backed by agentops-memory, a ~1300 LOC Go service with SQLite.

Tools as OCI artifacts. MCP tool servers are compiled Go binaries packaged as OCI artifacts. The operator pulls them via init containers and the runtime spawns them on stdio. No network hops for tool calls.

Real-time streaming. The Fantasy Event Protocol (FEP) over Server-Sent Events connects the AgentOps Console to live agent sessions for token-by-token streaming, tool call visualization, and memory inspection.

Read on for deep dives into each concept:

  • Agents — CRD spec, lifecycle modes, delegation, concurrency control
  • Providers — shared LLM provider configuration, type-based SDK wiring, per-call defaults
  • Memory — three-layer model, context injection, write dedup, MCP tools
  • Tools — MCP tool servers, OCI distribution, gateway sidecar, built-in servers
  • Resources — external resource catalog, agent bindings, git workspaces, console integration

Agents

Agent CRD, lifecycle modes, delegation, concurrency control, and what the operator creates.

Memory

Three-layer memory model, context injection, write deduplication, and the agentops-memory service.

Providers

Provider CRD, supported backends, endpoint configuration, and per-call defaults.

Tools

MCP tool servers, OCI artifact distribution, gateway sidecar, and built-in tool servers.

Agent Delegation and Orchestration

How agents discover, delegate to, and collect results from other agents using Kubernetes-native fan-out.

Observability

Distributed tracing, real-time streaming, and context window visibility across the entire AgentOps stack.

The Web Console

Go BFF and SolidJS PWA for interacting with agents, viewing traces, managing memory, and browsing Kubernetes resources.

Agent Resources

Declarative external resource catalog — Git repos, S3 buckets, documentation — and how agents bind to them.