AgentOps

AgentOps provides session replays, metrics, and monitoring for agents built with Superagent.

AgentOps Github

Overview

AgentOps provides monotoring for agents in development and production. It provides a dashboard for monitoring agent performance, session replays, and custom reporting.

Alt text

Additionally, AgentOps provides session drilldowns that allows users to view the agent’s interactions with users in real-time. This feature is useful for debugging and understanding how the agent interacts with users.

Alt text

Alt text

Features

  • LLM Cost management and tracking
  • Replay Analytics
  • Recursive thought detection
  • Custom Reporting
  • Analytics Dashboard
  • Public Model Testing
  • Custom Tests
  • Time Travel Debugging
  • Compliance and Security

Setting up AgentOps with Superagent locally

You can create a user API key here: app.agentops.ai/account.

AgentOps is automatically configured once you set an API key in your .env.

AGENTOPS_API_KEY=<YOUR_AGENTOPS_API_KEY>
AGENTOPS_ORG_KEY=<YOUR_ORG_KEY>

Superagent provides a default AGENTOPS_ORG_KEY that grants users access to specialized analytics features. However, you may also remove it or replace it with your own.