Sign inSign up

mcp/opik

Verified Publisher

By mcp

•Updated 10 months ago

Model Context Protocol (MCP) server for Opik, the open-source LLM observability and evaluation pl...

Image
Machine learning & AI
1

10K+

mcp/opik repository overview

⁠Opik MCP Server

Model Context Protocol (MCP) implementation for Opik enabling seamless IDE integration and unified access to prompts, projects, traces, and metrics. .

What is an MCP Server?⁠

⁠MCP Info

AttributeDetails
Docker Imagemcp/opik⁠
Authorcomet-ml⁠
Repositoryhttps://github.com/comet-ml/opik-mcp⁠

⁠Image Building Info

AttributeDetails
Dockerfilehttps://github.com/comet-ml/opik-mcp/blob/ea3b4862c5d904fd51cacf61a28abf4791864d1e/Dockerfile⁠
Commitea3b4862c5d904fd51cacf61a28abf4791864d1e
Docker Image built byDocker Inc.
Docker Scout Health ScoreDocker Scout Health Score
Verify SignatureCOSIGN_REPOSITORY=mcp/signatures cosign verify mcp/opik --key https://raw.githubusercontent.com/docker/keyring/refs/heads/main/public/mcp/latest.pub
LicenceApache License 2.0

⁠Available Tools (13)

Tools provided by this ServerShort Description
add-trace-feedbackAdd feedback scores to a trace for quality evaluation and monitoring.
create-projectCreate a new project
create-promptCreate a new prompt
get-prompt-versionRetrieve a specific version of a prompt
get-promptsGet a list of prompts with optional filtering
get-trace-by-idGet detailed information about a specific trace including input, output, metadata, and timing information
get-trace-statsGet aggregated statistics for traces including counts, costs, token usage, and performance metrics over time
get-trace-threadsGet trace threads (conversation groupings) to view related traces that belong to the same conversation or session
list-projectsGet a list of projects with optional filtering
list-tracesGet a list of traces from a project.
opik-integration-docsProvides detailed documentation on how to integrate Opik with your LLM application
save-prompt-versionSave a new version of a prompt
search-tracesAdvanced search for traces with complex filtering and query capabilities

⁠Tools Details

⁠Tool: add-trace-feedback

Add feedback scores to a trace for quality evaluation and monitoring. Useful for rating trace quality, relevance, or custom metrics

ParametersTypeDescription
scoresarrayArray of feedback scores to add. Each score should have a name and value between 0-1
traceIdstringID of the trace to add feedback to
workspaceNamestring optionalWorkspace name to use instead of the default

⁠Tool: create-project

Create a new project

ParametersTypeDescription
namestringName of the project
descriptionstring optionalDescription of the project
workspaceNamestring optionalWorkspace name to use instead of the default

⁠Tool: create-prompt

Create a new prompt

ParametersTypeDescription
namestringName of the prompt
descriptionstring optionalDescription of the prompt
tagsarray optionalList of tags for the prompt

⁠Tool: get-prompt-version

Retrieve a specific version of a prompt

ParametersTypeDescription
namestringName of the prompt
commitstring optionalSpecific commit/version to retrieve

⁠Tool: get-prompts

Get a list of prompts with optional filtering

ParametersTypeDescription
namestring optionalFilter by prompt name
pagenumber optionalPage number for pagination
sizenumber optionalNumber of items per page

⁠Tool: get-trace-by-id

Get detailed information about a specific trace including input, output, metadata, and timing information

ParametersTypeDescription
traceIdstringID of the trace to fetch (UUID format, e.g. "123e4567-e89b-12d3-a456-426614174000")
workspaceNamestring optionalWorkspace name to use instead of the default workspace

⁠Tool: get-trace-stats

Get aggregated statistics for traces including counts, costs, token usage, and performance metrics over time

ParametersTypeDescription
endDatestring optionalEnd date in ISO format (YYYY-MM-DD). Example: "2024-01-31"
projectIdstring optionalProject ID to filter traces. If not provided, will use the first available project
projectNamestring optionalProject name to filter traces (alternative to projectId)
startDatestring optionalStart date in ISO format (YYYY-MM-DD). Example: "2024-01-01"
workspaceNamestring optionalWorkspace name to use instead of the default workspace

⁠Tool: get-trace-threads

Get trace threads (conversation groupings) to view related traces that belong to the same conversation or session

ParametersTypeDescription
pagenumber optionalPage number for pagination
projectIdstring optionalProject ID to filter threads
projectNamestring optionalProject name to filter threads
sizenumber optionalNumber of threads per page
threadIdstring optionalSpecific thread ID to retrieve (useful for getting all traces in a conversation)
workspaceNamestring optionalWorkspace name to use instead of the default

⁠Tool: list-projects

Get a list of projects with optional filtering

ParametersTypeDescription
pagenumber optionalPage number for pagination
sizenumber optionalNumber of items per page
workspaceNamestring optionalWorkspace name to use instead of the default

⁠Tool: list-traces

Get a list of traces from a project. Use this for basic trace retrieval and overview

ParametersTypeDescription
pagenumber optionalPage number for pagination (starts at 1)
projectIdstring optionalProject ID to filter traces. If not provided, will use the first available project
projectNamestring optionalProject name to filter traces (alternative to projectId). Example: "My AI Assistant"
sizenumber optionalNumber of traces per page (1-100, default 10)
workspaceNamestring optionalWorkspace name to use instead of the default workspace

⁠Tool: opik-integration-docs

Provides detailed documentation on how to integrate Opik with your LLM application

⁠Tool: save-prompt-version

Save a new version of a prompt

ParametersTypeDescription
namestringName of the prompt
templatestringTemplate content for the prompt version
change_descriptionstring optionalDescription of changes in this version
metadataobject optionalAdditional metadata for the prompt version
typestring optionalTemplate type

⁠Tool: search-traces

Advanced search for traces with complex filtering and query capabilities

ParametersTypeDescription
filtersobject optionalAdvanced filters as key-value pairs. Examples: {"status": "error"}, {"model": "gpt-4"}, {"duration_ms": {"$gt": 1000}}
pagenumber optionalPage number for pagination
projectIdstring optionalProject ID to search within
projectNamestring optionalProject name to search within
querystring optionalText query to search in trace names, inputs, outputs, and metadata. Example: "error" or "user_query:hello"
sizenumber optionalNumber of traces per page (max 100)
sortBystring optionalField to sort by. Options: "created_at", "duration", "name", "status"
sortOrderstring optionalSort order: ascending or descending
workspaceNamestring optionalWorkspace name to use instead of the default

⁠Use this MCP Server

{
  "mcpServers": {
    "opik": {
      "command": "docker",
      "args": [
        "run",
        "-i",
        "--rm",
        "-e",
        "OPIK_API_BASE_URL",
        "-e",
        "OPIK_WORKSPACE_NAME",
        "-e",
        "OPIK_API_KEY",
        "mcp/opik"
      ],
      "env": {
        "OPIK_API_BASE_URL": "https://www.comet.com/opik/api",
        "OPIK_WORKSPACE_NAME": "default",
        "OPIK_API_KEY": "your_api_key"
      }
    }
  }
}

Why is it safer to run MCP Servers with Docker?⁠

Install from MCP:Hub

Tag summary

Content type

Image

Digest

sha256:0e0d7d33d…

Size

98.3 MB

Last updated

10 months ago

docker pull mcp/opik

This week's pulls

Pulls:

41

Last week