# Table of contents * [README](README.md) * [Changelog](CHANGELOG.md) * [CLA](CLA.md) * [Contributor Covenant Code of Conduct](CODE_OF_CONDUCT.md) * [Contributing to Arize-Phoenix](CONTRIBUTING.md) * [Developer's Guide](DEVELOPMENT.md) * [Migrations](MIGRATION.md) * [Security Policy](SECURITY.md) * [Maintenance README for Phoenix Sphinx API Documentation](api_reference/README.md) * [source](api_reference/source/README.md) * [Arize Phoenix Python Reference](api_reference/source/index.md) * [Arize Phoenix App](app/README.md) * [Arize Phoenix](docs/README.md) * [Table of contents](docs/SUMMARY.md) * [Environments](docs/environments.md) * [Production Guide](docs/production-guide.md) * [User Guide](docs/user-guide.md) * [concepts](docs/concepts/README.md) * [Overview: Tracing](docs/concepts/llm-traces.md) * [datasets-and-experiments](docs/datasets-and-experiments/README.md) * [Concepts: Datasets](docs/datasets-and-experiments/concepts-datasets.md) * [Overview: Datasets](docs/datasets-and-experiments/overview-datasets.md) * [How-to: Datasets](docs/datasets-and-experiments/how-to-datasets/README.md) * [Creating Datasets](docs/datasets-and-experiments/how-to-datasets/creating-datasets.md) * [Exporting Datasets](docs/datasets-and-experiments/how-to-datasets/exporting-datasets.md) * [How-to: Experiments](docs/datasets-and-experiments/how-to-experiments/README.md) * [Repetitions](docs/datasets-and-experiments/how-to-experiments/repetitions.md) * [Run Experiments](docs/datasets-and-experiments/how-to-experiments/run-experiments.md) * [Splits](docs/datasets-and-experiments/how-to-experiments/splits.md) * [Using Evaluators](docs/datasets-and-experiments/how-to-experiments/using-evaluators.md) * [evaluation](docs/evaluation/README.md) * [TypeScript Quickstart](docs/evaluation/typescript-quickstart.md) * [Concepts: Evals](docs/evaluation/concepts-evals/README.md) * [Custom Task Evaluation](docs/evaluation/concepts-evals/building-your-own-evals.md) * [Evaluating Multi-Agent Systems](docs/evaluation/concepts-evals/evaluating-multi-agent-systems.md) * [Eval Data Types](docs/evaluation/concepts-evals/evaluation-types.md) * [Evaluators](docs/evaluation/concepts-evals/evaluators.md) * [Input Mapping](docs/evaluation/concepts-evals/input-mapping.md) * [LLM as a Judge](docs/evaluation/concepts-evals/llm-as-a-judge.md) * [How to: Evals](docs/evaluation/how-to-evals/README.md) * [Batch Evaluations](docs/evaluation/how-to-evals/batch-evaluations.md) * [Code Evaluators](docs/evaluation/how-to-evals/code-evaluators.md) * [Custom LLM Evaluators](docs/evaluation/how-to-evals/custom-llm-evaluators.md) * [Using Evals with Phoenix](docs/evaluation/how-to-evals/using-evals-with-phoenix.md) * [Configuring the LLM](docs/evaluation/how-to-evals/configuring-the-llm/README.md) * [Calling models with LiteLLM](docs/evaluation/how-to-evals/configuring-the-llm/calling-models-with-litellm.md) * [Prompt Formats](docs/evaluation/how-to-evals/configuring-the-llm/prompt-formats.md) * [legacy](docs/evaluation/legacy/README.md) * [Quickstart: Evals](docs/evaluation/legacy/evals.md) * [Concepts: Evals](docs/evaluation/legacy/concepts-evals/README.md) * [Custom Task Evaluation](docs/evaluation/legacy/concepts-evals/building-your-own-evals.md) * [Evals With Explanations](docs/evaluation/legacy/concepts-evals/evals-with-explanations.md) * [Evaluating Multi-Agent Systems](docs/evaluation/legacy/concepts-evals/evaluating-multi-agent-systems.md) * [Eval Data Types](docs/evaluation/legacy/concepts-evals/evaluation-types.md) * [Evaluators](docs/evaluation/legacy/concepts-evals/evaluation.md) * [LLM as a Judge](docs/evaluation/legacy/concepts-evals/llm-as-a-judge.md) * [How to: Evals](docs/evaluation/legacy/how-to-evals/README.md) * [Build an Eval](docs/evaluation/legacy/how-to-evals/bring-your-own-evaluator.md) * [Evals API Reference](docs/evaluation/legacy/how-to-evals/evals-reference.md) * [Eval Models](docs/evaluation/legacy/how-to-evals/evaluation-models.md) * [Multimodal Evals](docs/evaluation/legacy/how-to-evals/multimodal-evals.md) * [Online Evals](docs/evaluation/legacy/how-to-evals/online-evals.md) * [Pre-Built Evals](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/README.md) * [Agent Path Convergence](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/agent-path-convergence.md) * [Agent Planning](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/agent-planning.md) * [Agent Reflection](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/agent-reflection.md) * [AI vs Human (Groundtruth)](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/ai-vs-human-groundtruth.md) * [Audio Emotion Detection](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/audio-emotion-detection.md) * [Code Generation](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/code-generation-eval.md) * [Hallucinations](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/hallucinations.md) * [Q\&A on Retrieved Data](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/q-and-a-on-retrieved-data.md) * [Reference (citation) Link](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/reference-link-evals.md) * [Retrieval (RAG) Relevance](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/retrieval-rag-relevance.md) * [SQL Generation Eval](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/sql-generation-eval.md) * [Summarization](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/summarization-eval.md) * [Agent Function Calling Eval](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/tool-calling-eval.md) * [Toxicity](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/toxicity.md) * [User Frustration](docs/evaluation/legacy/how-to-evals/running-pre-tested-evals/user-frustration.md) * [Overview: Evals](docs/evaluation/legacy/llm-evals/README.md) * [Agent Evaluation](docs/evaluation/legacy/llm-evals/agent-evaluation.md) * [Overview: Evals](docs/evaluation/llm-evals/README.md) * [Evaluator Traces](docs/evaluation/llm-evals/evaluator-traces.md) * [Executors](docs/evaluation/llm-evals/executors.md) * [Use Any LLM](docs/evaluation/llm-evals/use-any-llm.md) * [Pre-Built Evals](docs/evaluation/running-pre-tested-evals/README.md) * [Agent Path Convergence](docs/evaluation/running-pre-tested-evals/agent-path-convergence.md) * [Agent Planning](docs/evaluation/running-pre-tested-evals/agent-planning.md) * [Agent Reflection](docs/evaluation/running-pre-tested-evals/agent-reflection.md) * [AI vs Human (Groundtruth)](docs/evaluation/running-pre-tested-evals/ai-vs-human-groundtruth.md) * [Audio Emotion Detection](docs/evaluation/running-pre-tested-evals/audio-emotion-detection.md) * [Code Generation](docs/evaluation/running-pre-tested-evals/code-generation-eval.md) * [Heuristic Metrics](docs/evaluation/running-pre-tested-evals/code-metrics.md) * [Hallucination](docs/evaluation/running-pre-tested-evals/hallucinations.md) * [Q\&A on Retrieved Data](docs/evaluation/running-pre-tested-evals/q-and-a-on-retrieved-data.md) * [Reference (citation) Link](docs/evaluation/running-pre-tested-evals/reference-link-evals.md) * [Retrieval (RAG) Relevance](docs/evaluation/running-pre-tested-evals/retrieval-rag-relevance.md) * [SQL Generation Eval](docs/evaluation/running-pre-tested-evals/sql-generation-eval.md) * [Summarization](docs/evaluation/running-pre-tested-evals/summarization-eval.md) * [Agent Function Calling Eval](docs/evaluation/running-pre-tested-evals/tool-calling-eval.md) * [Toxicity](docs/evaluation/running-pre-tested-evals/toxicity.md) * [User Frustration](docs/evaluation/running-pre-tested-evals/user-frustration.md) * [Get Started](docs/get-started/README.md) * [Get Started: Datasets & Experiments](docs/get-started/get-started-datasets-and-experiments.md) * [Get Started: Evaluations](docs/get-started/get-started-evaluations.md) * [Get Started: Prompt Playground](docs/get-started/get-started-prompt-playground.md) * [Get Started: Tracing](docs/get-started/get-started-tracing.md) * [how-to](docs/how-to/README.md) * [Export Data](docs/how-to/export-your-data.md) * [Filter Spans](docs/how-to/filter-spans.md) * [Manage the App](docs/how-to/manage-the-app.md) * [Import Your Data](docs/how-to/define-your-schema/README.md) * [Retrieval (RAG)](docs/how-to/define-your-schema/retrieval-rag.md) * [integrations](docs/integrations/README.md) * [Export Data from Arize AX to Phoenix](docs/integrations/bring-production-data-to-notebook-for-eda-or-retraining.md) * [internal\_docs](docs/internal_docs/README.md) * [Testing](docs/internal_docs/TESTING.md) * [llm-evals](docs/llm-evals/README.md) * [Overview: Evals](docs/llm-evals/llm-evals.md) * [prompt-engineering](docs/prompt-engineering/README.md) * [Overview: Prompts](docs/prompt-engineering/overview-prompts.md) * [Concepts: Prompts](docs/prompt-engineering/concepts-prompts/README.md) * [Context Engineering Basics](docs/prompt-engineering/concepts-prompts/context-engineering-basics.md) * [Prompts Concepts](docs/prompt-engineering/concepts-prompts/prompts-concepts.md) * [How to: Prompts](docs/prompt-engineering/how-to-prompts/README.md) * [Configure AI Providers](docs/prompt-engineering/how-to-prompts/configure-ai-providers.md) * [Create a prompt](docs/prompt-engineering/how-to-prompts/create-a-prompt.md) * [Tag a prompt](docs/prompt-engineering/how-to-prompts/tag-a-prompt.md) * [Test a prompt](docs/prompt-engineering/how-to-prompts/test-a-prompt.md) * [Using a prompt](docs/prompt-engineering/how-to-prompts/using-a-prompt.md) * [Using the Playground](docs/prompt-engineering/how-to-prompts/using-the-playground.md) * [overview-prompts](docs/prompt-engineering/overview-prompts-1/README.md) * [Prompt Management](docs/prompt-engineering/overview-prompts/prompt-management.md) * [Prompt Playground](docs/prompt-engineering/overview-prompts/prompt-playground.md) * [Prompts in Code](docs/prompt-engineering/overview-prompts/prompts-in-code.md) * [Span Replay](docs/prompt-engineering/overview-prompts/span-replay.md) * [quickstart](docs/quickstart/README.md) * [Quickstart: Evals](docs/quickstart/evals.md) * [Quickstart: Inferences](docs/quickstart/phoenix-inferences/README.md) * [resources](docs/resources/README.md) * [Contribute to Phoenix](docs/resources/contribute-to-phoenix.md) * [Frequently Asked Questions](docs/resources/frequently-asked-questions/README.md) * [Braintrust Open Source Alternative? LLM Evaluation Platform Comparison](docs/resources/frequently-asked-questions/braintrust-open-source-alternative-llm-evaluation-platform-comparison.md) * [Can I add other users to my Phoenix Instance?](docs/resources/frequently-asked-questions/can-i-add-other-users-to-my-phoenix-instance.md) * [Can I persist data in a notebook?](docs/resources/frequently-asked-questions/can-i-persist-data-in-a-notebook.md) * [Can I run Phoenix on Sagemaker?](docs/resources/frequently-asked-questions/can-i-run-phoenix-on-sagemaker.md) * [Can I use Azure OpenAI?](docs/resources/frequently-asked-questions/can-i-use-azure-openai.md) * [Can I use gRPC for trace collection?](docs/resources/frequently-asked-questions/can-i-use-grpc-for-trace-collection.md) * [Can I use Phoenix locally from a remote Jupyter instance?](docs/resources/frequently-asked-questions/can-i-use-phoenix-locally-from-a-remote-jupyter-instance.md) * [How can I configure the backend to send the data to the phoenix UI in another container?](docs/resources/frequently-asked-questions/how-can-i-configure-the-backend-to-send-the-data-to-the-phoenix-ui-in-another-container.md) * [How do I resolve Phoenix Evals showing NOT\_PARSABLE?](docs/resources/frequently-asked-questions/how-do-i-resolve-phoenix-evals-showing-not_parsable.md) * [Langfuse alternative? Arize Phoenix vs Langfuse: key differences](docs/resources/frequently-asked-questions/langfuse-alternative-arize-phoenix-vs-langfuse-key-differences.md) * [Open Source LangSmith Alternative: Arize Phoenix vs. LangSmith](docs/resources/frequently-asked-questions/open-source-langsmith-alternative-arize-phoenix-vs.-langsmith.md) * [Phoenix Cloud Migration Guide: Legacy to New Version](docs/resources/frequently-asked-questions/phoenix-cloud-migration-guide-legacy-to-new-version.md) * [What is LlamaTrace vs Phoenix Cloud?](docs/resources/frequently-asked-questions/what-is-llamatrace-vs-phoenix-cloud.md) * [What is my Phoenix Endpoint?](docs/resources/frequently-asked-questions/what-is-my-phoenix-endpoint.md) * [What is the difference between GRPC and HTTP?](docs/resources/frequently-asked-questions/what-is-the-difference-between-grpc-and-http.md) * [What is the difference between Phoenix and Arize?](docs/resources/frequently-asked-questions/what-is-the-difference-between-phoenix-and-arize.md) * [Will Phoenix Cloud be on the latest version of Phoenix?](docs/resources/frequently-asked-questions/will-phoenix-cloud-be-on-the-latest-version-of-phoenix.md) * [Cookbooks](docs/section-cookbooks/README.md) * [Table of contents](docs/section-cookbooks/SUMMARY.md) * [Cookbooks](docs/section-cookbooks/cookbooks.md) * [Structured Data Extraction](docs/section-cookbooks/structured-data-extraction.md) * [Agent Workflow Patterns](docs/section-cookbooks/agent-workflow-patterns/README.md) * [AutoGen](docs/section-cookbooks/agent-workflow-patterns/autogen.md) * [CrewAI](docs/section-cookbooks/agent-workflow-patterns/crewai.md) * [Google GenAI SDK (Manual Orchestration)](docs/section-cookbooks/agent-workflow-patterns/google-genai-sdk-manual-orchestration.md) * [LangGraph](docs/section-cookbooks/agent-workflow-patterns/langgraph.md) * [OpenAI Agents](docs/section-cookbooks/agent-workflow-patterns/openai-agents.md) * [Smolagents](docs/section-cookbooks/agent-workflow-patterns/smolagents.md) * [ai-engineering-workflows](docs/section-cookbooks/ai-engineering-workflows/README.md) * [Iterative Evaluation & Experimentation Workflow (Python)](docs/section-cookbooks/ai-engineering-workflows/iterative-evaluation-and-experimentation-workflow-python.md) * [Iterative Evaluation & Experimentation Workflow (TypeScript)](docs/section-cookbooks/ai-engineering-workflows/iterative-evaluation-and-experimentation-workflow-typescript.md) * [LLM Ops Overview](docs/section-cookbooks/ai-engineering-workflows/llm-ops-overview.md) * [datasets-and-experiments](docs/section-cookbooks/datasets-and-experiments/README.md) * [Analyzing Customer Review Evals with Repetition Experiments](docs/section-cookbooks/datasets-and-experiments/analyzing-customer-review-evals-with-repetition-experiments.md) * [Comparing LlamaIndex Query Engines with a Pairwise Evaluator](docs/section-cookbooks/datasets-and-experiments/comparing-llamaindex-query-engines-with-a-pairwise-evaluator.md) * [More Cookbooks](docs/section-cookbooks/datasets-and-experiments/cookbooks.md) * [Experiment with a Customer Support Agent](docs/section-cookbooks/datasets-and-experiments/experiment-with-a-customer-support-agent.md) * [Model Comparison for an Email Text Extraction Service](docs/section-cookbooks/datasets-and-experiments/model-comparison-for-an-email-text-extraction-service.md) * [Summarization](docs/section-cookbooks/datasets-and-experiments/summarization.md) * [Text2SQL](docs/section-cookbooks/datasets-and-experiments/text2sql.md) * [evaluation](docs/section-cookbooks/evaluation/README.md) * [Code Readability Evaluation](docs/section-cookbooks/evaluation/code-readability-evaluation.md) * [More Cookbooks](docs/section-cookbooks/evaluation/cookbooks.md) * [Evaluate a Talk-to-your-Data Agent](docs/section-cookbooks/evaluation/evaluate-an-agent.md) * [Evaluate RAG](docs/section-cookbooks/evaluation/evaluate-rag.md) * [OpenAI Agents SDK Cookbook](docs/section-cookbooks/evaluation/openai-agents-sdk-cookbook.md) * [Relevance Classification Evaluation](docs/section-cookbooks/evaluation/relevance-classification-evaluation.md) * [Using Ragas to Evaluate a Math Problem-Solving Agent](docs/section-cookbooks/evaluation/using-ragas-to-evaluate-a-math-problem-solving-agent.md) * [human-in-the-loop-workflows-annotations](docs/section-cookbooks/human-in-the-loop-workflows-annotations/README.md) * [Aligning LLM Evals with Human Annotations (TypeScript)](docs/section-cookbooks/human-in-the-loop-workflows-annotations/aligning-llm-evals-with-human-annotations-typescript.md) * [Creating a Custom LLM Evaluator with a Benchmark Dataset](docs/section-cookbooks/human-in-the-loop-workflows-annotations/creating-a-custom-llm-evaluator-with-a-benchmark-dataset.md) * [Using Human Annotations for Eval-Driven Development](docs/section-cookbooks/human-in-the-loop-workflows-annotations/using-human-annotations-for-eval-driven-development.md) * [prompt-engineering](docs/section-cookbooks/prompt-engineering/README.md) * [Chain-of-Thought Prompting](docs/section-cookbooks/prompt-engineering/chain-of-thought-prompting.md) * [Few Shot Prompting](docs/section-cookbooks/prompt-engineering/few-shot-prompting.md) * [LLM as a Judge Prompt Optimization](docs/section-cookbooks/prompt-engineering/llm-as-a-judge-prompt-optimization.md) * [Optimizing Coding Agent Prompts - Prompt Learning](docs/section-cookbooks/prompt-engineering/optimizing-coding-agent-prompts-prompt-learning.md) * [Prompt Learning - Optimizing Prompts for Classification](docs/section-cookbooks/prompt-engineering/prompt-learning-optimizing-prompts-for-classification.md) * [Prompt Optimization](docs/section-cookbooks/prompt-engineering/prompt-optimization.md) * [ReAct Prompting](docs/section-cookbooks/prompt-engineering/react-prompting.md) * [retrieval-and-inferences](docs/section-cookbooks/retrieval-and-inferences/README.md) * [More Cookbooks](docs/section-cookbooks/retrieval-and-inferences/cookbooks.md) * [Embeddings Analysis](docs/section-cookbooks/retrieval-and-inferences/embeddings-analysis.md) * [tracing](docs/section-cookbooks/tracing/README.md) * [Agentic RAG Tracing](docs/section-cookbooks/tracing/agentic-rag-tracing.md) * [More Cookbooks](docs/section-cookbooks/tracing/cookbooks.md) * [Generating Synthetic Datasets for LLM Evaluators & Agents](docs/section-cookbooks/tracing/generating-synthetic-datasets-for-llm-evaluators-and-agents.md) * [Product Recommendation Agent: Google Agent Engine & LangGraph](docs/section-cookbooks/tracing/product-recommendation-agent-google-agent-engine-and-langgraph.md) * [Structured Data Extraction](docs/section-cookbooks/tracing/structured-data-extraction.md) * [.gitbook](docs/section-cookbooks/.gitbook/README.md) * [includes](docs/section-cookbooks/.gitbook/includes/README.md) * [Untitled](docs/section-cookbooks/.gitbook/includes/untitled.md) * [Overview](docs/section-integrations/README.md) * [Table of contents](docs/section-integrations/SUMMARY.md) * [Phoenix MCP Server](docs/section-integrations/phoenix-mcp-server.md) * [evaluation-integrations](docs/section-integrations/evaluation-integrations/README.md) * [Cleanlab](docs/section-integrations/evaluation-integrations/cleanlab.md) * [Ragas](docs/section-integrations/evaluation-integrations/ragas.md) * [python](docs/section-integrations/python/README.md) * [MCP Tracing](docs/section-integrations/python/mcp-tracing.md) * [Agno](docs/section-integrations/python/agno/README.md) * [Agno Tracing](docs/section-integrations/python/agno/agno-tracing.md) * [AutoGen](docs/section-integrations/python/autogen/README.md) * [AutoGen AgentChat Tracing](docs/section-integrations/python/autogen/autogen-agentchat-tracing.md) * [AutoGen Tracing](docs/section-integrations/python/autogen/autogen-tracing.md) * [BeeAI](docs/section-integrations/python/beeai/README.md) * [BeeAI Tracing (Python)](docs/section-integrations/python/beeai/beeai-tracing-python.md) * [CrewAI](docs/section-integrations/python/crewai/README.md) * [CrewAI Tracing](docs/section-integrations/python/crewai/crewai-tracing.md) * [DSPy](docs/section-integrations/python/dspy/README.md) * [DSPy Tracing](docs/section-integrations/python/dspy/dspy-tracing.md) * [Google ADK](docs/section-integrations/python/google-adk/README.md) * [Google ADK Tracing](docs/section-integrations/python/google-adk/google-adk-tracing.md) * [Graphite](docs/section-integrations/python/graphite/README.md) * [Arize AX & Phoenix Integration Guide](docs/section-integrations/python/graphite/arize-integration.md) * [Guardrails AI](docs/section-integrations/python/guardrails-ai/README.md) * [Guardrails AI Tracing](docs/section-integrations/python/guardrails-ai/guardrails-ai-tracing.md) * [Haystack](docs/section-integrations/python/haystack/README.md) * [Haystack Tracing](docs/section-integrations/python/haystack/haystack-tracing.md) * [Hugging Face smolagents](docs/section-integrations/python/hugging-face-smolagents/README.md) * [smolagents Tracing](docs/section-integrations/python/hugging-face-smolagents/smolagents-tracing.md) * [Instructor](docs/section-integrations/python/instructor/README.md) * [Instructor Tracing](docs/section-integrations/python/instructor/instructor-tracing.md) * [LangChain](docs/section-integrations/python/langchain/README.md) * [LangChain Tracing](docs/section-integrations/python/langchain/langchain-tracing.md) * [LangGraph](docs/section-integrations/python/langgraph/README.md) * [LangGraph Tracing](docs/section-integrations/python/langgraph/langgraph-tracing.md) * [LlamaIndex](docs/section-integrations/python/llamaindex/README.md) * [LlamaIndex Tracing](docs/section-integrations/python/llamaindex/llamaindex-tracing.md) * [LlamaIndex Workflows Tracing](docs/section-integrations/python/llamaindex/llamaindex-workflows-tracing.md) * [Portkey](docs/section-integrations/python/portkey/README.md) * [Portkey Tracing](docs/section-integrations/python/portkey/portkey-tracing.md) * [Pydantic AI](docs/section-integrations/python/pydantic/README.md) * [Pydantic AI Evals](docs/section-integrations/python/pydantic/pydantic-evals.md) * [Pydantic AI Tracing](docs/section-integrations/python/pydantic/pydantic-tracing.md) * [typescript](docs/section-integrations/typescript/README.md) * [MCP Tracing](docs/section-integrations/typescript/mcp-tracing.md) * [BeeAI](docs/section-integrations/typescript/beeai/README.md) * [BeeAI Tracing (JS)](docs/section-integrations/typescript/beeai/beeai-tracing-js.md) * [LangChain](docs/section-integrations/typescript/langchain/README.md) * [LangChain.js](docs/section-integrations/typescript/langchain/langchain-js.md) * [Mastra](docs/section-integrations/typescript/mastra/README.md) * [Mastra Tracing](docs/section-integrations/typescript/mastra/mastra-tracing.md) * [Vercel](docs/section-integrations/typescript/vercel/README.md) * [Vercel AI SDK Tracing (JS)](docs/section-integrations/typescript/vercel/vercel-ai-sdk-tracing-js.md) * [vector-databases](docs/section-integrations/vector-databases/README.md) * [Couchbase](docs/section-integrations/vector-databases/couchbase.md) * [MongoDB](docs/section-integrations/vector-databases/mongodb.md) * [Pinecone](docs/section-integrations/vector-databases/pinecone.md) * [Qdrant](docs/section-integrations/vector-databases/qdrant.md) * [Weaviate](docs/section-integrations/vector-databases/weaviate.md) * [Zilliz / Milvus](docs/section-integrations/vector-databases/zilliz-milvus.md) * [.gitbook](docs/section-integrations/.gitbook/README.md) * [includes](docs/section-integrations/.gitbook/includes/README.md) * [TS - Launch Phoenix](docs/section-integrations/.gitbook/includes/ts-launch-phoenix.md) * [frameworks-and-platforms](docs/section-integrations/frameworks-and-platforms/README.md) * [Graphite](docs/section-integrations/frameworks-and-platforms/graphite/README.md) * [Arize AX & Phoenix Integration Guide](docs/section-integrations/frameworks-and-platforms/graphite/arize-integration.md) * [java](docs/section-integrations/java/README.md) * [Arconia](docs/section-integrations/java/arconia/README.md) * [Arconia Tracing](docs/section-integrations/java/arconia/arconia-tracing.md) * [LangChain4j](docs/section-integrations/java/langchain4j/README.md) * [LangChain4j Tracing](docs/section-integrations/java/langchain4j/langchain4j-tracing.md) * [Spring AI](docs/section-integrations/java/springai/README.md) * [Spring AI Tracing](docs/section-integrations/java/springai/springai-tracing.md) * [llm-providers](docs/section-integrations/llm-providers/README.md) * [Amazon Bedrock](docs/section-integrations/llm-providers/amazon-bedrock/README.md) * [Amazon Bedrock Agents Tracing](docs/section-integrations/llm-providers/amazon-bedrock/amazon-bedrock-agents-tracing.md) * [Amazon Bedrock Evals](docs/section-integrations/llm-providers/amazon-bedrock/amazon-bedrock-evals.md) * [Amazon Bedrock Tracing](docs/section-integrations/llm-providers/amazon-bedrock/amazon-bedrock-tracing.md) * [Anthropic](docs/section-integrations/llm-providers/anthropic/README.md) * [Anthropic Evals](docs/section-integrations/llm-providers/anthropic/anthropic-evals.md) * [Anthropic Tracing](docs/section-integrations/llm-providers/anthropic/anthropic-tracing.md) * [Google](docs/section-integrations/llm-providers/google-gen-ai/README.md) * [Gemini Evals](docs/section-integrations/llm-providers/google-gen-ai/gemini-evals.md) * [Evaluate CrewAI Agents with Google Gen AI Evals](docs/section-integrations/llm-providers/google-gen-ai/google-gen-ai-evals-1.md) * [Google Gen AI Evals](docs/section-integrations/llm-providers/google-gen-ai/google-gen-ai-evals.md) * [Google Gen AI Tracing](docs/section-integrations/llm-providers/google-gen-ai/google-genai-tracing.md) * [Groq](docs/section-integrations/llm-providers/groq/README.md) * [Groq Tracing](docs/section-integrations/llm-providers/groq/groq-tracing.md) * [LiteLLM](docs/section-integrations/llm-providers/litellm/README.md) * [LiteLLM Evals](docs/section-integrations/llm-providers/litellm/litellm-evals.md) * [LiteLLM Tracing](docs/section-integrations/llm-providers/litellm/litellm-tracing.md) * [MistralAI](docs/section-integrations/llm-providers/mistralai/README.md) * [MistralAI Evals](docs/section-integrations/llm-providers/mistralai/mistralai-evals.md) * [MistralAI Tracing](docs/section-integrations/llm-providers/mistralai/mistralai-tracing.md) * [OpenAI](docs/section-integrations/llm-providers/openai/README.md) * [OpenAI Agents SDK Tracing](docs/section-integrations/llm-providers/openai/openai-agents-sdk-tracing.md) * [OpenAI Evals](docs/section-integrations/llm-providers/openai/openai-evals.md) * [OpenAI Node.js SDK](docs/section-integrations/llm-providers/openai/openai-node.js-sdk.md) * [OpenAI Tracing](docs/section-integrations/llm-providers/openai/openai-tracing.md) * [OpenRouter](docs/section-integrations/llm-providers/openrouter/README.md) * [OpenRouter Tracing](docs/section-integrations/llm-providers/openrouter/openai-tracing.md) * [VertexAI](docs/section-integrations/llm-providers/vertexai/README.md) * [VertexAI Evals](docs/section-integrations/llm-providers/vertexai/vertexai-evals.md) * [VertexAI Tracing](docs/section-integrations/llm-providers/vertexai/vertexai-tracing.md) * [platforms](docs/section-integrations/platforms/README.md) * [Dify](docs/section-integrations/platforms/dify/README.md) * [Dify Tracing](docs/section-integrations/platforms/dify/dify-tracing.md) * [Flowise](docs/section-integrations/platforms/flowise/README.md) * [Flowise Tracing](docs/section-integrations/platforms/flowise/flowise-tracing.md) * [LangFlow](docs/section-integrations/platforms/langflow/README.md) * [LangFlow Tracing](docs/section-integrations/platforms/langflow/langflow-tracing.md) * [Prompt Flow](docs/section-integrations/platforms/prompt-flow/README.md) * [Prompt Flow Tracing](docs/section-integrations/platforms/prompt-flow/prompt-flow-tracing.md) * [Evaluating Multi-Agent Systems](docs/section-learn/README.md) * [Table of contents](docs/section-learn/SUMMARY.md) * [Inferences Concepts](docs/section-learn/inferences-concepts.md) * [Retrieval Evals on Document Chunks](docs/section-learn/retrieval-evals-on-document-chunks.md) * [context-engineering](docs/section-learn/context-engineering/README.md) * [Context Engineering Basics](docs/section-learn/context-engineering/context-engineering-concepts.md) * [datasets-and-experiments](docs/section-learn/datasets-and-experiments/README.md) * [Datasets Concepts](docs/section-learn/datasets-and-experiments/datasets-concepts.md) * [evaluation](docs/section-learn/evaluation/README.md) * [Custom Task Evaluation](docs/section-learn/evaluation/custom-task-evaluation.md) * [Eval Data Types](docs/section-learn/evaluation/eval-data-types.md) * [Evals With Explanations](docs/section-learn/evaluation/evals-with-explanations.md) * [Evaluators](docs/section-learn/evaluation/evaluators.md) * [LLM as a Judge](docs/section-learn/evaluation/llm-as-a-judge.md) * [prompt-engineering](docs/section-learn/prompt-engineering/README.md) * [Prompts Concepts](docs/section-learn/prompt-engineering/prompts-concepts.md) * [resources](docs/section-learn/resources/README.md) * [Contribute to Phoenix](docs/section-learn/resources/contribute-to-phoenix.md) * [Frequently Asked Questions](docs/section-learn/resources/faqs/README.md) * [Braintrust Open Source Alternative? LLM Evaluation Platform Comparison](docs/section-learn/resources/faqs/braintrust-open-source-alternative-llm-evaluation-platform-comparison.md) * [Can I add other users to my Phoenix Instance?](docs/section-learn/resources/faqs/can-i-add-other-users-to-my-phoenix-instance.md) * [Can I persist data in a notebook?](docs/section-learn/resources/faqs/can-i-persist-data-in-a-notebook.md) * [Can I run Phoenix on Sagemaker?](docs/section-learn/resources/faqs/can-i-run-phoenix-on-sagemaker.md) * [Can I use Azure OpenAI?](docs/section-learn/resources/faqs/can-i-use-azure-openai.md) * [Can I use gRPC for trace collection?](docs/section-learn/resources/faqs/can-i-use-grpc-for-trace-collection.md) * [Can I use Phoenix locally from a remote Jupyter instance?](docs/section-learn/resources/faqs/can-i-use-phoenix-locally-from-a-remote-jupyter-instance.md) * [How can I configure the backend to send the data to the phoenix UI in another container?](docs/section-learn/resources/faqs/how-can-i-configure-the-backend-to-send-the-data-to-the-phoenix-ui-in-another-container.md) * [How do I resolve Phoenix Evals showing NOT\_PARSABLE?](docs/section-learn/resources/faqs/how-do-i-resolve-phoenix-evals-showing-not_parsable.md) * [Langfuse alternative? Arize Phoenix vs Langfuse: key differences](docs/section-learn/resources/faqs/langfuse-alternatives.md) * [Open Source LangSmith Alternative: Arize Phoenix vs. LangSmith](docs/section-learn/resources/faqs/langsmith-alternatives.md) * [Phoenix Cloud Migration Guide: Legacy to New Version](docs/section-learn/resources/faqs/phoenix-cloud-migration-guide-legacy-to-new-version.md) * [What is LlamaTrace vs Phoenix Cloud?](docs/section-learn/resources/faqs/what-is-llamatrace-vs-phoenix-cloud.md) * [What is my Phoenix Endpoint?](docs/section-learn/resources/faqs/what-is-my-phoenix-endpoint.md) * [What is the difference between GRPC and HTTP?](docs/section-learn/resources/faqs/what-is-the-difference-between-grpc-and-http.md) * [What is the difference between Phoenix and Arize?](docs/section-learn/resources/faqs/what-is-the-difference-between-phoenix-and-arize.md) * [Will Phoenix Cloud be on the latest version of Phoenix?](docs/section-learn/resources/faqs/will-phoenix-cloud-be-on-the-latest-version-of-phoenix.md) * [retrieval-and-infrences](docs/section-learn/retrieval-and-infrences/README.md) * [Benchmarking Retrieval](docs/section-learn/retrieval-and-infrences/benchmarking-retrieval.md) * [Retrieval with Embeddings](docs/section-learn/retrieval-and-infrences/retrieval-with-embeddings.md) * [tracing](docs/section-learn/tracing/README.md) * [Annotations Concepts](docs/section-learn/tracing/annotations-concepts.md) * [FAQs: Tracing](docs/section-learn/tracing/faqs-tracing.md) * [How Tracing Works](docs/section-learn/tracing/how-tracing-works.md) * [What are Traces](docs/section-learn/tracing/what-are-traces.md) * [Release Notes](docs/section-release-notes/README.md) * [Table of contents](docs/section-release-notes/SUMMARY.md) * [01.2025](docs/section-release-notes/01.2025/README.md) * [01.18.2025: Automatic & Manual Span Tracing βš™οΈ](docs/section-release-notes/01.2025/01.18.2025-automatic-and-manual-span-tracing.md) * [02.2025](docs/section-release-notes/02.2025/README.md) * [02.18.2025: One-Line Instrumentation⚑️](docs/section-release-notes/02.2025/02.18.2025-one-line-instrumentation.md) * [02.19.2025: Prompts πŸ“ƒ](docs/section-release-notes/02.2025/02.19.2025-prompts.md) * [03.2025](docs/section-release-notes/03.2025/README.md) * [03.06.2025: Project Improvements πŸ“½οΈ](docs/section-release-notes/03.2025/03.06.2025-project-improvements.md) * [03.07.2025: Model Config Enhancements for Prompts πŸ’‘](docs/section-release-notes/03.2025/03.07.2025-model-config-enhancements-for-prompts.md) * [03.07.2025: New Prompt Playground, Evals, and Integration Support 🦾](docs/section-release-notes/03.2025/03.07.2025-new-prompt-playground-evals-and-integration-support.md) * [03.14.2025: OpenAI Agents Instrumentation πŸ“‘](docs/section-release-notes/03.2025/03.14.2025-openai-agents-instrumentation.md) * [03.18.2025: Resize Span, Trace, and Session Tables πŸ”€](docs/section-release-notes/03.2025/03.18.2025-resize-span-trace-and-session-tables.md) * [03.19.2025: Access to New Integrations in Projects πŸ”Œ](docs/section-release-notes/03.2025/03.19.2025-access-to-new-integrations-in-projects.md) * [03.20.2025: Delete Experiment from Action Menu πŸ—‘οΈ](docs/section-release-notes/03.2025/03.20.2025-delete-experiment-from-action-menu.md) * [03.21.2025: Environment Variable Based Admin User Configuration πŸ—οΈ](docs/section-release-notes/03.2025/03.21.2025-environment-variable-based-admin-user-configuration.md) * [03.24.2025: Tracing Configuration Tab πŸ–ŒοΈ](docs/section-release-notes/03.2025/03.24.2025-tracing-configuration-tab.md) * [03.27.2025: Span View Improvements πŸ‘€](docs/section-release-notes/03.2025/03.27.2025-span-view-improvements.md) * [04.2025](docs/section-release-notes/04.2025/README.md) * [04.01.2025: Support for MCP Span Tool Info in OpenAI Agents SDK πŸ”¨](docs/section-release-notes/04.2025/04.01.2025-support-for-mcp-span-tool-info-in-openai-agents-sdk.md) * [04.02.2025: Improved Span Annotation Editor ✍️](docs/section-release-notes/04.2025/04.02.2025-improved-span-annotation-editor.md) * [04.03.2025: Phoenix Client Prompt Tagging 🏷️](docs/section-release-notes/04.2025/04.03.2025-phoenix-client-prompt-tagging.md) * [04.09.2025: New REST API for Projects with RBAC πŸ“½οΈ](docs/section-release-notes/04.2025/04.09.2025-new-rest-api-for-projects-with-rbac.md) * [04.09.2025: Project Management API Enhancements ✨](docs/section-release-notes/04.2025/04.09.2025-project-management-api-enhancements.md) * [04.15.2025: Display Tool Call and Result IDs in Span Details πŸ«†](docs/section-release-notes/04.2025/04.15.2025-display-tool-call-and-result-ids-in-span-details.md) * [04.16.2025: API Key Generation via API πŸ”](docs/section-release-notes/04.2025/04.16.2025-api-key-generation-via-api.md) * [04.18.2025: Tracing for MCP Client-Server Applications πŸ”Œ](docs/section-release-notes/04.2025/04.18.2025-tracing-for-mcp-client-server-applications.md) * [04.25.2025: Scroll Selected Span Into View πŸ–±οΈ](docs/section-release-notes/04.2025/04.25.2025-scroll-selected-span-into-view.md) * [04.28.2025: Improved Shutdown Handling πŸ›‘](docs/section-release-notes/04.2025/04.28.2025-improved-shutdown-handling.md) * [04.28.2025: TLS Support for Phoenix Server πŸ”](docs/section-release-notes/04.2025/04.28.2025-tls-support-for-phoenix-server.md) * [04.30.2025: Span Querying & Data Extraction for Phoenix Client πŸ“Š](docs/section-release-notes/04.2025/04.30.2025-span-querying-and-data-extraction-for-phoenix-client.md) * [05.2025](docs/section-release-notes/05.2025/README.md) * [05.05.2025: OpenInference Google GenAI Instrumentation](docs/section-release-notes/05.2025/05.05.2025-openinference-google-genai-instrumentation.md) * [05.09.2025: Annotations, Data Retention Policies, Hotkeys πŸ““](docs/section-release-notes/05.2025/05.09.2025-annotations-data-retention-policies-hotkeys.md) * [05.14.2025: Experiments in the JS Client](docs/section-release-notes/05.2025/05.14.2025-experiments-in-the-js-client.md) * [05.20.2025: Datasets and Experiment Evaluations in the JS Client](docs/section-release-notes/05.2025/05.20.2025-datasets-and-experiment-evaluations-in-the-js-client.md) * [05.30.2025: xAI and Deepseek Support in Playground πŸ›](docs/section-release-notes/05.2025/05.30.2025-xai-and-deepseek-support-in-playground.md) * [06.2025](docs/section-release-notes/06.2025/README.md) * [06.03.2025: Deploy via Helm ☸️](docs/section-release-notes/06.2025/06.03.2025-deploy-via-helm.md) * [06.04.2025: Ollama Support in Playground πŸ›](docs/section-release-notes/06.2025/06.04.2025-ollama-support-in-playground.md) * [06.06.2025: Experiment Progress Graph πŸ“Š](docs/section-release-notes/06.2025/06.06.2025-experiment-progress-graph.md) * [06.12.2025: Dataset Filtering πŸ”](docs/section-release-notes/06.2025/06.12.2025-dataset-filtering.md) * [06.13.2025: Enhanced Span Creation and Logging πŸͺ](docs/section-release-notes/06.2025/06.13.2025-enhanced-span-creation-and-logging.md) * [06.13.2025: Session Filtering πŸͺ„](docs/section-release-notes/06.2025/06.13.2025-session-filtering.md) * [06.25.2025: Amazon Bedrock Support in Playground πŸ›](docs/section-release-notes/06.2025/06.25.2025-amazon-bedrock-support-in-playground.md) * [06.25.2025: Cost Tracking πŸ’°](docs/section-release-notes/06.2025/06.25.2025-cost-tracking.md) * [06.25.2025: New Phoenix Cloud ☁️](docs/section-release-notes/06.2025/06.25.2025-new-phoenix-cloud.md) * [07.2025](docs/section-release-notes/07.2025/README.md) * [07.02.2025: Cursor MCP Button ⚑️](docs/section-release-notes/07.2025/07.02.2025-cursor-mcp-button.md) * [07.03.2025: Cost Summaries in Trace Headers πŸ’Έ](docs/section-release-notes/07.2025/07.03.2025-cost-summaries-in-trace-headers.md) * [07.07.2025: Databse Disk Usage Monitor πŸ›‘](docs/section-release-notes/07.2025/07.07.2025-databse-disk-usage-monitor.md) * [07.09.2025: Baseline for Experiment Comparisons πŸ”](docs/section-release-notes/07.2025/07.09.2025-baseline-for-experiment-comparisons.md) * [07.13.2025: Experiments Module in phoenix-client πŸ§ͺ](docs/section-release-notes/07.2025/07.13.2025-experiments-module-in-phoenix-client.md) * [07.18.2025: OpenInference Java ✨](docs/section-release-notes/07.2025/07.18.2025-openinference-java.md) * [07.21.2025: Project and Trace Management via GraphQL πŸ“€](docs/section-release-notes/07.2025/07.21.2025-project-and-trace-management-via-graphql.md) * [07.25.2025: Average Metrics in Experiment Comparison Table πŸ“Š](docs/section-release-notes/07.2025/07.25.2025-average-metrics-in-experiment-comparison-table.md) * [07.25.2025: Project Dashboards πŸ“ˆ](docs/section-release-notes/07.2025/07.25.2025-project-dashboards.md) * [07.29.2025: Google GenAI Evals 🌐](docs/section-release-notes/07.2025/07.29.2025-google-genai-evals.md) * [08.2025](docs/section-release-notes/08.2025/README.md) * [08.03.2025: Delete Spans via REST API 🧹](docs/section-release-notes/08.2025/08.03.2025-delete-spans-via-rest-api.md) * [08.04.2025: Manual Project Creation & Trace Duplication πŸ“‚](docs/section-release-notes/08.2025/08.04.2025-manual-project-creation-and-trace-duplication.md) * [08.05.2025: Claude Opus 4-1 Support πŸ€–](docs/section-release-notes/08.2025/08.05.2025-claude-opus-4-1-support.md) * [08.06.2025: Expanded Search Capabilities πŸ”](docs/section-release-notes/08.2025/08.06.2025-expanded-search-capabilities.md) * [08.07.2025: Improved Error Handling in Prompt Playground ⚠️](docs/section-release-notes/08.2025/08.07.2025-improved-error-handling-in-prompt-playground.md) * [08.09.2025: Playground Support for GPT-5 πŸš€](docs/section-release-notes/08.2025/08.09.2025-playground-support-for-gpt-5.md) * [08.12.2025: UI Design Overhauls 🎨](docs/section-release-notes/08.2025/08.12.2025-ui-design-overhauls.md) * [08.14.2025: Trace Transfer for Long-Term Storage πŸ“¦](docs/section-release-notes/08.2025/08.14.2025-trace-transfer-for-long-term-storage.md) * [08.15.2025: Enhance Experiment Comparison Views πŸ§ͺ](docs/section-release-notes/08.2025/08.15.2025-enhance-experiment-comparison-views.md) * [08.20.2025: New Experiment and Annotation Quick Filters 🏎️](docs/section-release-notes/08.2025/08.20.2025-new-experiment-and-annotation-quick-filters.md) * [08.22.2025: New Trace Timeline View πŸ”­](docs/section-release-notes/08.2025/08.22.2025-new-trace-timeline-view.md) * [08.28.2025: New arize-phoenix-client Package πŸ“¦](docs/section-release-notes/08.2025/08.28.2025-new-arize-phoenix-client-package.md) * [09.2025](docs/section-release-notes/09.2025/README.md) * [09.03.2025: Add Methods to Log Document Annotations πŸ“œ](docs/section-release-notes/09.2025/09.03.2025-add-methods-to-log-document-annotations.md) * [09.04.2025: Experiment Lists Page Frontend Enhancements πŸ’»](docs/section-release-notes/09.2025/09.04.2025-experiment-lists-page-frontend-enhancements.md) * [09.08.2025: Experiment Annotation Popover in Detail View πŸ”](docs/section-release-notes/09.2025/09.08.2025-experiment-annotation-popover-in-detail-view.md) * [09.12.2025: Enable Paging in Experiment Compare Details πŸ“„](docs/section-release-notes/09.2025/09.12.2025-enable-paging-in-experiment-compare-details.md) * [09.15.2025: Prompt Labels 🏷️](docs/section-release-notes/09.2025/09.15.2025-prompt-labels.md) * [09.17.2025: Experiment compare details slideover in list view πŸ”](docs/section-release-notes/09.2025/09.17.2025-experiment-compare-details-slideover-in-list-view.md) * [09.22.2025: Helm configurable image registry & IPv6 support 🌐](docs/section-release-notes/09.2025/09.22.2025-helm-configurable-image-registry-and-ipv6-support.md) * [09.23.2025: Repetitions in experiment compare slideover πŸ”„](docs/section-release-notes/09.2025/09.23.2025-repetitions-in-experiment-compare-slideover.md) * [09.24.2025: Custom HTTP headers for requests in Playground πŸ› οΈ](docs/section-release-notes/09.2025/09.24.2025-custom-http-headers-for-requests-in-playground.md) * [09.25.2025: Repetitions πŸ”](docs/section-release-notes/09.2025/09.25.2025-repetitions.md) * [09.26.2025: Session AnnotationsπŸ—‚οΈ](docs/section-release-notes/09.2025/09.26.2025-session-annotations.md) * [09.27.2025: Dataset Splits πŸ“Š](docs/section-release-notes/09.2025/09.27.2025-dataset-splits.md) * [09.29.2025: Day 0 support for Claude Sonnet 4.5 ⚑](docs/section-release-notes/09.2025/09.29.2025-day-0-support-for-claude-sonnet-4.5.md) * [10.2025](docs/section-release-notes/10.2025/README.md) * [10.03.2025: Prompt Version Editing in Playground πŸ›](docs/section-release-notes/10.2025/10.03.2025-prompt-version-editing-in-playground.md) * [10.05.2025: Load Prompt by Tag into Playground πŸ›](docs/section-release-notes/10.2025/10.05.2025-load-prompt-by-tag-into-playground.md) * [10.06.2025: Paginate Compare Experiments πŸ“ƒ](docs/section-release-notes/10.2025/10.06.2025-paginate-compare-experiments.md) * [10.08.2025: Dataset Labels 🏷️](docs/section-release-notes/10.2025/10.08.2025-dataset-labels.md) * [10.10.2025: Viewer Role πŸ‘€](docs/section-release-notes/10.2025/10.10.2025-viewer-role.md) * [10.13.2025: View Traces in Compare Experiments πŸ§ͺ](docs/section-release-notes/10.2025/10.13.2025-view-traces-in-compare-experiments.md) * [10.15.2025: Enhanced Filtering for Examples Table πŸ”](docs/section-release-notes/10.2025/10.15.2025-enhanced-filtering-for-examples-table.md) * [10.18.2025: Filter Annotations in Compare Experiments Slideover ✍️](docs/section-release-notes/10.2025/10.18.2025-filter-annotations-in-compare-experiments-slideover.md) * [10.20.2025: Splits δ·–](docs/section-release-notes/10.2025/10.20.2025-splits.md) * [10.24.2025: Filter Prompts Page by Label 🏷️](docs/section-release-notes/10.2025/10.24.2025-filter-prompts-page-by-label.md) * [10.26.2025: Add Split Edit Menu to Examples δ·–](docs/section-release-notes/10.2025/10.26.2025-add-split-edit-menu-to-examples.md) * [10.28.2025: Enable AWS IAM Auth for DB Configuration πŸ”](docs/section-release-notes/10.2025/10.28.2025-enable-aws-iam-auth-for-db-configuration.md) * [10.30.2025: Metadata Support for Experiment Run Annotations 🧩](docs/section-release-notes/10.2025/10.30.2025-metadata-support-for-experiment-run-annotations.md) * [11.2025](docs/section-release-notes/11.2025/README.md) * [11.01.2025: Resume Experiments and Evaluations πŸ”„](docs/section-release-notes/11.2025/11.01.2025-resume-experiments-and-evaluations.md) * [11.03.2025: Playground Dataset Label Display 🏷️](docs/section-release-notes/11.2025/11.03.2025-playground-dataset-label-display.md) * [11.05.2025: Metadata for Prompts πŸ—‚οΈ](docs/section-release-notes/11.2025/11.05.2025-metadata-for-prompts.md) * [11.07.2025: Timezone Preference 🌍](docs/section-release-notes/11.2025/11.07.2025-timezone-preference.md) * [11.09.2025 OpenInference TypeScript 2.0 πŸ’»](docs/section-release-notes/11.2025/11.09.2025-openinference-typescript-2.0.md) * [11.12.2025: Updated Anthropic Model List 🧠](docs/section-release-notes/11.2025/11.12.2025-updated-anthropic-model-list.md) * [11.19.2025: Expanded Provider Support with OpenAI 5.1 + Gemini 3πŸ”§](docs/section-release-notes/11.2025/11.19.2025-expanded-provider-support-with-openai-5.1-+-gemini-3.md) * [11.23.2025: Repetitions for Manual Playground Invocations πŸ›](docs/section-release-notes/11.2025/11.23.2025-repetitions-for-manual-playground-invocations.md) * [11.25.2025: Split Assignments When Uploading a Dataset πŸ—‚οΈ](docs/section-release-notes/11.2025/11.25.2025-split-assignments-when-uploading-a-dataset.md) * [11.27.2025: Show Server Credential Setup in Playground API Keys πŸ”](docs/section-release-notes/11.2025/11.27.2025-show-server-credential-setup-in-playground-api-keys.md) * [11.29.2025: Add support for Claude Opus 4-5 πŸ€–](docs/section-release-notes/11.2025/11.29.2025-add-support-for-claude-opus-4-5.md) * [2024](docs/section-release-notes/2024/README.md) * [07.02.2024: Function Call Evaluations βš’οΈ](docs/section-release-notes/2024/07.02.2024-function-call-evaluations.md) * [07.03.2024: Datasets & Experiments πŸ§ͺ](docs/section-release-notes/2024/07.03.2024-datasets-and-experiments.md) * [07.11.2024: Hosted Phoenix and LlamaTrace πŸ’»](docs/section-release-notes/2024/07.11.2024-hosted-phoenix-and-llamatrace.md) * [07.18.2024: Guardrails AI IntegrationsπŸ’‚](docs/section-release-notes/2024/07.18.2024-guardrails-ai-integrations.md) * [09.26.2024: Authentication & RBAC πŸ”](docs/section-release-notes/2024/09.26.2024-authentication-and-rbac.md) * [11.18.2024: Prompt Playground πŸ›](docs/section-release-notes/2024/11.18.2024-prompt-playground.md) * [12.09.2024: Sessions πŸ’¬](docs/section-release-notes/2024/12.09.2024-sessions.md) * [.gitbook](docs/section-release-notes/.gitbook/README.md) * [includes](docs/section-release-notes/.gitbook/includes/README.md) * [Untitled](docs/section-release-notes/.gitbook/includes/untitled.md) * [Overview](docs/section-sdk-api-reference/README.md) * [Table of contents](docs/section-sdk-api-reference/SUMMARY.md) * [openinference-sdk](docs/section-sdk-api-reference/openinference-sdk/README.md) * [OpenInference Java](docs/section-sdk-api-reference/openinference-sdk/openinference-java.md) * [python](docs/section-sdk-api-reference/python/README.md) * [arize-phoenix-client](docs/section-sdk-api-reference/python/arize-phoenix-client.md) * [arize-phoenix-evals](docs/section-sdk-api-reference/python/arize-phoenix-evals.md) * [arize-phoenix-otel](docs/section-sdk-api-reference/python/arize-phoenix-otel.md) * [rest-api](docs/section-sdk-api-reference/rest-api/README.md) * [REST API Overview](docs/section-sdk-api-reference/rest-api/overview.md) * [API Reference](docs/section-sdk-api-reference/rest-api/api-reference/README.md) * [Annotation Configs](docs/section-sdk-api-reference/rest-api/api-reference/annotationconfig.md) * [Annotations](docs/section-sdk-api-reference/rest-api/api-reference/annotations.md) * [Datasets](docs/section-sdk-api-reference/rest-api/api-reference/datasets.md) * [Experiments](docs/section-sdk-api-reference/rest-api/api-reference/experiments.md) * [Projects](docs/section-sdk-api-reference/rest-api/api-reference/projects.md) * [Prompts](docs/section-sdk-api-reference/rest-api/api-reference/prompts.md) * [Sessions](docs/section-sdk-api-reference/rest-api/api-reference/sessions.md) * [Spans](docs/section-sdk-api-reference/rest-api/api-reference/spans.md) * [Traces](docs/section-sdk-api-reference/rest-api/api-reference/traces.md) * [Users](docs/section-sdk-api-reference/rest-api/api-reference/users.md) * [typescript](docs/section-sdk-api-reference/typescript/README.md) * [@arizeai/phoenix-client](docs/section-sdk-api-reference/typescript/arizeai-phoenix-client.md) * [@arizeai/phoenix-evals](docs/section-sdk-api-reference/typescript/arizeai-phoenix-evals.md) * [@arizeai/phoenix-otel](docs/section-sdk-api-reference/typescript/arizeai-phoenix-otel.md) * [MCP Server](docs/section-sdk-api-reference/typescript/mcp-server.md) * [TypeScript SDK Overview](docs/section-sdk-api-reference/typescript/overview.md) * [Self-Hosting](docs/section-self-hosting/README.md) * [Table of contents](docs/section-self-hosting/SUMMARY.md) * [Authentication](docs/section-self-hosting/authentication.md) * [Email Configuration](docs/section-self-hosting/email.md) * [FAQs](docs/section-self-hosting/frequently-asked-questions.md) * [License Overview (Elastic License 2.0)](docs/section-self-hosting/license.md) * [management](docs/section-self-hosting/management.md) * [provisioning](docs/section-self-hosting/provisioning.md) * [Configuration](docs/section-self-hosting/configuration/README.md) * [Using Amazon Aurora](docs/section-self-hosting/configuration/using-amazon-aurora.md) * [deployment-options](docs/section-self-hosting/deployment-options/README.md) * [AWS with CloudFormation](docs/section-self-hosting/deployment-options/aws-with-cloudformation.md) * [Docker](docs/section-self-hosting/deployment-options/docker.md) * [Kubernetes (helm)](docs/section-self-hosting/deployment-options/kubernetes-helm.md) * [Kubernetes](docs/section-self-hosting/deployment-options/kubernetes.md) * [Railway](docs/section-self-hosting/deployment-options/railway.md) * [features](docs/section-self-hosting/features/README.md) * [Authentication](docs/section-self-hosting/features/authentication.md) * [Email Configuration](docs/section-self-hosting/features/email.md) * [management](docs/section-self-hosting/features/management.md) * [provisioning](docs/section-self-hosting/features/provisioning.md) * [misc](docs/section-self-hosting/misc/README.md) * [FAQs](docs/section-self-hosting/misc/frequently-asked-questions.md) * [upgrade](docs/section-self-hosting/upgrade/README.md) * [Migrations](docs/section-self-hosting/upgrade/migrations.md) * [settings](docs/settings/README.md) * [Access Control (RBAC)](docs/settings/access-control-rbac.md) * [API Keys](docs/settings/api-keys.md) * [Data Retention](docs/settings/data-retention.md) * [Phoenix to Arize AX Migration](docs/settings/phoenix-to-arize-ax-migration.md) * [tracing](docs/tracing/README.md) * [Concepts: Tracing](docs/tracing/concepts-tracing.md) * [Features: Tracing](docs/tracing/features-tracing.md) * [Concepts: Tracing](docs/tracing/concepts-tracing/README.md) * [Annotations Concepts](docs/tracing/concepts-tracing/annotations-concepts.md) * [FAQs: Tracing](docs/tracing/concepts-tracing/faqs-tracing.md) * [How Tracing Works](docs/tracing/concepts-tracing/how-tracing-works.md) * [What are Traces](docs/tracing/concepts-tracing/what-are-traces.md) * [How-to: Tracing](docs/tracing/how-to-tracing/README.md) * [Add Metadata](docs/tracing/how-to-tracing/add-metadata/README.md) * [Add Attributes, Metadata, Users](docs/tracing/how-to-tracing/add-metadata/customize-spans.md) * [Instrument Prompt Templates and Prompt Variables](docs/tracing/how-to-tracing/add-metadata/instrumenting-prompt-templates-and-prompt-variables.md) * [Advanced](docs/tracing/how-to-tracing/advanced/README.md) * [Masking Span Attributes](docs/tracing/how-to-tracing/advanced/masking-span-attributes.md) * [Modifying Spans](docs/tracing/how-to-tracing/advanced/modifying-spans.md) * [Capture Multimodal Traces](docs/tracing/how-to-tracing/advanced/multimodal-tracing.md) * [Suppress Tracing](docs/tracing/how-to-tracing/advanced/suppress-tracing.md) * [Cost Tracking](docs/tracing/how-to-tracing/cost-tracking/README.md) * [Annotate Traces](docs/tracing/how-to-tracing/feedback-and-annotations/README.md) * [Annotating Auto-Instrumented Spans](docs/tracing/how-to-tracing/feedback-and-annotations/annotating-auto-instrumented-spans.md) * [Annotating in the UI](docs/tracing/how-to-tracing/feedback-and-annotations/annotating-in-the-ui.md) * [Annotating via the Client](docs/tracing/how-to-tracing/feedback-and-annotations/capture-feedback.md) * [Running Evals on Traces](docs/tracing/how-to-tracing/feedback-and-annotations/evaluating-phoenix-traces.md) * [Log Evaluation Results](docs/tracing/how-to-tracing/feedback-and-annotations/llm-evaluations.md) * [Importing & Exporting Traces](docs/tracing/how-to-tracing/importing-and-exporting-traces/README.md) * [Exporting Annotated Spans](docs/tracing/how-to-tracing/importing-and-exporting-traces/exporting-annotated-spans.md) * [Export Data & Query Spans](docs/tracing/how-to-tracing/importing-and-exporting-traces/extract-data-from-spans.md) * [Import Existing Traces](docs/tracing/how-to-tracing/importing-and-exporting-traces/importing-existing-traces.md) * [Setup Tracing](docs/tracing/how-to-tracing/setup-tracing/README.md) * [Setup using base OTEL](docs/tracing/how-to-tracing/setup-tracing/custom-spans.md) * [Using Tracing Helpers](docs/tracing/how-to-tracing/setup-tracing/instrument.md) * [Setup Tracing (TS)](docs/tracing/how-to-tracing/setup-tracing/javascript.md) * [Setup Projects](docs/tracing/how-to-tracing/setup-tracing/setup-projects.md) * [Setup Sessions](docs/tracing/how-to-tracing/setup-tracing/setup-sessions.md) * [Setup using Phoenix OTEL](docs/tracing/how-to-tracing/setup-tracing/setup-using-phoenix-otel.md) * [Overview: Tracing](docs/tracing/llm-traces/README.md) * [Annotations](docs/tracing/llm-traces/how-to-annotate-traces.md) * [Metrics](docs/tracing/llm-traces/metrics.md) * [Projects](docs/tracing/llm-traces/projects.md) * [Sessions](docs/tracing/llm-traces/sessions.md) * [use-cases](docs/use-cases/README.md) * [Evaluate RAG](docs/use-cases/rag-evaluation.md) * [.gitbook](docs/.gitbook/README.md) * [includes](docs/.gitbook/includes/README.md) * [Having trouble finding your...](docs/.gitbook/includes/having-trouble-finding-your....md) * [IntegrationsConfiguration](docs/.gitbook/includes/integrationsconfiguration.md) * [Launch Phoenix Python](docs/.gitbook/includes/launch-phoenix-python.md) * [Launch Phoenix TS](docs/.gitbook/includes/launch-phoenix-ts.md) * [Phoenix startup for tracing integrations](docs/.gitbook/includes/phoenix-startup-for-tracing-integrations.md) * [TS Quickstart](docs/.gitbook/includes/ts-quickstart.md) * [Untitled](docs/.gitbook/includes/untitled.md) * [locales](docs/locales/README.md) * [Arize Phoenix](docs/locales/jp/README.md) * [Table of contents](docs/locales/jp/SUMMARY.md) * [Arize Phoenix](docs/locales/zh/README.md) * [Table of contents](docs/locales/zh/SUMMARY.md) * [Phoenix Examples](examples/README.md) * [agent-framework-analysis](examples/agent_framework_comparison/README.md) * [Code Generation Agent Example](examples/code_gen_agent/README.md) * [Computer Use Agent Examples](examples/computer_use_agent/README.md) * [Running Evals with Cron](examples/cron-evals/README.md) * [Llama Researcher](examples/llamaindex-workflows-research-agent/README.md) * [Manually Instrument Your LLM Applications](examples/manually-instrumented-chatbot/README.md) * [Agentic RAG Examples](examples/rag_agent/README.md) * [Deploying Phoenix with a Reverse Proxy](examples/reverse-proxy/README.md) * [phoenix-helm](helm/README.md) * [Internal Documentation](internal_docs/README.md) * [On-Call Guide](internal_docs/on_call.md) * [specs](internal_docs/specs/README.md) * [Evals](internal_docs/specs/evals.md) * [Playground](internal_docs/specs/playground.md) * [Prompts](internal_docs/specs/prompts.md) * [Server Evaluators](internal_docs/specs/server_evaluators.md) * [vignettes](internal_docs/vignettes/README.md) * [PostgreSQL JSON vs JSONB Demo](internal_docs/vignettes/json-jsonb-demo/README.md) * [PostgreSQL with TLS Setup](internal_docs/vignettes/postgresql_tls/README.md) * [sqlalchemy](internal_docs/vignettes/sqlalchemy/README.md) * [SQLAlchemy Polymorphic User Example](internal_docs/vignettes/sqlalchemy/polymorphic_user/README.md) * [arize-phoenix TS](js/README.MD) * [Phoenix TS](js/DEVELOPMENT.md) * [Changesets](js/.changeset/README.md) * [examples](js/examples/README.md) * [JavaScript / Deno Notebook Examples](js/examples/notebooks/README.md) * [apps](js/examples/apps/README.md) * [TypeScript Experiments and Evals with Arize Phoenix](js/examples/apps/demo-document-relevancy-experiment/README.md) * [Phoenix Experiment Runner](js/examples/apps/phoenix-experiment-runner/README.md) * [packages](js/packages/README.md) * [@arizeai/phoenix-cli](js/packages/phoenix-cli/README.md) * [@arizeai/phoenix-cli](js/packages/phoenix-cli/CHANGELOG.md) * [Development Guide](js/packages/phoenix-cli/DEVELOPMENT.md) * [@arizeai/phoenix-client](js/packages/phoenix-client/README.md) * [@arizeai/phoenix-client](js/packages/phoenix-client/CHANGELOG.md) * [Development Guide for @arizeai/phoenix-client](js/packages/phoenix-client/DEVELOPMENT.md) * [Running phoenix-client Examples](js/packages/phoenix-client/examples/README.md) * [@arizeai/phoenix-evals](js/packages/phoenix-evals/README.md) * [@arizeai/phoenix-evals](js/packages/phoenix-evals/CHANGELOG.md) * [Running phoenix-evals Examples](js/packages/phoenix-evals/examples/README.md) * [Arize Phoenix MCP Server](js/packages/phoenix-mcp/README.md) * [@arizeai/phoenix-mcp](js/packages/phoenix-mcp/CHANGELOG.md) * [@arizeai/phoenix-otel](js/packages/phoenix-otel/README.md) * [@arizeai/phoenix-otel](js/packages/phoenix-otel/CHANGELOG.md) * [kustomize](kustomize/README.md) * [packages](packages/README.md) * [arize-phoenix-client](packages/phoenix-client/README.md) * [Changelog](packages/phoenix-client/CHANGELOG.md) * [docs](packages/phoenix-client/docs/README.md) * [source](packages/phoenix-client/docs/source/README.md) * [Phoenix Client Reference](packages/phoenix-client/docs/source/index.md) * [arize-phoenix-evals](packages/phoenix-evals/README.md) * [Changelog](packages/phoenix-evals/CHANGELOG.md) * [docs](packages/phoenix-evals/docs/README.md) * [source](packages/phoenix-evals/docs/source/README.md) * [Phoenix Evals Reference](packages/phoenix-evals/docs/source/index.md) * [arize-phoenix-otel](packages/phoenix-otel/README.md) * [Changelog](packages/phoenix-otel/CHANGELOG.md) * [Phoenix OTEL Documentation](packages/phoenix-otel/docs/README.md) * [source](packages/phoenix-otel/docs/source/README.md) * [Phoenix OTEL Reference](packages/phoenix-otel/docs/source/index.md) * [scripts](scripts/README.md) * [Analytics](scripts/analytics/README.md) * [Data Generation Scripts](scripts/generate_data_via_plpgsql/README.md) * [docker](scripts/docker/README.md) * [Phoenix Development Environment](scripts/docker/devops/README.md) * [Phoenix OIDC Debug Server](scripts/docker/devops/oidc-server/README.md) * [Phoenix SMTP Development Server](scripts/docker/devops/smtp-server/README.md) * [Vite Dev Server - Technical Notes](scripts/docker/devops/vite-dev/README.md) * [tutorials](tutorials/README.md) * [AI Evals Course](tutorials/ai_evals_course/README.md) * [Homework 3: LLM-as-Judge for Recipe Bot Evaluation with Phoenix](tutorials/ai_evals_course/hw3_phoenix/README.md) * [Lessons Learned](tutorials/ai_evals_course/hw3_phoenix/lessons_learned.md) * [Phoenix Methods Guide](tutorials/ai_evals_course/hw3_phoenix/phoenix_methods_guide.md) * [Homework 5 – Failure Analysis with Phoenix and LLM Evaluations](tutorials/ai_evals_course/hw5_phoenix/README.md) * [mcp](tutorials/mcp/README.md) * [How to Implement End-to-End Tracing for MCP Client-Server Applications](tutorials/mcp/tracing_between_mcp_client_and_server/README.md) * [agents](tutorials/agents/README.md) * [mastra](tutorials/agents/mastra/README.md) * [Mastra Agent with Arize Phoenix Tracing](tutorials/agents/mastra/example-agent/README.md) * [src](src/README.md) * [phoenix](src/phoenix/README.md) * [Database](src/phoenix/db/README.md) * [Phoenix Metrics](src/phoenix/metrics/README.md) * [server](src/phoenix/server/README.md) * [Permission Matrix for GraphQL API](src/phoenix/server/api/README.md) * [trace](src/phoenix/trace/README.md) * [dsl](src/phoenix/trace/dsl/README.md)