---
description: Explore the capabilities of Phoenix with notebooks
---

# Examples

## Tutorials

<table data-card-size="large" data-view="cards"><thead><tr><th></th><th data-hidden data-card-cover data-type="files"></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><strong>LLM Ops - Tracing, Evaluation, and Analysis</strong></td><td><a href=".gitbook/assets/Screenshot 2023-09-27 at 1.51.45 PM.png">Screenshot 2023-09-27 at 1.51.45 PM.png</a></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/llm_ops_overview.ipynb">https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/llm_ops_overview.ipynb</a></td></tr><tr><td><strong>Evaluation - Evaluating a RAG pipeline</strong></td><td><a href=".gitbook/assets/retriever_span_with_evals.png">retriever_span_with_evals.png</a></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_rag.ipynb">https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_rag.ipynb</a></td></tr><tr><td><strong>Agents - Experimenting with Agents</strong></td><td><a href=".gitbook/assets/Screenshot 2025-02-04 at 13.48@2x.png">Screenshot 2025-02-04 at 13.48@2x.png</a></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/agents-cookbook.ipynb">https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/agents-cookbook.ipynb</a></td></tr><tr><td><strong>Embedding Analysis - Search and Retrieval</strong></td><td><a href=".gitbook/assets/Screenshot 2023-09-27 at 1.53.06 PM.png">Screenshot 2023-09-27 at 1.53.06 PM.png</a></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/llama_index_search_and_retrieval_tutorial.ipynb">https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/llama_index_search_and_retrieval_tutorial.ipynb</a></td></tr></tbody></table>

## Application Examples

Example full-stack applications instrumented using OpenInference and observed via phoenix server instances.

<table data-card-size="large" data-view="cards"><thead><tr><th></th><th></th><th data-type="content-ref"></th><th data-type="files"></th><th data-hidden data-card-cover data-type="files"></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><strong>Python</strong></td><td>LlamaIndex, Fast API Instrumentation</td><td></td><td></td><td><a href=".gitbook/assets/python.png">python.png</a></td><td><a href="https://github.com/Arize-ai/openinference/tree/main/python/examples">https://github.com/Arize-ai/openinference/tree/main/python/examples</a></td></tr><tr><td><strong>Javascript</strong></td><td>OpenAI, Express, Next.JS</td><td></td><td></td><td><a href=".gitbook/assets/javascript.png">javascript.png</a></td><td><a href="https://github.com/Arize-ai/openinference/tree/main/js/examples">https://github.com/Arize-ai/openinference/tree/main/js/examples</a></td></tr><tr><td><strong>DSPy</strong></td><td>DSPy, Fast API Instrumentation</td><td></td><td></td><td><a href=".gitbook/assets/dspy_tiled.png">dspy_tiled.png</a></td><td><a href="https://github.com/Arize-ai/openinference/tree/main/python/examples/dspy-rag-fastapi">https://github.com/Arize-ai/openinference/tree/main/python/examples/dspy-rag-fastapi</a></td></tr><tr><td><strong>TypeScript Chatbot with User Feedback</strong></td><td>OpenAI, Express, Next.JS</td><td></td><td></td><td><a href=".gitbook/assets/ts-chatbot-with-annotations.png">ts-chatbot-with-annotations.png</a></td><td><a href="https://github.com/Arize-ai/openinference/tree/main/js/examples/openai">https://github.com/Arize-ai/openinference/tree/main/js/examples/openai</a></td></tr><tr><td><strong>Python Chatbot with User Feedback</strong></td><td>OpenAI, Streamlit</td><td></td><td></td><td><a href=".gitbook/assets/python-chatbot-with-annotations.png">python-chatbot-with-annotations.png</a></td><td><a href="https://github.com/Arize-ai/phoenix/tree/main/examples/manually-instrumented-chatbot">https://github.com/Arize-ai/phoenix/tree/main/examples/manually-instrumented-chatbot</a></td></tr></tbody></table>

## Agent Demos

<table data-view="cards"><thead><tr><th></th><th></th><th data-hidden data-card-target data-type="content-ref"></th><th data-hidden data-card-cover data-type="files"></th></tr></thead><tbody><tr><td><strong>RAG Agent Chatbot</strong></td><td></td><td><a href="https://colab.research.google.com/drive/1XQtFOjgoajiPsUrlO8FEGkU2rTagPzLf?usp=sharing">https://colab.research.google.com/drive/1XQtFOjgoajiPsUrlO8FEGkU2rTagPzLf?usp=sharing</a></td><td><a href=".gitbook/assets/persistence.png">persistence.png</a></td></tr><tr><td><strong>Code Generator Agent</strong></td><td></td><td><a href="https://colab.research.google.com/drive/11MQOIu9mwvuEya4PmFz3GgrQuOr-wyJl?usp=sharing">https://colab.research.google.com/drive/11MQOIu9mwvuEya4PmFz3GgrQuOr-wyJl?usp=sharing</a></td><td><a href=".gitbook/assets/terminal.png">terminal.png</a></td></tr><tr><td><strong>Computer Use Agent</strong></td><td></td><td></td><td><a href=".gitbook/assets/book-blue.png">book-blue.png</a></td></tr></tbody></table>

## LLM Traces

Trace through the execution of your LLM application to understand its internal structure and to troubleshoot issues with retrieval, tool execution, LLM calls, and more.

| Title                                                                                        | Topics                                                                                 | Links                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        |
| -------------------------------------------------------------------------------------------- | -------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
| Tracing an OpenAI App                                                                        | <ul><li>Tracing</li><li>Basics</li></ul>                                               | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/hosted_phoenix/hosted_phoenix_openai_tutorial.ipynb)                                                                                                                                                                                                                                                                                                                                                                |
| Tracing a LlamaIndex App                                                                     | <ul><li>Tracing</li><li>Basics</li></ul>                                               | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/hosted_phoenix/hosted_phoenix_llamaindex_tutorial.ipynb)                                                                                                                                                                                                                                                                                                                                                            |
| Retrieval Example with Evaluations: Fast UI Viz                                              | <ul><li>Evaluations</li><li>Retrieval</li></ul>                                        | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/llm_application_tracing_evaluating_and_analysis.ipynb)                                                                                                                                                                                                                                                                                                                                                              |
| Tracing and Evaluating a LlamaIndex + OpenAI RAG Application                                 | <ul><li>LlamaIndex</li><li>OpenAI</li><li>retrieval-augmented generation</li></ul>     | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/tracing/llama_index_tracing_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/tracing/llama_index_tracing_tutorial.ipynb)                                                                                                              |
| Tracing and Evaluating a LlamaIndex OpenAI Agent                                             | <ul><li>LlamaIndex</li><li>OpenAI</li><li>agents</li><li>function calling</li></ul>    | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/tracing/llama_index_openai_agent_tracing_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/tracing/llama_index_openai_agent_tracing_tutorial.ipynb)                                                                                    |
| Tracing and Evaluating a Structured Data Extraction Application with OpenAI Function Calling | <ul><li>OpenAI</li><li>structured data extraction</li><li>function calling</li></ul>   | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/tracing/openai_tracing_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/tracing/openai_tracing_tutorial.ipynb)                                                                                                                        |
| Tracing and Evaluating a LangChain + OpenAI RAG Application                                  | <ul><li>LangChain</li><li>OpenAI</li><li>retrieval-augmented generation</li></ul>      | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/tracing/langchain_tracing_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/tracing/langchain_tracing_tutorial.ipynb)                                                                                                                  |
| Tracing and Evaluating a LangChain Agent                                                     | <ul><li>LangChain</li><li>OpenAI</li><li>agents</li><li>function calling</li></ul>     | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/tracing/langchain_agent_tracing_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/tracing/langchain_agent_tracing_tutorial.ipynb)                                                                                                      |
| Tracing and Evaluation a DSPy Application                                                    | <ul><li>LangChain</li><li>Google PaLM</li><li>retrieval-augmented generation</li></ul> | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/tracing/dspy_tracing_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/tracing/dspy_tracing_tutorial.ipynb)                                                                                                                            |
| Tracing a LlamaIndex app with Sessions                                                       | <ul><li>LlamaIndex</li><li>Tracing</li><li>Sessions</li></ul>                          | <p><a href="https://github.com/Arize-ai/phoenix/blob/main/tutorials/tracing/openai_sessions_tutorial.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20Colab&#x26;logo=googlecolab&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=orange&#x26;label=%20" alt="Open in Colab"></a><br><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/tracing/project_sessions_llama_index_query_engine.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20GitHub&#x26;logo=github&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=white&#x26;label=%20" alt="Open in GitHub"></a></p> |
| Tracing an OpenAI app with Sessions                                                          | <ul><li>OpenAI</li><li>Tracing</li><li>Sessions</li></ul>                              | <p><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/tracing/openai_sessions_tutorial.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20Colab&#x26;logo=googlecolab&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=orange&#x26;label=%20" alt="Open in Colab"></a><br><a href="https://github.com/Arize-ai/phoenix/blob/main/tutorials/tracing/openai_sessions_tutorial.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20GitHub&#x26;logo=github&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=white&#x26;label=%20" alt="Open in GitHub"></a></p>                  |
| Tracing an OpenAI app with Sessions (JS/TS)                                                  | <ul><li>OpenAI</li><li>Tracing</li><li>Sessions</li></ul>                              | [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/js/examples/notebooks/tracing_openai_sessions_tutorial.ipynb)                                                                                                                                                                                                                                                                                                                                                                                           |

## Datasets and Experiments

Iteratively improve your LLM task by building datasets, running experiments, and evaluating performance using code and LLM-as-a-judge.

| Title                                                 | Topics                                                      | Links                                                                                                                                                                                                                                                                                                |
| ----------------------------------------------------- | ----------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Quickstart: Datasets and Experiments                  | <ul><li>datasets</li><li>experiments</li></ul>              | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/datasets_and_experiments_quickstart.ipynb)      |
| Text2SQL                                              | <ul><li>SQL generation</li></ul>                            | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/txt2sql.ipynb)                                  |
| Prompt Template Iteration for a Summarization Service | <ul><li>summarization</li></ul>                             | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/summarization.ipynb)                            |
| Answer Relevancy and Context Relevancy Evaluation     | <ul><li>RAG</li></ul>                                       | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/llama-index/answer_and_context_relevancy.ipynb) |
| Guideline Eval                                        | <ul><li>RAG</li></ul>                                       | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/llama-index/guideline_eval.ipynb)               |
| Pairwise Eval                                         | <ul><li>pairwise eval</li></ul>                             | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/llama-index/pairwise_eval.ipynb)                |
| LlamaIndex RAG with Reranker                          | <ul><li>LlamaIndex</li><li>RAG</li><li>re-rankers</li></ul> | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/run_experiments_with_llama_index.ipynb)         |
| LangChain Email Extraction                            | <ul><li>LangChain</li></ul>                                 | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/experiments/langchain_email_extraction.ipynb)               |

## LLM Evals

Leverage the power of large language models to evaluate your generative model or application for hallucinations, toxicity, relevance of retrieved documents, and more.

<table><thead><tr><th width="345">Title</th><th>Topics</th><th>Links</th></tr></thead><tbody><tr><td>Evaluating Hallucinations</td><td><ul><li>hallucinations</li></ul></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_hallucination_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20Colab&#x26;logo=googlecolab&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=orange&#x26;label=%20" alt="Open in Colab"></a> <a href="https://github.com/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_hallucination_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20GitHub&#x26;logo=github&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=white&#x26;label=%20" alt="Open in GitHub"></a></td></tr><tr><td>Evaluating Toxicity</td><td><ul><li>toxicity</li></ul></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_toxicity_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20Colab&#x26;logo=googlecolab&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=orange&#x26;label=%20" alt="Open in Colab"></a> <a href="https://github.com/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_toxicity_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20GitHub&#x26;logo=github&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=white&#x26;label=%20" alt="Open in GitHub"></a></td></tr><tr><td>Evaluating Relevance of Retrieved Documents</td><td><ul><li>document relevance</li></ul></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_relevance_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20Colab&#x26;logo=googlecolab&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=orange&#x26;label=%20" alt="Open in Colab"></a> <a href="https://github.com/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_relevance_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20GitHub&#x26;logo=github&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=white&#x26;label=%20" alt="Open in GitHub"></a></td></tr><tr><td>Evaluating Question-Answering</td><td><ul><li>question-answering</li></ul></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_QA_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20Colab&#x26;logo=googlecolab&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=orange&#x26;label=%20" alt="Open in Colab"></a> <a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_QA_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20GitHub&#x26;logo=github&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=white&#x26;label=%20" alt="Open in GitHub"></a></td></tr><tr><td>Evaluating Summarization</td><td><ul><li>summarization</li></ul></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_summarization_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20Colab&#x26;logo=googlecolab&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=orange&#x26;label=%20" alt="Open in Colab"></a> <a href="https://github.com/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_summarization_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20GitHub&#x26;logo=github&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=white&#x26;label=%20" alt="Open in GitHub"></a></td></tr><tr><td>Evaluating Code Readability</td><td><ul><li>code readability</li></ul></td><td><a href="https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_code_readability_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20Colab&#x26;logo=googlecolab&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=orange&#x26;label=%20" alt="Open in Colab"></a> <a href="https://github.com/Arize-ai/phoenix/blob/main/tutorials/evals/evaluate_code_readability_classifications.ipynb"><img src="https://img.shields.io/static/v1?message=Open%20in%20GitHub&#x26;logo=github&#x26;labelColor=grey&#x26;color=blue&#x26;logoColor=white&#x26;label=%20" alt="Open in GitHub"></a></td></tr></tbody></table>

## Retrieval-Augmented Generation Analysis

Visualize your generative application's retrieval process to surface failed retrievals and to find topics not addressed by your knowledge base.

| Title                                                      | Topics                                                                             | Links                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 |
| ---------------------------------------------------------- | ---------------------------------------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Evaluating and Improving Search and Retrieval Applications | <ul><li>LlamaIndex</li><li>retrieval-augmented generation</li></ul>                | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/llama_index_search_and_retrieval_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/llama_index_search_and_retrieval_tutorial.ipynb)             |
| Evaluating and Improving Search and Retrieval Applications | <ul><li>LlamaIndex</li><li>Milvus</li><li>retrieval-augmented generation</li></ul> | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/milvus_llamaindex_search_and_retrieval_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/milvus_llamaindex_search_and_retrieval_tutorial.ipynb) |

## Embedding Analysis

Explore lower-dimensional representations of your embedding data to identify clusters of high-drift and performance degradation.

| Title                                                             | Topics                                                     | Links                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   |
| ----------------------------------------------------------------- | ---------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Active Learning for a Drifting Image Classification Model         | <ul><li>image classification</li><li>fine-tuning</li></ul> | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/image_classification_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/image_classification_tutorial.ipynb)                       |
| Root-Cause Analysis for a Drifting Sentiment Classification Model | <ul><li>NLP</li><li>sentiment classification</li></ul>     | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/sentiment_classification_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/sentiment_classification_tutorial.ipynb)               |
| Troubleshooting an LLM Summarization Task                         | <ul><li>summarization</li></ul>                            | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/llm_summarization_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/llm_summarization_tutorial.ipynb)                             |
| Collect Chats with GPT                                            | <ul><li>LLMs</li></ul>                                     | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/llm_generative_gpt_4.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/llm_generative_gpt_4.ipynb)                                         |
| Find Clusters, Export, and Explore with GPT                       | <ul><li>LLMs</li><li>exploratory data analysis</li></ul>   | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/find_cluster_export_and_explore_with_gpt.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/find_cluster_export_and_explore_with_gpt.ipynb) |

## Structured Data Analysis

Statistically analyze your structured data to perform A/B analysis, temporal drift analysis, and more.

| Title                                   | Topics                                                   | Links                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |
| --------------------------------------- | -------------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| Detecting Fraud with Tabular Embeddings | <ul><li>tabular data</li><li>anomaly detection</li></ul> | [![Open in Colab](https://img.shields.io/static/v1?message=Open%20in%20Colab\&logo=googlecolab\&labelColor=grey\&color=blue\&logoColor=orange\&label=%20)](https://colab.research.google.com/github/Arize-ai/phoenix/blob/main/tutorials/credit_card_fraud_tutorial.ipynb) [![Open in GitHub](https://img.shields.io/static/v1?message=Open%20in%20GitHub\&logo=github\&labelColor=grey\&color=blue\&logoColor=white\&label=%20)](https://github.com/Arize-ai/phoenix/blob/main/tutorials/credit_card_fraud_tutorial.ipynb) |