OpenTelemetry Instrumentation OpenAI V2

https://pypi.org/project/opentelemetry-instrumentation-openai-v2/

Admin

OpenTelemetry instrumentation library for tracing LLM requests and logging messages made by the...

Tokens:3,187

Snippets:57

Trust Score:10

Update:4 months ago

Show doc for...

Tokens:

Raw

### Installation

Source: https://pypi.org/project/opentelemetry-instrumentation-openai-v2/2.4b0

Install the opentelemetry-instrumentation-openai-v2 package.

```bash
pip install opentelemetry-instrumentation-openai-v2
```

--------------------------------

### Install the upload extra

Source: https://pypi.org/project/opentelemetry-instrumentation-openai-v2/2.4b0

Install the upload extra to pull in fsspec for uploading prompts and completions.

```bash
pip install opentelemetry-util-genai[upload]
```

--------------------------------

### Instrumenting all clients

Source: https://pypi.org/project/opentelemetry-instrumentation-openai-v2/2.4b0

Example of instrumenting all OpenAI clients and making chat completion and embeddings requests.

```python
from opentelemetry.instrumentation.openai_v2 import OpenAIInstrumentor

OpenAIInstrumentor().instrument()

client = OpenAI()
# Chat completion example
response = client.chat.completions.create(
    model="gpt-4o-mini",
    messages=[
        {"role": "user", "content": "Write a short poem on open telemetry."},
    ],
)

# Embeddings example
embedding_response = client.embeddings.create(
    model="text-embedding-3-small",
    input="Generate vector embeddings for this text"
)
```

--------------------------------

### Uninstrument

Source: https://pypi.org/project/opentelemetry-instrumentation-openai-v2/2.4b0

To uninstrument clients, call the uninstrument method.

```python
from opentelemetry.instrumentation.openai_v2 import OpenAIInstrumentor

OpenAIInstrumentor().instrument()
# ...

# Uninstrument all clients
OpenAIInstrumentor().uninstrument()
```

Tokens:

Raw