Panoptes Streaming

https://github.com/yahoo/panoptes-stream
Admin
Panoptes Streaming is a cloud-native distributed streaming network telemetry platform that collects...
Tokens:19,890
Snippets:308
Trust Score:10
License:Apache-2.0
Update:6 months ago
Show doc for...
Tokens:
Raw
### Start Demo Environment with Docker Compose

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Starts the Panoptes demo environment including InfluxDB and Grafana using Docker Compose. Ensure Docker Compose is installed and the docker-compose.yml file is in the current directory.

```bash
docker-compose up -d
```

--------------------------------

### Example Global Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Set global parameters such as buffer sizes for Panoptes.

```yaml
bufferSize: 20000
outputBufferSize: 10000
```

--------------------------------

### Start Demonstration Containers

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_etcd_shards.md

Use Docker Compose to launch all necessary containers for the etcd-based demonstration. This command starts the Panoptes nodes, simulator, etcd, and monitoring tools in detached mode.

```bash
docker-compose -f docker-compose.etcd.yml up -d
```

--------------------------------

### Install Panoptes-Stream Helm Chart

Source: https://github.com/yahoo/panoptes-stream/blob/master/helm/README.md

Use this command to install the Panoptes-Stream Helm chart. Ensure Helm and Kubernetes prerequisites are met.

```bash
helm install panoptes-stream panoptes-stream
```

--------------------------------

### Start Panoptes Demo Containers

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_pseudo_shards.md

Launch the Panoptes demonstration environment using Docker Compose with a pseudo service discovery configuration.

```console
docker-compose -f docker-compose.pseudo.yml up -d
```

--------------------------------

### Example Device Options Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Configure default options for devices, including TLS settings, username, and password.

```yaml
deviceOptions:
  tlsConfig:
    Enabled: false
  username: "admin"
  password: "admin"
```

--------------------------------

### Example Logger Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Configure logging settings, specifying the level and output paths for logs and errors.

```yaml
logger:
  level: debug
  outputPaths:
    - /var/log/panoptes
  errorOutputPaths:
    - stderr
```

--------------------------------

### Example Dialout Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Configure dialout services, specifying the default output and service-specific addresses.

```yaml
dialout:
  defaultOutput: console::stdout,
  services: 
  	cisco.mdt: 
      addr: 0.0.0.0:50055
```

--------------------------------

### Example Shard Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Configure sharding parameters, including whether it's enabled, the number of nodes, and initializing shards.

```yaml
shards:
  enabled: true
  numberOfNodes: 2
  InitializingShards: 
```

--------------------------------

### Example Device Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Define device connection details and sensors to subscribe to. Ensure correct host, port, username, and password are provided.

```yaml
devices:
  - host: 192.168.55.3
    port: 50051
    username: admin
    password: admin
    sensors:
      - sensor1
```

--------------------------------

### Example Discovery Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Configure service discovery, specifying the service (e.g., 'consul') and its configuration details like the address.

```yaml
discovery:
  service: "consul"
  config:
    address: "127.0.0.1:8500"
```

--------------------------------

### Start Kafka Docker Containers

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_kafka.md

Starts the Kafka and Zookeeper services using a Docker Compose file. Use `docker-compose ps` to verify the containers are running.

```bash
docker-compose -f docker-compose.kafka.yml up -d
```

```bash
docker-compose -f docker-compose.kafka.yml ps
```

--------------------------------

### Run Panoptes with Consul Integration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/simulator_load_test.md

Starts the Panoptes binary, enabling integration with Consul and reading from standard input.

```bash
panoptes -consul -
```

--------------------------------

### Start Consul Agent

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/simulator_load_test.md

Starts a local Consul agent in development mode. This is often a prerequisite for running Panoptes.

```bash
consul agent -dev
```

--------------------------------

### Deploy Panoptes on Kubernetes with Helm

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Deploy Panoptes on Kubernetes using Helm charts. Includes steps for creating a namespace, installing Consul (optional), installing Panoptes, and verifying the deployment.

```bash
# Create Kubernetes namespace
kubectl create ns panoptes

# Install Consul for service discovery (optional)
helm repo add hashicorp https://helm.releases.hashicorp.com
helm install -f consul-values.yaml hashicorp hashicorp/consul

# Install Panoptes with Helm
helm install panoptes panoptes-stream -n panoptes

# Verify deployment
kubectl get pods -n panoptes -o wide
```

```bash
# View Consul UI via port-forward
kubectl port-forward service/hashicorp-consul-server 8500:8500

# Clean up
helm uninstall hashicorp
helm uninstall panoptes-stream

# Create GKE cluster (optional)
gcloud container clusters create panoptes-demo -z us-central1-b -m e2-medium
gcloud container clusters delete panoptes-demo -z us-central1-b
```

--------------------------------

### Start Panoptes Consul Demo Containers

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_consul_shards.md

This command initiates all necessary Docker containers for the Panoptes Consul demonstration using the provided docker-compose file. Ensure Docker is running.

```console
docker-compose -f docker-compose.consul.yml up -d
```

--------------------------------

### Example Device Configuration in JSON

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

JSON format for configuring a device in Panoptes. The key is the device name, and the value contains its properties.

```json
{
    "host": "core1.lax",
    "port": 50051,
    "sensors" : ["sensor1"],
    "username" : "demo",
    "password" : "demo"
}
```

--------------------------------

### Sample Consul YAML Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

Example of a YAML file used for Panoptes configuration when using Consul.

```yaml
address: 192.168.55.5:8500 
prefix: panoptes/config/
```

--------------------------------

### Example Status Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Configure the status server address. This setting determines where Panoptes exposes its status information.

```yaml
status:
  addr: "0.0.0.0:8081"
```

--------------------------------

### Start Docker Compose Services

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo.md

Use Docker Compose to start the Panoptes Stream demonstration environment in detached mode. Access the Grafana dashboard at http://localhost:3000 with user 'panoptes' and password 'panoptes'.

```console
# docker-compose up -d
```

--------------------------------

### Sample TLS Configuration (YAML)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_tls.md

Example of a TLS configuration in YAML format. This mirrors the JSON configuration, showing how to enable TLS and specify certificate paths.

```yaml
tlsConfig:
    enabled: true 
    caFile: /etc/panoptes/certs/ca.pem
    certFile: /etc/panoptes/cert.pem
    keyFile: /etc/panoptes/key.pem 
    insecureSkipVerify: true 
```

--------------------------------

### Install Consul using Helm

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/k8s_minikube.md

Installs Consul on your Kubernetes cluster using Helm. Ensure you have a 'consul-values.yaml' file configured.

```bash
helm repo add hashicorp https://helm.releases.hashicorp.com
helm install -f consul-values.yaml hashicorp hashicorp/consul
```

--------------------------------

### Run Panoptes with etcd Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_etcd.md

Use these commands to start Panoptes with etcd configuration, specifying either a YAML file or a dash for default settings.

```console
panoptes -etcd config.yaml
```

```console
panoptes -etcd -
```

--------------------------------

### Start GTD Demo Containers

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_gtd.md

Launch the Docker containers required for the Guaranteed Telemetry Delivery demonstration using the specified docker-compose file. Ensure Docker is running.

```console
docker-compose -f docker-compose.gtd.yml up -d
```

--------------------------------

### Install Panoptes-Stream using Helm

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/k8s.md

Installs Panoptes-Stream on the Kubernetes cluster using Helm. This command assumes you have configured the `panoptes-stream/values.yaml` file with appropriate settings for affinity, service discovery, and configuration.

```bash
# helm install panoptes-stream panoptes-stream
```

--------------------------------

### Install Panoptes Stream with Helm

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/helm.md

Deploy the Panoptes Stream application using Helm, specifying the release name and namespace.

```bash
helm install panoptes panoptes-stream -n panoptes
```

--------------------------------

### Example Global Configuration in JSON

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

JSON object for global Panoptes settings. This includes optional configurations for status, sharding, discovery, logging, and device options.

```json
{
  "status": {},
  "shard": {},
  "discovery": {},
  "dialout": {},
  "logger": {},
  "deviceOptions": {},
}
```

--------------------------------

### gNMI Stream Output Example

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/quick_start.md

This is an example of the JSON output stream received from Panoptes when collecting interface state counters. Metrics are reported every 10 seconds.

```json
{
  "key": "out-discards",
  "labels": {
    "name": "Ethernet2"
  },
  "prefix": "/interfaces/interface/state/counters",
  "system_id": "192.168.59.3",
  "timestamp": 1596848835935721428,
  "value": 0
}{
  "key": "out-errors",
  "labels": {
    "name": "Ethernet2"
  },
  "prefix": "/interfaces/interface/state/counters",
  "system_id": "192.168.59.3",
  "timestamp": 1596848835935724719,
  "value": 0
}{
  "key": "out-octets",
  "labels": {
    "name": "Ethernet2"
  },
  "prefix": "/interfaces/interface/state/counters",
  "system_id": "192.168.59.3",
  "timestamp": 1596918079559461774,
  "value": 4695711345
}
```

--------------------------------

### Example Sensor Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Configure sensors, specifying the data path, mode, sampling interval, service, and output. This sensor is assigned to devices in the 'devices' section.

```yaml
sensors:
  sensor1:
    path: /interfaces/interface/state/counters
    mode: sample
    sampleInterval: 10
    service: juniper.gnmi
    output: console::stdout
```

--------------------------------

### Run Panoptes with Consul Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

Use these commands to start Panoptes and specify the Consul configuration source. The '-' argument indicates default configuration.

```console
panoptes -consul config.yaml
```

```console
panoptes -consul -
```

--------------------------------

### List Running Containers

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_etcd_shards.md

Verify that all Docker containers for the demonstration have started successfully. This command lists the status of containers managed by the specified Docker Compose file.

```bash
docker-compose -f docker-compose.etcd.yml ps
```

--------------------------------

### Example Producer Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Define producers, such as Kafka, to send sensor data to. Specify the service type and configuration details like brokers and topics.

```yaml
producers:
  kafka1:
    service: kafka
    config:
      brokers:
        - 192.168.55.10:9092
      topics:
        - interfaces
        - bgp
```

--------------------------------

### etcd Configuration Management

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Use etcd as an alternative distributed key-value store for dynamic configuration. Start Panoptes with etcd configuration or use default.

```bash
# Start Panoptes with etcd configuration
panoptes -etcd config.yaml
# Or use default configuration
panoptes -etcd -
```

```yaml
# etcd-config.yaml
endpoints:
  - 192.168.55.5:2379
  - 192.168.55.6:2379
prefix: panoptes/config/
```

```bash
# Initialize etcd key structure
export ETCDCTL_API=3
etcdctl put panoptes/config/devices/
etcdctl put panoptes/config/database/
etcdctl put panoptes/config/producers/
etcdctl put panoptes/config/sensors/
etcdctl put panoptes/config/global {}

# Add device configuration
etcdctl put panoptes/config/devices/core1.lax '{ 
    "host": "core1.lax",
    "port": 50051,
    "sensors": ["sensor1"],
    "username": "demo",
    "password": "demo"
}'

# Backup and restore etcd
ETCDCTL_API=3 etcdctl snapshot save etcd_kv_snapshot
ETCDCTL_API=3 etcdctl snapshot --data-dir=/etcd restore etcd_kv_snapshot

# Environment variables for etcd
export PANOPTES_CONFIG_ETCD_ADDRESS=192.168.55.5:2379,192.168.55.6:2379
```

--------------------------------

### Panoptes Configuration Example

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_pseudo_shards.md

This YAML configuration defines devices, sensors, databases, discovery settings (using pseudo service discovery), and sharding parameters for Panoptes.

```yaml
devices:
  - host: device1.lax
    port: 50051
    sensors:
      - sensor1
  - host: device2.lax
    port: 50051
    sensors:
      - sensor1
  - host: device3.lax
    port: 50051
    sensors:
      - sensor1
  - host: device4.lax
    port: 50051
    sensors:
      - sensor1
  - host: device5.lax
    port: 50051
    sensors:
      - sensor1

sensors:
  sensor1:
    path: /interfaces/interface/state/counters
    mode: sample
    sampleInterval: 10
    service: juniper.gnmi
    output: influxdb1::ifcounters

databases:
  influxdb1:
    service: influxdb
    config:
      server: http://influxdb:8086
      bucket: mybucket

discovery:
  service: pseudo
  config:
    instances:
      - panoptes-node1:8081
      - panoptes-node2:8081
    probe: http
    path: /healthcheck

shards:
  enabled: true
  numberOfNodes: 2
  InitializingShards: 1

status:
  addr: "0.0.0.0:8081"

logger:
  level: debug
  outputPaths:
    - stdout
  errorOutputPaths:
    - stderr

```

--------------------------------

### Running Kafka Demo with Docker Compose

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Use Docker Compose to set up a Kafka environment for testing Panoptes integration. Commands are provided to start, check status, and consume messages from Kafka.

```bash
# Environment variable overrides for Kafka producer
export PANOPTES_PRODUCER_KAFKA01_BROKERS=192.168.55.10:9092

# Docker Compose example for Kafka demo
docker-compose -f docker-compose.kafka.yml up -d
docker-compose -f docker-compose.kafka.yml ps

# Consume messages from Kafka
docker exec -it kafka bash
cd /opt/bitnami/kafka/bin
kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic ifcounters --from-beginning
```

--------------------------------

### Consul Configuration Management

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Use Consul as a distributed key-value store for dynamic configuration. Start Panoptes with Consul configuration or use default.

```bash
# Start Panoptes with Consul configuration
panoptes -consul config.yaml
# Or use default configuration
panoptes -consul -
```

```yaml
# consul-config.yaml
address: 192.168.55.5:8500
prefix: panoptes/config/
```

```json
// Consul KV: panoptes/config/devices/core1.lax
{
    "host": "core1.lax",
    "port": 50051,
    "sensors": ["sensor1"],
    "username": "demo",
    "password": "demo"
}

// Consul KV: panoptes/config/sensors/sensor1
{
    "service": "cisco.gnmi",
    "path": "/interfaces/interface/state/counters",
    "mode": "sample",
    "sampleInterval": 10,
    "output": "console::stdout"
}

// Consul KV: panoptes/config/producers/kafka1
{
    "service": "kafka",
    "config": {
        "brokers": ["127.0.0.1:9092"],
        "topics": ["interface", "bgp"],
        "batchSize": 1000
    }
}

// Consul KV: panoptes/config/databases/influxdb1
{
    "service": "influxdb",
    "config": {
        "server": "http://localhost:8086",
        "bucket": "mybucket"
    }
}
```

```bash
# Initialize Consul with default configuration
curl https://raw.githubusercontent.com/yahoo/panoptes-stream/master/scripts/consul/init_config.json | consul kv import - 

# Backup and restore Consul configuration
consul kv export > panoptes.config.json
consul kv import @panoptes.config.json

# Environment variables for Consul
export PANOPTES_CONFIG_CONSUL_ADDRESS=127.0.0.1:8500
```

--------------------------------

### Sample TLS Configuration (JSON)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_tls.md

Example of a TLS configuration in JSON format. This includes enabling TLS, specifying CA, certificate, and key files, and an option to skip verification.

```json
"tlsConfig": {
    "enabled": true,
    "caFile": "/etc/panoptes/certs/ca.pem",
    "certFile": "/etc/panoptes/cert.pem",
    "keyFile": "/etc/panoptes/key.pem",
    "insecureSkipVerify": true
}
```

--------------------------------

### Example Sensor Configuration in JSON

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

JSON format for configuring a sensor in Panoptes. The key is the sensor name, and the value specifies its operational details.

```json
{
    "service": "cisco.gnmi",
    "path": "/interfaces/interface/state/counters",
    "mode": "sample",
    "sampleInterval": 10,
    "output":"console::stdout"
}
```

--------------------------------

### Install Panoptes-Stream using Helm

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/k8s_minikube.md

Deploys Panoptes-Stream to your Kubernetes cluster using Helm. This command assumes the Panoptes-Stream Helm chart is available.

```bash
helm install panoptes panoptes-stream
```

--------------------------------

### Start InfluxDB Container

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_gtd.md

Restart the InfluxDB container after a period of unavailability. Panoptes will then resume ingesting buffered metrics from NSQ.

```console
docker start influxdb
```

--------------------------------

### Example Discovery Configuration for etcd

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_etcd.md

This JSON snippet configures Panoptes' discovery service to register with etcd, essential for sharding features. It specifies etcd endpoints.

```json
"discovery": {
   "service": "etcd",
   "config": {
     "endpoints": ["127.0.0.1:2379"],
   }
 }
```

--------------------------------

### Example Database Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Configure databases, like InfluxDB, to store sensor data. Specify the service type and connection details such as the server URL and bucket name.

```yaml
databases:
  influxdb1:
    service: influxdb
    config:
      server: http://influxdb:8086
      bucket: mybucket
```

--------------------------------

### Example Kafka Producer Configuration in JSON

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

JSON format for configuring a Kafka producer in Panoptes. This includes broker addresses and topics for data output.

```json
{
    "service": "kafka",
    "config" : {
        "brokers": ["127.0.0.1:9092"],
         "topics":["interface","bgp"],
        "batchSize" : 1000
    }
}
```

--------------------------------

### Check Panoptes Consul Demo Container Status

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_consul_shards.md

Verify that all Docker containers for the Panoptes Consul demo have started successfully and are running as expected.

```console
docker-compose -f docker-compose.consul.yml ps
```

--------------------------------

### Example Discovery Configuration for Consul

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

JSON snippet for configuring Panoptes to register with Consul for service discovery, essential for features like sharding. Includes Consul address and health check URL.

```json
"discovery": {
   "service": "consul",
   "config": {
     "address": "127.0.0.1:8500",
     "healthcheckURL": "http://127.0.0.1:8081/healthcheck"
   }
 }
```

--------------------------------

### InfluxDB Configuration

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Configure Panoptes to send data to InfluxDB. Set environment variables for overrides and use Docker Compose for a demo setup.

```yaml
devices:
  - host: simulator
    port: 50051
    username: admin
    password: admin
    sensors:
      - sensor1

sensors:
  sensor1:
    path: /interfaces/interface/state/counters
    mode: sample
    sampleInterval: 5
    service: juniper.gnmi
    output: influxdb1::ifcounters

databases:
  influxdb1:
    service: influxdb
    config:
      server: http://influxdb:8086
      bucket: mybucket
      org: myorg
      token: my-super-secret-token
      batchSize: 1000
      maxRetries: 2
      timeout: 1
```

```bash
# Environment variable overrides for InfluxDB
export PANOPTES_DATABASE_INFLUXDB1_SERVER=http://influxdb:8086
export PANOPTES_DATABASE_INFLUXDB1_TOKEN=my-super-secret-token

# Docker Compose demo with InfluxDB and Grafana
docker-compose up -d

# Access Grafana dashboard at http://localhost:3000
# Default credentials: panoptes / panoptes
```

--------------------------------

### Example Status Configuration for Monitoring

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

JSON snippet for configuring Panoptes' self-monitoring and health check endpoints, which can be scraped by Prometheus. Includes optional TLS configuration.

```json
"status": {
    "addr": "0.0.0.0:8081",
    "tlsConfig": {
    "enabled": true,
    "certFile": "/demo/certs/panoptes.crt",
    "keyFile": "/demo/certs/panoptes.key"
   }
}
```

--------------------------------

### Start a Panoptes Node

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_etcd_shards.md

Restart a previously stopped Panoptes node to rejoin the cluster. This tests the process of a node re-integrating and resuming its shard responsibilities.

```bash
docker start panoptes-node2
```

--------------------------------

### Example InfluxDB Database Configuration in JSON

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

JSON format for configuring an InfluxDB database in Panoptes. Specify the server URL and bucket for storing time-series data.

```json
{
    "service": "influxdb",
    "config": {
    "server": "http://localhost:8086",
    "bucket":"mybucket"
    }
}
```

--------------------------------

### Example Status Configuration for Panoptes Metrics

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_etcd.md

This JSON snippet configures the status endpoint for Panoptes, enabling Prometheus to scrape metrics. It includes address and optional TLS settings.

```json
"status": {
    "addr": "0.0.0.0:8081",
    "tlsConfig": {
    "enabled": true,
    "certFile": "/demo/certs/panoptes.crt",
    "keyFile": "/demo/certs/panoptes.key",
   }
}
```

--------------------------------

### Example Telemetry Output

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

This JSON structure represents a single telemetry data point collected by Panoptes, including key, labels, prefix, system ID, timestamp, and value.

```json
{
  "key": "out-octets",
  "labels": {
    "name": "Ethernet2"
  },
  "prefix": "/interfaces/interface/state/counters",
  "system_id": "192.168.59.3",
  "timestamp": 1596918079559461774,
  "value": 4695711345
}
```

--------------------------------

### Initialize Fake Devices with Simulator Script

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/simulator_load_test.md

Uses the simulator_config.sh script to add a specified number of fake devices to the system. Requires sudo privileges.

```bash
sudo ./simulator_config.sh add 100
```

--------------------------------

### Checkout GitHub Repository

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_etcd_shards.md

Clone the Panoptes repository and navigate to the demo scripts directory. This is the initial step to access the demonstration files.

```bash
git checkout github.com/yahoo/panoptes-stream
cd panoptes-stream/scripts/demo_shards
```

--------------------------------

### Run Panoptes with Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_yaml.md

Execute Panoptes by specifying the configuration file path.

```console
panoptes -config config.yaml
```

--------------------------------

### Initialize etcd Configuration Keys

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_etcd.md

Set up initial empty configuration keys in etcd for various Panoptes components using the etcdctl command-line tool. Ensure ETCDCTL_API is set to 3.

```bash
export ETCDCTL_API=3
etcdctl put panoptes/config/devices/
etcdctl put panoptes/config/database/
etcdctl put panoptes/config/producers/
etcdctl put panoptes/config/sensors/
etcdctl put panoptes/config/global {}
```

--------------------------------

### Initialize Consul Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

Import initial configuration into Consul KV store using a curl command to fetch the configuration file.

```bash
curl https://raw.githubusercontent.com/yahoo/panoptes-stream/master/scripts/consul/init_config.json | consul kv import -
```

--------------------------------

### Configure Cisco MDT Sensor with Subscription Binding

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Sets up a sensor for Cisco MDT data using sample mode. It includes subscription binding, service type, and an option to disable the sensor.

```yaml
  # Cisco MDT with subscription binding
  cisco_telemetry:
    path: Cisco-IOS-XR-infra-statsd-oper:infra-statistics
    mode: sample
    sampleInterval: 30
    service: cisco.mdt
    subscription: sub1           # Subscription binding for Cisco
    output: kafka1::cisco
    disabled: false              # Enable/disable sensor
```

--------------------------------

### Configure Subscription for MDT Dial-in

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/cisco/readme.md

Set up a telemetry subscription, linking it to a sensor group and defining the sample interval for dial-in.

```text
Router(config)#telemetry model-driven  
Router(config-model-driven)#subscription Sub1  
Router(config-model-driven-subs)#sensor-group-id SubGroup1 sample-interval 30000  
Router(config-mdt-subscription)# commit
```

--------------------------------

### Configure Service Discovery

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Set up service discovery for Panoptes. Supports Consul, etcd, Kubernetes, and a pseudo mode.

```yaml
discovery:
  service: consul
  config:
    address: 127.0.0.1:8500
    healthcheckURL: http://127.0.0.1:8081/healthcheck
```

```yaml
discovery:
  service: etcd
  config:
    endpoints:
      - 127.0.0.1:2379
    healthcheckURL: http://127.0.0.1:8081/healthcheck
```

```yaml
discovery:
  service: k8s
  config:
    namespace: panoptes
```

```yaml
discovery:
  service: pseudo
  config:
    instances:
      - panoptes-node1:8081
      - panoptes-node2:8081
    probe: http
    path: /healthcheck
    timeout: 5
    interval: 10
    maxRetry: 3
```

--------------------------------

### Sample Panoptes etcd YAML Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_etcd.md

This YAML file defines etcd endpoints and the configuration prefix for Panoptes.

```yaml
endpoints:
  - 192.168.55.5:2379
  - 192.168.55.6:2379
prefix: panoptes/config/
```

--------------------------------

### Sample TLS Configuration with Vault (YAML)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_tls.md

YAML configuration for TLS using HashiCorp Vault. This shows how to enable TLS and reference a certificate stored in Vault using a specific key path.

```yaml
tlsConfig:
    enabled: true 
    certFile: __vault::panoptes/device/tls
    insecureSkipVerify: true 
```

--------------------------------

### Access Status and Prometheus Metrics via cURL

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Use cURL to access the health check and Prometheus metrics endpoints. Shows example metrics exposed by Panoptes.

```bash
# Health check endpoint
curl http://localhost:8081/healthcheck
# Response: panoptes alive and reachable

# Prometheus metrics endpoint
curl http://localhost:8081/metrics

# Example metrics exposed:
# panoptes_subscribed_devices - Number of currently subscribed devices
# panoptes_active_grpc_connections - Number of active gRPC connections
# panoptes_grpc_reconnects_total - Total gRPC reconnection attempts
```

--------------------------------

### Set Global Settings via Environment Variables

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Exports global configuration settings like buffer sizes as environment variables. This is an alternative to direct configuration file settings.

```bash
# Environment variables for global settings
export PANOPTES_BUFFERSIZE=20000
export PANOPTES_OUTPUTBUFFERSIZE=10000
```

--------------------------------

### Checkout GitHub Repository

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo.md

Clone the Panoptes Stream repository from GitHub and navigate into the project directory.

```bash
git checkout github.com/yahoo/panoptes-stream
cd panoptes-stream
```

--------------------------------

### Import Consul Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

Import configuration from a local JSON file ('panoptes.config.json') into the Consul KV store.

```bash
consul kv import @panoptes.config.json
```

--------------------------------

### Validation Show Commands for gRPC and MDT

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/cisco/readme.md

Commands to verify gRPC status and telemetry model-driven subscription configurations.

```text
show grpc
show telemetry model-driven subscription Sub1
show run telemetry model-driven
```

--------------------------------

### Service Discovery Configuration

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Configure service discovery using Consul, etcd, Kubernetes, or Pseudo for cluster node detection.

```yaml

```

--------------------------------

### Run the Simulator

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/simulator_load_test.md

Executes the simulator program. This is likely used to generate data or test device interactions.

```bash
simulator
```

--------------------------------

### Configure Global Buffer Settings

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Defines global buffer sizes for telemetry data and output buffers per producer. Also shows how to disable the configuration file watcher.

```yaml
# Global buffer configuration
bufferSize: 20000        # Shared buffer between telemetries
outputBufferSize: 10000  # Output buffer per producer or database
watcherDisabled: false   # Disable config file watcher (use SIGHUP instead)
```

--------------------------------

### Create Kubernetes Namespace

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/helm.md

Use this command to create a new Kubernetes namespace for the Panoptes deployment.

```bash
kubectl create ns panoptes
```

--------------------------------

### Clean Up Demonstration Environment

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_etcd_shards.md

Stop and remove all containers, networks, and volumes created by the Docker Compose file for the etcd demonstration. This command ensures a clean state after the demo.

```bash
docker-compose -f docker-compose.etcd.yml down
```

--------------------------------

### Save etcd Snapshot

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_etcd.md

Create a snapshot of the etcd key-value store for backup purposes. This command requires ETCDCTL_API to be set to 3.

```bash
ETCDCTL_API=3 etcdctl snapshot save etcd_kv_snapshot
```

--------------------------------

### Running Panoptes with YAML Configuration

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Execute Panoptes using a specified YAML configuration file. Docker is also supported for containerized deployments. View logs to monitor telemetry output.

```bash
# Run Panoptes with YAML configuration
panoptes -config config.yaml

# Or run with Docker
docker run -d --name panoptes \
  -v $PWD:/etc/panoptes \
  panoptes/panoptes-stream \
  -config /etc/panoptes/config.yaml

# View telemetry output
docker logs -f panoptes
```

--------------------------------

### Pseudo Service Discovery Configuration (YAML)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/discovery.md

YAML configuration for Pseudo service discovery. Define the instances, probe method, and path for health checks.

```yaml
discovery:
  service: pseudo
  config:
    instances:
      - panoptes-node1:8081
      - panoptes-node2:8081
    probe: http
    path: /healthcheck

```

--------------------------------

### Execute Panoptes (Docker)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/quick_start.md

Execute Panoptes stream using Docker. This command mounts the current directory to the container's /etc/panoptes and runs the stream client. View logs with `docker logs -f panoptes`.

```bash
docker run -d --name panoptes -v $PWD:/etc/panoptes panoptes/panoptes-stream -config /etc/panoptes/config.yaml
```

```bash
docker logs -f panoptes
```

--------------------------------

### Configure Global Device Options

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Sets default device connection options such as username, password, timeout, and TLS configuration. These are inherited by all devices unless overridden.

```yaml
# Global device options (inherited by all devices)
deviceOptions:
  username: admin
  password: admin
  timeout: 30
  tlsConfig:
    enabled: false
```

--------------------------------

### Checkout Panoptes Stream GitHub Repository

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_kafka.md

Clones the Panoptes Stream repository and navigates to the demo scripts directory.

```bash
git checkout github.com/yahoo/panoptes-stream
cd panoptes-stream/scripts/demo
```

--------------------------------

### Enable and Configure Sharding

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

Enable sharding for Panoptes nodes to auto-shard network devices and handle node failures. Specify the number of nodes and initial shards.

```json
{
   "shards" : {
      "enabled": true,
      "numberOfNodes": 3,
      "InitializingShards" : 1
    }
 }
```

--------------------------------

### Basic gNMI Configuration (.yaml)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/quick_start.md

This .yaml file configures Panoptes Stream to collect interface state counters from a device via gNMI. Ensure your device is configured for gNMI and adjust host, port, and service as needed.

```yaml
devices:
  - host: 192.168.55.3
    port: 50051
    sensors:
      - sensor1

sensors:
  sensor1:
    path: /interfaces/interface/state/counters
    mode: sample
    sampleInterval: 10
    service: arista.gnmi
    output: console::stdout
```

--------------------------------

### Pseudo Service Discovery Configuration (JSON)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/discovery.md

JSON configuration for the Pseudo service discovery. List the instances, probe type, and path for health checks.

```json
"discovery": {
    "service": "pseudo",
    "config": {
        "instances" : ["panoptes-node1:8081","panoptes-node1:8081"],
        "probe": "http",
        "path": "/healthcheck"
    }
}
```

--------------------------------

### Clean Up GTD Demo Resources

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_gtd.md

Stop and remove the Docker containers and associated network resources created for the Guaranteed Telemetry Delivery demonstration.

```console
docker-compose -f docker-compose.gtd.yml down
```

--------------------------------

### Configure Subscription for MDT Dial-out

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/cisco/readme.md

Set up a telemetry subscription for dial-out, linking it to a sensor group, destination, and defining the sample interval.

```text
Router(config)#telemetry model-driven  
Router(config-model-driven)#subscription Sub1  
Router(config-model-driven-subs)#sensor-group-id SubGroup1 sample-interval 30000  
Router(config-model-driven-subs)#destination-id panoptes 
Router(config-mdt-subscription)# commit
```

--------------------------------

### Clean Up Panoptes Demo Environment

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_pseudo_shards.md

Shut down and remove all containers and resources associated with the Panoptes pseudo service discovery demo.

```console
docker-compose -f docker-compose.pseudo.yml down
```

--------------------------------

### Set Default Device Options

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

Define shared configuration options for all devices, including username, password, and TLS settings. Device-specific configurations will override these.

```json
{
    "deviceOptions": {
        "username": "demo",
        "password": "demo",
        "tlsConfig": {
          "enabled": false,
          "certFile": "/demo/certs/panoptes.crt",
          "keyFile": "/demo/certs/panoptes.key",
          "insecureSkipVerify": true
        }
    }
}
```

--------------------------------

### Access Minikube Dashboard

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/k8s_minikube.md

Launches the Minikube dashboard in your default web browser, providing a graphical interface to manage your Minikube cluster.

```bash
minikube dashboard
```

--------------------------------

### Create GKE Cluster

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/k8s.md

Creates a Google Kubernetes Engine (GKE) cluster with specified machine types and zones. Use this if you don't have an existing Kubernetes cluster.

```bash
gcloud container clusters create panoptes-demo -z us-central1-b -m e2-medium
```

--------------------------------

### Sample TLS Configuration with Vault (JSON)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_tls.md

JSON configuration for TLS when using HashiCorp Vault to store certificates. It enables TLS and specifies the Vault path for the certificate file.

```json
"tlsConfig": {
    "enabled": true,
    "certFile": "__vault::panoptes/device/tls",
    "insecureSkipVerify": true
}
```

--------------------------------

### Configure Global Logging Settings

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Sets the logging level and specifies output paths for logs and errors. Supports multiple output destinations.

```yaml
# Logging configuration
logger:
  level: debug           # debug, info, warn, error
  outputPaths:
    - stdout
    - /var/log/panoptes/panoptes.log
  errorOutputPaths:
    - stderr
```

--------------------------------

### Panoptes Sensor Configuration

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/cisco/readme.md

Sample YAML configuration for Panoptes to use a Cisco MDT sensor.

```yaml
sensors:
  sensor1:
    subscription: Sub1
    service: cisco.mdt
    output: console::stdout
```

--------------------------------

### Configure gRPC Port for MDT Dial-in

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/cisco/readme.md

Configure the gRPC port and disable TLS for model-driven telemetry dial-in.

```text
Router# configure
Router (config)# grpc
Router (config-grpc)# port 50051
Router (config-grpc)# no-tls
```

--------------------------------

### Configure Default Device Options

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_etcd.md

Define shared configuration options for all devices, such as default username and password, and TLS settings. Device-specific configurations will override these global settings.

```json
"deviceOptions": {
    "username": "demo",
    "password": "demo",
    "tlsConfig": {
      "enabled": false,
      "certFile": "/demo/certs/panoptes.crt",
      "keyFile": "/demo/certs/panoptes.key",
      "insecureSkipVerify": true
    }
}

```

--------------------------------

### Configure Logging Level and Output

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_consul.md

Set the logging level (e.g., 'debug') and specify output destinations for Panoptes logs, such as 'stdout' or 'stderr'.

```json
{
    "logger": {
        "level":"debug", 
        "outputPaths": ["stdout"],
        "errorOutputPaths":["stderr"]
      }
  }
```

--------------------------------

### Configure Device TLS

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Enable TLS encryption for device connections. This includes specific device configurations and global device options.

```yaml
# Device TLS configuration
devices:
  - host: secure-router.example.com
    port: 50051
    username: admin
    password: admin
    tlsConfig:
      enabled: true
      certFile: /etc/panoptes/certs/device.crt
      keyFile: /etc/panoptes/certs/device.key
      caFile: /etc/panoptes/certs/ca.crt
      insecureSkipVerify: false
    sensors:
      - sensor1

# Global device options (applies to all devices)
deviceOptions:
  username: admin
  password: admin
  timeout: 30
  tlsConfig:
    enabled: true
    certFile: /etc/panoptes/certs/client.crt
    keyFile: /etc/panoptes/certs/client.key
    caFile: /etc/panoptes/certs/ca.crt
    insecureSkipVerify: false

# Status endpoint TLS
status:
  addr: "0.0.0.0:8081"
  tlsConfig:
    enabled: true
    certFile: /etc/panoptes/certs/panoptes.crt
    keyFile: /etc/panoptes/certs/panoptes.key
```

--------------------------------

### Clean Up Panoptes Consul Demo Environment

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_consul_shards.md

This command stops and removes all Docker containers, networks, and volumes created by the Panoptes Consul demonstration.

```console
docker-compose -f docker-compose.consul.yml down
```

--------------------------------

### Configure Status Endpoint and Prometheus Metrics

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Enable the status endpoint for monitoring and Prometheus metrics. Includes optional TLS configuration.

```yaml
# Enable status endpoint
status:
  addr: "0.0.0.0:8081"
  # Optional TLS
  # tlsConfig:
  #   enabled: true
  #   certFile: /path/to/cert.pem
  #   keyFile: /path/to/key.pem
```

--------------------------------

### Interact with Kafka Console Consumer and Topics

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/demo_kafka.md

Executes commands inside the Kafka container to consume messages from the 'ifcounters' topic and describe topic details. Ensure the Kafka container is running.

```bash
docker exec -it kafka bash
cd /opt/bitnami/kafka/bin
kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic ifcounters --from-beginning
kafka-topics.sh --describe --zookeeper zookeeper:2181 --topic ifcounters
```

--------------------------------

### Set Panoptes etcd Configuration via Environment Variable

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_etcd.md

Configure etcd connection details for Panoptes using environment variables in the specified format.

```bash
PANOPTES_CONFIG_ETCD_ADDRESS=192.168.55.5:2379,192.168.55.6:2379
```

--------------------------------

### Configure Interface Status Sensor (On-Change Mode)

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Configures a sensor for interface status changes, using 'on_change' mode to send updates only when data differs. Includes heartbeat and suppression settings.

```yaml
  # On-change mode: event-driven updates
  interface_status:
    path: /interfaces/interface/state/oper-status
    mode: on_change
    heartbeatInterval: 60        # Max silent period in seconds
    suppressRedundant: true      # Only send changed data
    service: cisco.gnmi
    output: influxdb1::status
```

--------------------------------

### Generate Server Certificate (Shell)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_tls.md

Command to generate a server certificate signed by a CA using cfssl. This requires the CA certificate and key, a configuration file, and a profile.

```shell
cfssl gencert \
  -ca=ca.pem \
  -ca-key=ca-key.pem \
  -config=ca-config.json \
  -profile=default \
  panoptes-csr.json | cfssljson -bare panoptes
```

--------------------------------

### Basic YAML Configuration for gNMI

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Configure Panoptes to collect interface counter telemetry using gNMI from an Arista device. Ensure the 'config.yaml' file is correctly formatted.

```yaml
# config.yaml - Basic gNMI configuration for interface counters
devices:
  - host: 192.168.55.3
    port: 50051
    username: admin
    password: admin
    sensors:
      - sensor1

sensors:
  sensor1:
    path: /interfaces/interface/state/counters
    mode: sample
    sampleInterval: 10
    service: arista.gnmi
    output: console::stdout
```

--------------------------------

### Access Consul UI via Minikube Service

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/k8s_minikube.md

Opens the Consul UI in your default web browser by creating a Minikube service. This allows you to inspect the Consul cluster.

```bash
minikube service hashicorp-consul-ui
```

--------------------------------

### etcd Service Discovery Configuration (YAML)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/discovery.md

This YAML configuration sets up etcd for service discovery. Ensure the endpoints and healthcheckURL are accurate.

```yaml
discovery:
  service: consul
  config:
    endpoints:
      - 127.0.0.1:2379
    healthcheckURL: "http://127.0.0.1:8081/healthcheck"  

```

--------------------------------

### Kubernetes Service Discovery Configuration (YAML)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/discovery.md

Use this YAML configuration to enable Kubernetes (k8s) service discovery. Specify the correct namespace where Panoptes pods are deployed.

```yaml
discovery:
  service: k8s
    config:
       namespace: panoptes 

```

--------------------------------

### Configure Logging Output

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_etcd.md

Set the logging level and specify output destinations for Panoptes. Logs can be directed to files, stdout, or stderr.

```json
"logger": {
    "level":"debug", 
    "outputPaths": ["stdout"],
    "errorOutputPaths":["stderr"]
  }

```

--------------------------------

### Server Certificate Signing Request (JSON)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/config_tls.md

JSON configuration for generating a Certificate Signing Request (CSR) for a server (e.g., Panoptes). It includes common name, hosts, key details, and subject names.

```json
{
  "CN": "localhost",
  "hosts": [
    "localhost",
    "127.0.0.1"
  ],
  "key": {
    "algo": "rsa",
    "size": 2048
  },
  "names": [
    {
      "C": "US",
      "L": "Los Angeles",
      "O": "Panoptes Labs",
      "OU": "Panoptes",
      "ST": "California"
    }
  ]
}
```

--------------------------------

### View Panoptes Node Logs

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Follows the logs of the panoptes-node container in real-time. Useful for debugging and monitoring the Panoptes stream.

```bash
docker logs -f panoptes-node
```

--------------------------------

### Kafka Producer Configuration for Telemetry

Source: https://context7.com/yahoo/panoptes-stream/llms.txt

Configure Panoptes to send telemetry data to Apache Kafka. Supports batching, compression, and optional TLS configuration. Environment variables can override producer settings.

```yaml
# config-kafka.yaml
devices:
  - host: simulator
    port: 50051
    username: admin
    password: admin
    sensors:
      - sensor1

sensors:
  sensor1:
    path: /interfaces/interface/state/counters
    mode: sample
    sampleInterval: 5
    service: juniper.gnmi
    output: kafka01::ifcounters

producers:
  kafka01:
    service: kafka
    config:
      brokers:
        - kafka:9092
      topics:
        - ifcounters
        - bgp
      batchSize: 1000
      batchTimeout: 1
      compression: gzip
      # Optional TLS configuration
      # tlsConfig:
      #   enabled: true
      #   certFile: /path/to/cert.pem
      #   keyFile: /path/to/key.pem
```

--------------------------------

### etcd Service Discovery Configuration (JSON)

Source: https://github.com/yahoo/panoptes-stream/blob/master/docs/discovery.md

Configure etcd for service discovery using this JSON format. Provide the correct endpoints and healthcheckURL.

```json
{
  "discovery": {
    "service": "consul",
    "config": {
      "endpoints": ["127.0.0.1:2379"],
      "healthcheckURL": "http://127.0.0.1:8081/healthcheck"
    }
  }
}
```
Tokens:
Raw