Elassandra

https://elassandra.readthedocs.io/en/latest/
Admin
Elassandra closely integrates Elasticsearch in Cassandra to provide powerful search capabilities on...
Tokens:50,640
Snippets:492
Trust Score:9.6
Update:5 months ago
Show doc for...
Tokens:
Raw
### Start Elassandra with SysV

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Start the Elassandra service using SysV init scripts, an alternative init system.

```bash
sudo service cassandra start

```

--------------------------------

### Start Elassandra with Systemd

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Start the Elassandra service using systemd, the standard init system for many Linux distributions.

```bash
sudo systemctl start cassandra

```

--------------------------------

### Install Elassandra via APT

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Update the package list and install Elassandra using the APT package manager.

```bash
sudo apt-get update && sudo apt-get install elassandra

```

--------------------------------

### Install Elasticsearch plugin

Source: https://elassandra.readthedocs.io/en/latest/integration.html

Standard command for installing Elasticsearch plugins. This remains unchanged when using Elassandra.

```bash
bin/plugin install <url>
```

--------------------------------

### Install APT Utilities

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Install necessary utilities for managing APT repositories, including HTTPS transport and GPG key management.

```bash
sudo apt-get install software-properties-common apt-transport-https gnupg2

```

--------------------------------

### Create Keyspace and Tables for Join Query Example

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Defines the keyspace and tables required for a join query example. Ensures data distribution consistency by using the same partition key across tables.

```cql
CREATE KEYSPACE IF NOT EXISTS example WITH REPLICATION = { 'class' : 'NetworkTopologyStrategy', 'DC1' : 1 };

CREATE TABLE IF NOT EXISTS example.books (books uuid PRIMARY KEY, title text, author text);
INSERT INTO example.books (books, title, author) VALUES (278078aa-095f-4aec-a048-a138f5071431, 'A Brief History of Time', 'Stephen Hawking');
INSERT INTO example.books (books, title, author) VALUES (7c592b75-475c-420d-980b-f035e1252787, 'The Universe in a Nutshell', 'Stephen Hawking');
INSERT INTO example.books (books, title, author) VALUES (f1662d47-afe7-4273-8544-d7663dcb7498, 'Relativity', 'Albert Einstein');
INSERT INTO example.books (books, title, author) VALUES (72cc85db-4ec1-455a-b893-e884607b3f9f, 'The World as I See It', 'Albert Einstein');

CREATE TABLE IF NOT EXISTS example.citations (books uuid, id uuid, words text, PRIMARY KEY (books, id));
INSERT INTO example.citations (books, id, words) VALUES (278078aa-095f-4aec-a048-a138f5071431, 0c46578e-4dcf-46d3-9136-8a2da187b8eb, 'Quiet people have the loudest minds.');
INSERT INTO example.citations (books, id, words) VALUES (278078aa-095f-4aec-a048-a138f5071431, f14942d8-281f-4835-813d-09254a0d70d8, 'Intelligence is the ability to adapt to change.');
INSERT INTO example.citations (books, id, words) VALUES (278078aa-095f-4aec-a048-a138f5071431, f9e3b0ba-2c52-484e-911e-d2e633baf41c, 'I don''t think the human race will survive the next thousand years, unless we spread into space.');
INSERT INTO example.citations (books, id, words) VALUES (f1662d47-afe7-4273-8544-d7663dcb7498, 72cc85db-4ec1-455a-b893-e884607b3f9f, 'Great spirits have always encountered violent opposition from mediocre minds.');
INSERT INTO example.citations (books, id, words) VALUES (f1662d47-afe7-4273-8544-d7663dcb7498, 70986be4-e586-4560-9405-12c290e9e0ab, 'If you can''t explain it to a six year old, you don''t understand it yourself.');

CREATE TABLE IF NOT EXISTS example.editions (books uuid, editor text, isbn text, available boolean, PRIMARY KEY ((books), editor));
INSERT INTO example.editions (books, editor, isbn, available) VALUES (278078aa-095f-4aec-a048-a138f5071431, 'Bantam Press', '0857501003', true);
INSERT INTO example.editions (books, editor, isbn, available) VALUES (7c592b75-475c-420d-980b-f035e1252787, 'Bantam Press', '9780593048153', false);
INSERT INTO example.editions (books, editor, isbn, available) VALUES (f1662d47-afe7-4273-8544-d7663dcb7498, 'Penguin Classics', '0143039822', false);
INSERT INTO example.editions (books, editor, isbn, available) VALUES (f1662d47-afe7-4273-8544-d7663dcb7498, 'GENERAL PRESS', 'B00R86QABW', false);
INSERT INTO example.editions (books, editor, isbn, available) VALUES (72cc85db-4ec1-455a-b893-e884607b3f9f, 'Filiquarian Publishing', '1599869659', false);

```

--------------------------------

### Install Elassandra via YUM/DNF

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Install Elassandra using the YUM or DNF package manager after configuring the repository.

```bash
sudo yum install elassandra

```

--------------------------------

### Install OpenJDK 8 on Debian Jessie

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Install the OpenJDK 8 Java Runtime Environment on Debian Jessie from backports, which is a prerequisite for Elassandra.

```bash
sudo apt-get install -t jessie-backports openjdk-8-jre-headless

```

--------------------------------

### Start and Scale Elassandra Cluster with Docker Compose

Source: https://elassandra.readthedocs.io/en/latest/quickstart.html

Commands to start the Docker containers and scale the Elassandra cluster. Use `--scale node=0` to initialize without extra nodes, then `--scale node=1` to add one.

```bash
docker-compose --project-name test -f docker-compose.yml up -d --scale node=0
docker-compose --project-name test -f docker-compose.yml up -d --scale node=1

```

--------------------------------

### Start Elassandra with Elasticsearch Enabled

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Start the Elassandra service with Elasticsearch enabled using the '-e' option. Configuration can be adjusted in conf/cassandra.yaml.

```bash
bin/cassandra -e

```

--------------------------------

### Elassandra Build Unit Test Example

Source: https://elassandra.readthedocs.io/en/latest/testing.html

This test class extends ESSingleNodeTestCase and demonstrates using both Elasticsearch API and CQL requests for creating tables, inserting data, and querying. It includes setup for indices, mappings, and assertions for data existence and counts. Ensure the 'cmdb' index and 'server' type are correctly configured for these operations.

```java
public class BasicTests extends ESSingleNodeTestCase {

    @Test
    public void testTest() throws Exception {
     createIndex("cmdb");
     ensureGreen("cmdb");

     process(ConsistencyLevel.ONE,"CREATE TABLE cmdb.server ( name text, ip inet, netmask int, prod boolean, primary key (name))");
     assertAcked(client().admin().indices().preparePutMapping("cmdb")
             .setType("server")
             .setSource("{ \"server\" : { \"discover\" : \".*\", \"properties\": { \"name\":{ \"type\":\"keyword\" }}}})
             .get());

     process(ConsistencyLevel.ONE,"insert into cmdb.server (name,ip,netmask,prod) VALUES ('localhost','127.0.0.1',8,true)");
     process(ConsistencyLevel.ONE,"insert into cmdb.server (name,ip,netmask,prod) VALUES ('my-server','123.45.67.78',24,true)");

     assertThat(client().prepareGet().setIndex("cmdb").setType("server").setId("my-server").get().isExists(), equalTo(true));
     assertThat(client().prepareGet().setIndex("cmdb").setType("server").setId("localhost").get().isExists(), equalTo(true));

     assertEquals(client().prepareIndex("cmdb", "server", "bigserver234")
         .setSource("{\"ip\": \"22.22.22.22\", \"netmask\":32, \"prod\" : true, \"description\": \"my big server\" }")
         .get().getResult(), DocWriteResponse.Result.CREATED);

     assertThat(client().prepareSearch().setIndices("cmdb").setTypes("server").setQuery(QueryBuilders.queryStringQuery("*:*")).get().getHits().getTotalHits(), equalTo(3L));
    }
}

```

--------------------------------

### Elassandra SSL Configuration Example

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

This is an example configuration snippet for `conf/cassandra.yaml` demonstrating how to configure SSL network encryption for Elassandra. It includes comments explaining inter-node encryption options like 'all', 'none', 'dc', and 'rack'.

```yaml
# Enable or disable inter-node encryption
# Default settings are TLS v1, RSA 1024-bit keys (it is imperative that
# users generate their own keys) TLS_RSA_WITH_AES_128_CBC_SHA as the cipher
# suite for authentication, key exchange and encryption of the actual data transfers.
# Use the DHE/ECDHE ciphers if running in FIPS 140 compliant mode.
# NOTE: No custom encryption options are enabled at the moment
# The available internode options are : all, none, dc, rack
#
# If set to dc cassandra will encrypt the traffic between the DCs
# If set to rack cassandra will encrypt the traffic between the racks
#
```

--------------------------------

### Start Elassandra Server Instance

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Launches a detached Elassandra instance named 'node0' using a specific version of the Docker image.

```bash
docker run --name node0 -d strapdata/elassandra:6.8.4.13
```

--------------------------------

### Add Elassandra APT Repository

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Add the Elassandra APT repository and its GPG key to your system's sources for package installation.

```bash
sudo add-apt-repository 'deb [arch=all] https://nexus.repo.strapdata.com/repository/apt-releases/ stretch main'
sudo apt-key adv --keyserver hkp://keyserver.ubuntu.com:80 --recv-keys B335A4DD

```

--------------------------------

### Start Cassandra-only nodes

Source: https://elassandra.readthedocs.io/en/latest/integration.html

Use this command to start Cassandra-only nodes in a new datacenter during integration. Ensure auto_bootstrap is set to false in cassandra.yaml.

```bash
bin/cassandra
```

--------------------------------

### Navigate to Elassandra Directory

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Change the current directory to the extracted Elassandra installation folder.

```bash
cd elassandra-6.8.4.13

```

--------------------------------

### Install Elassandra Helm Chart

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Install the Elassandra Helm chart on your Kubernetes cluster. Specify the namespace and the desired image tag for the Elassandra version.

```bash
helm install -n elassandra --set image.tag="6.8.4.13" strapdata/elassandra
```

--------------------------------

### Start Elassandra nodes with Elasticsearch

Source: https://elassandra.readthedocs.io/en/latest/integration.html

Command to start Elassandra nodes with Elasticsearch enabled in a new datacenter. This is done after Cassandra-only nodes have joined the cluster.

```bash
bin/cassandra -e
```

--------------------------------

### Check Java Version

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Verify the installed Java version. Elassandra requires at least Java 8.

```bash
$ java -version
java version "1.8.0_121"
Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)

```

--------------------------------

### JMXTerm Example for Elasticsearch Index Metrics

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Connect to Elassandra using JMXTerm to query Elasticsearch index metrics. This example demonstrates how to set the domain and bean, then retrieve all attributes for a specific index shard.

```shell
java -jar jmxterm-1.0.0-uber.jar -l localhost:7199
$>domain org.elasticsearch.index
#domain is set to org.elasticsearch.index
$>bean org.elasticsearch.index:name=sales_2017,scope=search,type=IndexShard
#bean is set to org.elasticsearch.index:name=sales_2017,scope=search,type=IndexShard
$>get *
#mbean = org.elasticsearch.index:name=sales_2017,scope=search,type=IndexShard:
QueryTotal = 21;
FetchTotal = 0;
ScrollTotal = 0;
QueryTimeInMillis = 56038;
QueryCurrent = 0;
FetchTimeInMillis = 0;
FetchCurrent = 0;
ScrollTimeInMillis = 0;
ScrollCurrent = 0;
SuggestCount = 0;
SuggestTimeInMillis = 0;
SuggestCurrent = 0;
$>
```

--------------------------------

### Example Audit Log Entries (Logback)

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Sample output from the audit.log file, showing timestamp, status code, event type, user, and access details.

```text
2017-10-20 14:11:49,854 200,PERMISSION,sales,roles/sales,/10.0.1.5,indices:data/read/search,[sales_*]
2017-10-20 14:11:51,607 200,PERMISSION,sales,roles/sales,/10.0.1.5,indices:data/read/search,[.kibana]
2017-10-20 14:11:52,377 200,PRIVILEGE,kibana,roles/kibana,/10.0.1.5,cluster:monitor/main,null
2017-10-20 14:11:52,501 200,PRIVILEGE,kibana,roles/kibana,/10.0.1.5,cluster:monitor/nodes/info,null
2017-10-20 14:11:52,627 200,PRIVILEGE,kibana,roles/kibana,/10.0.1.5,cluster:monitor/nodes/info,null
2017-10-20 14:11:52,679 200,PERMISSION,sales,roles/sales,/10.0.1.5,indices:data/read/mget[shard],[.kibana]
2017-10-20 14:11:52,751 200,PERMISSION,kibana,roles/kibana,/10.0.1.5,indices:data/read/mget[shard],[.kibana]
2017-10-20 14:11:52,868 200,PRIVILEGE,kibana,roles/kibana,/10.0.1.5,cluster:monitor/health,[.kibana]
2017-10-20 14:11:52,990 200,PERMISSION,kibana,roles/kibana,/10.0.1.5,indices:data/read/search,[.kibana]
```

--------------------------------

### Insert Data and Query Timeseries Table

Source: https://elassandra.readthedocs.io/en/latest/mapping.html

Demonstrates inserting data into a Cassandra table with static columns and then querying it. This example shows how to associate metadata (region) with time-series data points. Ensure the table and mapping are set up before running.

```cql
INSERT INTO test.timeseries (m, t, v) VALUES ('server1-cpu', '2016-04-10 13:30', 10);
INSERT INTO test.timeseries (m, t, v) VALUES ('server1-cpu', '2016-04-10 13:31', 20);
INSERT INTO test.timeseries (m, t, v) VALUES ('server1-cpu', '2016-04-10 13:32', 15);
INSERT INTO test.timeseries (m, meta) VALUES ('server1-cpu', { 'region':'west' } );
SELECT * FROM test.timeseries;
```

--------------------------------

### Add Privileges for Fluentbit User

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Example of inserting privileges for the 'fluentbit' user to manage Elasticsearch templates, pipelines, and create indices with specific naming patterns.

```cql
INSERT INTO elastic_admin.privileges (role,actions,indices) VALUES (‘fluentbit’,’cluster:monitor/nodes/info’,’.*’);
```

```cql
INSERT INTO elastic_admin.privileges (role,actions,indices) VALUES (‘fluentbit’,’cluster:admin/ingest/pipeline/put’,’.*’);
```

```cql
INSERT INTO elastic_admin.privileges (role,actions,indices) VALUES (‘fluentbit’,’indices:.*’,’kubernetes_cluster.*’);
```

--------------------------------

### Add Helm Repository

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Add the Strapdata Helm repository to your Helm client. This command is necessary before installing any charts from this repository.

```bash
helm repo add strapdata https://charts.strapdata.com
```

--------------------------------

### JDBC Driver connection and query

Source: https://elassandra.readthedocs.io/en/latest/integration.html

Example of connecting to Elassandra using the Elasticsearch JDBC driver (sql4es) and executing a query. Ensure the driver is in your classpath.

```java
Class.forName("nl.anchormen.sql4es.jdbc.ESDriver");
Connection con = DriverManager.getConnection("jdbc:sql4es://localhost:9300/twitter?cluster.name=Test%20Cluster");
Statement st = con.createStatement();
ResultSet rs = st.executeQuery("SELECT user,avg(size),count(*) FROM tweet GROUP BY user");
ResultSetMetaData rsmd = rs.getMetaData();
int nrCols = rsmd.getColumnCount();
while(rs.next()){
    for(int i=1; i<=nrCols; i++){
         System.out.println(rs.getObject(i));
     }
}
rs.close();
con.close();
```

--------------------------------

### Get Kubernetes Resources

Source: https://elassandra.readthedocs.io/en/latest/installation.html

List all Kubernetes resources within the 'elassandra' namespace to check the status of pods, services, and stateful sets. This is useful for debugging and verifying the deployment.

```bash
kubectl get all -o wide -n elassandra
```

--------------------------------

### Submit Spark job with elasticsearch-hadoop connector

Source: https://elassandra.readthedocs.io/en/latest/integration.html

Example command to submit a Spark job in client mode using a modified elasticsearch-hadoop connector for Elassandra. Ensure the JAR path and Spark master are correctly specified.

```bash
bin/spark-submit --driver-class-path <yourpath>/elasticsearch-spark_2.10-2.2.0.jar  --master spark://<sparkmaster>:7077 --deploy-mode client <application.jar>
```

--------------------------------

### Enable InfluxDB Reporting in Cassandra Env

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Add this line to your `conf/cassandra-env.sh` to enable the InfluxDB metrics reporting configuration. This requires the Elassandra Enterprise plugin to be installed.

```shell
JVM_OPTS=”$JVM_OPTS -Dcassandra.metricsReporterConfigFile=influxdb-reporting.yaml”
```

--------------------------------

### Retrieve Extensions using cqlsh

Source: https://elassandra.readthedocs.io/en/latest/operations.html

Use cqlsh to query the 'extensions' column from the system_schema.tables table to get the raw Smile-encoded metadata. This is a prerequisite for decoding.

```bash
$CASSANDRA_HOME/bin/cqlsh -e "select extensions from system_schema.tables where keyspace_name = 'test' and table_name = 'docs';"
```

--------------------------------

### Create Index with Custom Keyspace Mapping in Elassandra

Source: https://elassandra.readthedocs.io/en/latest/mapping.html

Example of creating a new Elasticsearch index ('twitter2') and mapping it to a specific Cassandra keyspace ('twitter'). This allows multiple indices to share the same keyspace.

```json
curl -XPUT -H 'Content-Type: application/json' "http://localhost:9200/twitter2/" -d '{
   "settings" : { "keyspace" : "twitter" } },
   "mappings" : {
      "tweet" : {
            "properties" : {
              "message" : { "type" : "text" },
              "post_date" : { "type" : "date", "format": "yyyy-MM-dd" },
              "user" : { "type" : "keyword" },
              "size" : { "type" : "long" }
            }
      }
   }
}'

```

--------------------------------

### Modify logstash.jsonl for Kibana

Source: https://elassandra.readthedocs.io/en/latest/integration.html

A series of sed commands to modify logstash.jsonl for compatibility with Kibana, particularly for sample data loading from the Kibana Getting Started guide.

```bash
s/logstash-2015.05.18/logstash_20150518/g
s/logstash-2015.05.19/logstash_20150519/g
s/logstash-2015.05.20/logstash_20150520/g

s/article:modified_time/articleModified_time/g
s/article:published_time/articlePublished_time/g
s/article:section/articleSection/g
s/article:tag/articleTag/g

s/og:type/ogType/g
s/og:title/ogTitle/g
s/og:description/ogDescription/g
s/og:site_name/ogSite_name/g
s/og:url/ogUrl/g
s/og:image:width/ogImageWidth/g
s/og:image:height/ogImageHeight/g
s/og:image/ogImage/g

s/twitter:title/twitterTitle/g
s/twitter:description/twitterDescription/g
s/twitter:card/twitterCard/g
s/twitter:image/twitterImage/g
s/twitter:site/twitterSite/g
```

--------------------------------

### Check Elassandra Enterprise Plugin Activation

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Use this GET request to verify if the Strapdata Enterprise plugin is active on your Elassandra nodes. The output shows details of installed plugins, including the enterprise version.

```http
GET _nodes/plugins?pretty
```

```json
{
  "plugins" : [
     {
       "name" : "org.apache.cassandra.service.ElassandraDaemon$ElassandraPlugin",
       "version" : "NA",
       "description" : "classpath plugin",
       "classname" : "org.apache.cassandra.service.ElassandraDaemon$ElassandraPlugin",
       "extended_plugins" : [ ],
       "has_native_controller" : false,
       "requires_keystore" : false
     },
     {
       "name" : "strapdata-plugin",
       "version" : "6.2.3.13",
       "description" : "Strapdata Enterprise plugin version 6.2.3.13",
       "classname" : "com.strapdata.elasticsearch.plugin.EnterprisePlugin",
       "extended_plugins" : [ ],
       "has_native_controller" : false,
       "requires_keystore" : false
     }
   ],
 .... 

}
```

--------------------------------

### Configure and Use SSL Transport Client

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Java code demonstrating how to initialize a PreBuiltSslTransportClient with various security settings and connect to an Elassandra cluster. It also shows how to add authorization headers for authenticated requests.

```java
import com.strapdata.elasticsearch.plugins.ssl.PreBuiltSslTransportClient;

TransportClient client = new PreBuiltSslTransportClient(Settings.builder()
     .put("cluster.name", "myClusterName")
     .put("client.transport.sniff",true)
     .put("ssl.transport.enabled", true)
     .put("ssl.truststore.path", "/path/to/truststore.jks")
     .put("ssl.truststore.password", "******")
     .put("ssl.transport_client_credential", "monitor:password")   // Add credential to monitor Elasticsearch
     ...
     .build())
 .addTransportAddress(new InetSocketTransportAddress(InetAddress.getByName("localhost"), 9300))

 // Add user credential to request Elasticsearch
 client.filterWithHeader(Collections.singletonMap("Authorization", PreBuiltSslTransportClient.encodeBasicHeader("bob","password")));

```

--------------------------------

### Create Cassandra Schema and Insert Data

Source: https://elassandra.readthedocs.io/en/latest/quickstart.html

Use CQLSH to create a keyspace, user-defined type, table, and insert sample data. This sets up the data structure before indexing.

```bash
docker exec -i test_seed_node_1 cqlsh <<EOF
CREATE KEYSPACE IF NOT EXISTS test WITH replication = {'class': 'NetworkTopologyStrategy', 'DC1': 1};
CREATE TYPE IF NOT EXISTS test.user_type (first text, last text);
CREATE TABLE IF NOT EXISTS test.docs (uid int, username frozen<user_type>, login text, PRIMARY KEY (uid));
INSERT INTO test.docs (uid, username, login) VALUES (1, {first:'vince',last:'royer'}, 'vroyer');
INSERT INTO test.docs (uid, username, login) VALUES (2, {first:'barthelemy',last:'delemotte'}, 'barth');
EOF

```

--------------------------------

### Create Keyspace, Table, and Insert Data with CQL

Source: https://elassandra.readthedocs.io/en/latest/mapping.html

Sets up a Cassandra keyspace and table for parent-child relationships, then inserts sample data. This is a prerequisite for mapping the table as a document type.

```cql
CREATE KEYSPACE IF NOT EXISTS company WITH replication={ 'class':'NetworkTopologyStrategy', 'dc1':'1' };
CREATE TABLE company.employee (
"_parent" text,
"_id" text,
name text,
dob timestamp,
hobby text,
primary key (("_parent"),"_id")
);
INSERT INTO company.employee ("_parent","_id",name,dob,hobby) VALUES ('london','1','Alice Smith','1970-10-24','hiking');
INSERT INTO company.employee ("_parent","_id",name,dob,hobby) VALUES ('london','2','Alice Smith','1990-10-24','hiking');

```

--------------------------------

### Check Helm Chart Status

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Verify the status of the installed Elassandra Helm chart. This command helps confirm if the deployment was successful.

```bash
helm status elassandra
```

--------------------------------

### Configure Elassandra RPM Repository

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Create an RPM repository configuration file for Elassandra, specifying the base URLs for releases and snapshots.

```ini
[strapdata]
name=Strapdata
baseurl=https://nexus.repo.strapdata.com/repository/rpm-releases/
enabled=1
gpgcheck=0
priority=1

[strapdata-snapshots]
name=Strapdata Snapshots
baseurl=https://nexus.repo.strapdata.com/repository/rpm-snapshots/
enabled=1
gpgcheck=0
priority=1


```

--------------------------------

### Query Audit Events from CQL Table

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Example of querying the 'elastic_audit.events' table using cqlsh to retrieve stored audit records.

```sql
cassandra@cqlsh> select * from elastic_audit.events ;

 node     | event                                | action                        | indices     | level      | login  | role         | source   | status
----------+--------------------------------------+-------------------------------+-------------+------------+--------+--------------+----------+--------
 10.0.0.4 | cf74fed0-b5a2-11e7-9508-157b11ac2561 |          cluster:monitor/main |        null |  PRIVILEGE | kibana | roles/kibana | 10.0.1.5 |    200
 10.0.0.4 | d2026070-b5a2-11e7-9508-157b11ac2561 |         cluster:monitor/state |        null |  PRIVILEGE | kibana | roles/kibana | 10.0.1.5 |    200
 10.0.0.4 | da709470-b5a2-11e7-9508-157b11ac2561 |      indices:data/read/search | ['sales_*'] | PERMISSION |  sales |  roles/sales | 10.0.1.5 |    200
 10.0.0.4 | d8025390-b5a2-11e7-9508-157b11ac2561 |        cluster:monitor/health | ['.kibana'] |  PRIVILEGE | kibana | roles/kibana | 10.0.1.5 |    200
 10.0.0.4 | cf9de390-b5a2-11e7-9508-157b11ac2561 |    cluster:monitor/nodes/info |        null |  PRIVILEGE | kibana | roles/kibana | 10.0.1.5 |    200
```

--------------------------------

### Create Monitor Role and Grant Privileges

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Use these SQL commands to create a 'monitor' role with a password and grant it necessary privileges for cluster monitoring. This role is used for monitoring Elassandra cluster state and node liveness.

```sql
CREATE ROLE monitor WITH PASSWORD = 'monitor' AND LOGIN = true;
INSERT INTO elastic_admin.privileges (role, actions,indices) VALUES('monitor','cluster:monitor/state','.*');
INSERT INTO elastic_admin.privileges (role, actions,indices) VALUES('monitor','cluster:monitor/nodes/liveness','.*');

```

--------------------------------

### GET Data from Elassandra

Source: https://elassandra.readthedocs.io/en/latest/operations.html

Use cURL to retrieve data from specific indices and types. These commands demonstrate fetching individual documents.

```bash
curl -XGET 'http://localhost:9200/twitter/user/kimchy?pretty=true'

```

```bash
curl -XGET 'http://localhost:9200/twitter/tweet/1?pretty=true'

```

```bash
curl -XGET 'http://localhost:9200/twitter/tweet/2?pretty=true'

```

--------------------------------

### Get Elasticsearch Cluster State

Source: https://elassandra.readthedocs.io/en/latest/quickstart.html

Use this command to retrieve the current state of your Elasticsearch cluster. This includes information about nodes, indices, and routing.

```bash
curl "http://localhost:9200/_cluster/state?pretty"
{
  "cluster_name" : "Test Cluster",
  "compressed_size_in_bytes" : 579,
  "version" : 8,
  "state_uuid" : "mrE5raXOQO2SVA8AROJqwQ",
  "master_node" : "25457162-c5ef-44fa-a46b-a96434aae319",
  "blocks" : { },
  "nodes" : {
    "25457162-c5ef-44fa-a46b-a96434aae319" : {
      "name" : "172.17.0.2",
      "status" : "ALIVE",
      "ephemeral_id" : "25457162-c5ef-44fa-a46b-a96434aae319",
      "transport_address" : "172.17.0.2:9300",
      "attributes" : {
        "rack" : "r1",
        "dc" : "DC1"
      }
    }
  },
  "metadata" : {
    "version" : 1,
    "cluster_uuid" : "25457162-c5ef-44fa-a46b-a96434aae319",
    "templates" : { },
    "indices" : {
      "test" : {
        "state" : "open",
        "settings" : {
          "index" : {
            "creation_date" : "1553512833429",
            "number_of_shards" : "1",
            "number_of_replicas" : "0",
            "uuid" : "BOolxI89SqmrcbK7KM4sIA",
            "version" : {
              "created" : "6020399"
            },
            "provided_name" : "test"
          }
        },
        "mappings" : {
          "docs" : {
            "properties" : {
              "uid" : {
                "cql_partition_key" : true,
                "cql_primary_key_order" : 0,
                "type" : "integer",
                "cql_collection" : "singleton"
              },
              "login" : {
                "type" : "keyword",
                "cql_collection" : "singleton"
              },
              "username" : {
                "cql_udt_name" : "user_type",
                "type" : "nested",
                "properties" : {
                  "last" : {
                    "type" : "keyword",
                    "cql_collection" : "singleton"
                  },
                  "first" : {
                    "type" : "keyword",
                    "cql_collection" : "singleton"
                  }
                },
                "cql_collection" : "singleton"
              }
            }
          }
        },
        "aliases" : [ ],
        "primary_terms" : {
          "0" : 0
        },
        "in_sync_allocations" : {
          "0" : [ ]
        }
      }
    },
    "index-graveyard" : {
      "tombstones" : [ ]
    }
  },
  "routing_table" : {
    "indices" : {
      "test" : {
        "shards" : {
          "0" : [
            {
              "state" : "STARTED",
              "primary" : true,
              "node" : "25457162-c5ef-44fa-a46b-a96434aae319",
              "relocating_node" : null,
              "shard" : 0,
              "index" : "test",
              "token_ranges" : [
                "(-9223372036854775808,9223372036854775807]"
              ],
              "allocation_id" : {
                "id" : "dummy_alloc_id"
              }
            }
          ]
        }
      }
    }
  },
  "routing_nodes" : {
    "unassigned" : [ ],
    "nodes" : {
      "25457162-c5ef-44fa-a46b-a96434aae319" : [
        {
          "state" : "STARTED",
          "primary" : true,
          "node" : "25457162-c5ef-44fa-a46b-a96434aae319",
          "relocating_node" : null,
          "shard" : 0,
          "index" : "test",
          "token_ranges" : [
            "(-9223372036854775808,9223372036854775807]"
          ],
          "allocation_id" : {
            "id" : "dummy_alloc_id"
          }
        }
      ]
    }
  },
  "snapshots" : {
    "snapshots" : [ ]
  },
  "restore" : {
    "snapshots" : [ ]
  },
  "snapshot_deletions" : {
    "snapshot_deletions" : [ ]
  }
}
```

--------------------------------

### Query Sample Data with cqlsh

Source: https://elassandra.readthedocs.io/en/latest/quickstart.html

Execute a CQL query to retrieve sample data from the 'kibana_sample_data_logs' table. This demonstrates basic data retrieval.

```sql
Connected to Test Cluster at 127.0.0.1:9042.
[cqlsh 5.0.1 | Cassandra 3.11.5 | CQL spec 3.4.4 | Native protocol v4]
Use HELP for help.
cqlsh> select * from kibana_sample_data_logs."_doc" limit 3;
```

--------------------------------

### Create Elasticsearch Index from Scratch

Source: https://elassandra.readthedocs.io/en/latest/quickstart.html

Use curl to create an Elasticsearch index with a custom mapping. Elassandra will automatically generate the corresponding CQL schema.

```bash
curl -XPUT -H 'Content-Type: application/json' http://localhost:9200/test2 -d'{
   "mappings":{
      "docs":{
         "properties": {
            "first": {
               "type":"text"
            },
            "last": {
               "type":"text",
               "cql_collection":"singleton"
            }
         }
      }
   }
}'

```

--------------------------------

### Create Cassandra Table for Dynamic Mapping

Source: https://elassandra.readthedocs.io/en/latest/mapping.html

Defines a Cassandra keyspace and a user table with a map column 'attrs' to demonstrate dynamic mapping.

```cql
CREATE KEYSPACE IF NOT EXISTS twitter WITH replication={
  'class':'NetworkTopologyStrategy',
  'DC1':'1'
};
CREATE TABLE twitter.user (
   name text,
   attrs map<text,text>,
   PRIMARY KEY (name)
);
INSERT INTO twitter.user (name,attrs) VALUES ('bob',{'email':'bob@gmail.com','firstname':'bob'});

```

--------------------------------

### Connect to cqlsh

Source: https://elassandra.readthedocs.io/en/latest/quickstart.html

Connect to the Elassandra cluster using cqlsh to interact with Cassandra data. Ensure Elassandra is running before executing.

```bash
docker exec -it test_seed_node_1 cqlsh
```

--------------------------------

### Connect to Elassandra with cqlsh

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Connect to the running Elassandra node using the cqlsh command-line interface to execute CQL commands.

```bash
bin/cqlsh

```

--------------------------------

### Access Elasticsearch with HTTPS

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Example using `curl` to access Elasticsearch over HTTPS. Requires the `--cacert` option to specify the CA certificate for server validation.

```bash
curl -XGET --cacert conf/cacert.pem "https://localhost:9200/my_index/_search"
```

--------------------------------

### Create Cassandra Superuser and Set Password

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

SQL commands to create a new administrative role with superuser privileges and set the password for the default Cassandra superuser.

```sql
CREATE ROLE admin WITH PASSWORD='******' AND LOGIN=true AND SUPERUSER=true;
ALTER ROLE cassandra WITH PASSWORD='******';

```

--------------------------------

### Multiple Sibling Aggregations

Source: https://elassandra.readthedocs.io/en/latest/search_over_cql.html

When requesting multiple sibling aggregations, the results are flattened. This example shows a date histogram aggregation alongside a sum of bucket aggregation.

```cql
cassandra@cqlsh> SELECT * FROM twitter2.doc WHERE es_query='{"size":0,
      "aggs":{"sales_per_month":{"date_histogram":{"field":"post_date","interval":"day"},"aggs":{"sales":{"sum":{"field":"price"}}}},
      "sum_monthly_sales":{"sum_bucket":{"buckets_path":"sales_per_month>sales"}}}}';
```

--------------------------------

### Check Elasticsearch SSL Info

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Retrieve SSL information for Elasticsearch using a `GET /_sslinfo` request. This confirms the active HTTPS protocol and cipher suite.

```bash
curl -XGET --cacert conf/cacert.pem "https://localhost:9200/_sslinfo"
```

--------------------------------

### Get Elasticsearch Index Information

Source: https://elassandra.readthedocs.io/en/latest/quickstart.html

Retrieve a summary of your Elasticsearch indices, including their health status, name, and size. The '-v' flag provides verbose output.

```bash
curl "http://localhost:9200/_cat/indices?v"
health status index uuid                   pri rep docs.count docs.deleted store.size pri.store.size
green  open   test  BOolxI89SqmrcbK7KM4sIA   1   0          4            0      4.1kb          4.1kb

```

--------------------------------

### Enable Cassandra LDAP Authentication

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Configure Cassandra to use LDAP for external authentication. This setup attempts local authentication first before querying the LDAP directory.

```yaml
authorizer: CassandraAuthorizer
authenticator: com.strapdata.cassandra.ldap.LDAPAuthenticator
role_manager: com.strapdata.cassandra.ldap.LDAPRoleManager

```

--------------------------------

### Execute Commands in Elassandra Container

Source: https://elassandra.readthedocs.io/en/latest/installation.html

Run administrative tools like nodetool, cqlsh, and curl inside a running Elassandra container.

```bash
docker exec -it node0 nodetool status
```

```bash
docker exec -it node0 cqlsh
```

```bash
docker exec -it node0 curl localhost:9200
```

--------------------------------

### Create a Partitioned Index with a Virtual Index

Source: https://elassandra.readthedocs.io/en/latest/mapping.html

Configures a partitioned index that inherits mappings from a virtual index named 'logs'. This reduces the number of mappings stored in the cluster and simplifies mapping updates.

```json
{
  "settings": {
      "keyspace":"logs",
      "index.partition_function":"toYearIndex logs_{0,date,yyyy} date_field",
      "index.partition_function_class":"MessageFormatPartitionFunction",
      "index.virtual_index":"logs"
  },
  "mappings": {
      "mylog" : { "discover" : ".*" }
  }
}
```

--------------------------------

### Rebuild data in a new datacenter

Source: https://elassandra.readthedocs.io/en/latest/integration.html

Rebuilds data in the new datacenter by pulling from a specified source datacenter. This command is run after starting Elassandra nodes with Elasticsearch enabled.

```bash
nodetool rebuild <source-datacenter-name>
```

--------------------------------

### GET Cluster State

Source: https://elassandra.readthedocs.io/en/latest/operations.html

Retrieve the current state of the Elasticsearch cluster, including node information, metadata, and routing tables. This is useful for understanding cluster configuration and status.

```bash
curl -XGET 'http://localhost:9200/_cluster/state/?pretty=true'

```

```json
{
  "cluster_name" : "Test Cluster",
  "version" : 5,
  "master_node" : "74ae1629-0149-4e65-b790-cd25c7406675",
  "blocks" : { },
  "nodes" : {
    "74ae1629-0149-4e65-b790-cd25c7406675" : {
      "name" : "localhost",
      "status" : "ALIVE",
      "transport_address" : "inet[localhost/127.0.0.1:9300]",
      "attributes" : {
        "data" : "true",
        "rack" : "RAC1",
        "data_center" : "DC1",
        "master" : "true"
      }
    }
  },
  "metadata" : {
    "version" : 3,
    "uuid" : "74ae1629-0149-4e65-b790-cd25c7406675",
    "templates" : { },
    "indices" : {
      "twitter" : {
        "state" : "open",
        "settings" : {
          "index" : {
            "creation_date" : "1440659762584",
            "uuid" : "fyqNMDfnRgeRE9KgTqxFWw",
            "number_of_replicas" : "1",
            "number_of_shards" : "1",
            "version" : {
              "created" : "1050299"
            }
          }
        },
        "mappings" : {
          "user" : {
            "properties" : {
              "name" : {
                "type" : "string"
              }
            }
          },
          "tweet" : {
            "properties" : {
              "message" : {
                "type" : "string"
              },
              "postDate" : {
                "format" : "dateOptionalTime",
                "type" : "date"
              },
              "user" : {
                "type" : "string"
              }
            }
          }
        },
        "aliases" : [ ]
      }
    }
  },
  "routing_table" : {
    "indices" : {
      "twitter" : {
        "shards" : {
          "0" : [ {
            "state" : "STARTED",
            "primary" : true,
            "node" : "74ae1629-0149-4e65-b790-cd25c7406675",
            "token_ranges" : [ "(-9223372036854775808,9223372036854775807]" ],
            "shard" : 0,
            "index" : "twitter"
          } ]
        }
      }
    }
  },
  "routing_nodes" : {
    "unassigned" : [ ],
    "nodes" : {
      "74ae1629-0149-4e65-b790-cd25c7406675" : [ {
        "state" : "STARTED",
        "primary" : true,
        "node" : "74ae1629-0149-4e65-b790-cd25c7406675",
        "token_ranges" : [ "(-9223372036854775808,9223372036854775807]" ],
        "shard" : 0,
        "index" : "twitter"
      } ]
    }
  },
  "allocations" : [ ]
}

```

--------------------------------

### Create a Partitioned Index

Source: https://elassandra.readthedocs.io/en/latest/mapping.html

Defines a partitioned index for logs, specifying the keyspace, partition function, and class. The index name pattern includes a date format, and the partition function uses the 'date_field' for partitioning.

```json
{
  "settings": {
      "keyspace":"logs",
      "index.partition_function":"toYearIndex logs_{0,date,yyyy} date_field",
      "index.partition_function_class":"MessageFormatPartitionFunction"
  },
  "mappings": {
      "mylog" : { "discover" : ".*" }
  }
}
```

--------------------------------

### Configure JMX Exporter Java Agent

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Add this JVM option to your environment or `conf/cassandra-env.sh` to enable the JMX Exporter and expose metrics on TCP port 7500. Ensure the agent JAR and configuration file are in the correct paths.

```bash
JVM_OPTS="$JVM_OPTS -javaagent:agents/jmx_prometheus_javaagent-0.3.1.jar=7500:conf/jmx_prometheus_exporter.yml"

```

--------------------------------

### Configure Internode Encryption

Source: https://elassandra.readthedocs.io/en/latest/enterprise.html

Set up internode encryption options in `conf/cassandra.yaml`. Ensure passwords match keystore/truststore generation. Use absolute paths for keystores to avoid issues.

```yaml
server_encryption_options:
    internode_encryption: all
    keystore: /etc/cassandra/.keystore.jks
    keystore_password: changeit
    truststore: /etc/cassandra/.truststore.jks
    truststore_password: changeit
    protocol: TLSv1.2
```
Tokens:
Raw