Striim

https://www.striim.com/docs
Admin
Striim is a real-time data integration and streaming analytics platform that continuously ingests,...
Tokens:1,848,570
Snippets:12,640
Trust Score:10
Update:4 weeks ago
Show doc for...
Tokens:
Raw
### Run full setup with setupDb2.sh

Source: https://www.striim.com/docs/en/db2-for-z-os-initial-setup-for-cdc.html

Runs the full setup: installs and configures the Striim Agent for Db2 for z/OS, initializes the repository database, creates a pipeline to send data from Db2 to the Striim application's Kafka-persisted stream, starts the agent, and starts the pipeline. Requires the installation bundle to be extracted on the host.

```bash
setupDb2.sh -a full -s <db2 password> -r <Striim Agent for Db2 for z/OS repository password> -p <path to configuration file>
```

--------------------------------

### OJet setup script example

Source: https://www.striim.com/docs/platform/en/configuring-oracle-and-striim-to-use-ojet.html

Example command to run setupOJet.sh with a sample IP address, SID, and password.

```bash
setupOJet.sh 203.0.113.49:1521/orcl sys ******** OJET_USER 

```

--------------------------------

### Example: report start and stop for MultiLogApp

Source: https://www.striim.com/docs/en/using-the-report-start---stop-command.html

Example session showing report start, starting the application, and report stop for MultiLogApp. The application must be deployed or running when report start is issued. The output includes total events, first and last event details, and average throughput.

```text
W (Samples) > report start multilogapp;
Processing - report start multilogapp
-> SUCCESS 
Elapsed time: 11 ms
W (Samples) > start application multilogapp;
Processing - start application multilogapp
-> SUCCESS 
Elapsed time: 4043 ms
W (Samples) > report stop multilogapp;
Processing - report stop multilogapp
Total Events - 2898802
First Event Time - 14:46:30

First Event - {"timeStamp":"2017-02-23T14:46:30.973-08:00","data":["216.103.201.86","-",
"EHernandez","10/Feb/2014:12:13:51.037 -0800","GET http://cloud.saas.me/login&
jsessionId=01e3928f-e059-6361-bdc5-14109fcf2383 HTTP/1.1","200","21560","-",
"Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.0; Trident/5.0)","1606"],
"metadata":{"RecordOffset":479236678,"RecordStatus":"VALID_RECORD","FileName":"access_log",
"RecordEnd":479236986,"FileOffset":0},"before":null,"dataPresenceBitMap":"AAA=",
"beforePresenceBitMap":"AAA=","typeUUID":null,"idstring":"01e6fa1a-0cb0-b625-a5e4-685b3587069e"}

Average Throughput for this interval - 51000
Total Wactions created - 5850
Last Waction created at - 14:47:27

Last Waction - {"internalWactionStoreName":"Samples_UnusualActivity","wactionTs":
"2017-02-23T14:47:27.408-08:00","key":"75.201.196.173","mapKey":
{"id":"01e6fa1a-0ce9-2b03-a5e4-685b3587069e","key":"75.201.196.173"},"wactionStatus":0,
"position":null,"typeOfActivity":"ZeroContent","accessTime":1392142812204,
"accessSessionId":"01e39290-7985-4599-bdc5-14109fcf2383","srcIp":"75.201.196.173",
"userId":"AWhite","country":"United States","city":null,"lat":38.0,"lon":-97.0,
"accessTimeAsLong":1392142812204,"events":[{"_id":null,"timeStamp":1487890047407,
"originTimeStamp":0,"key":null,"accessTime":1392142812204,"accessSessionId":
"01e39290-7985-4599-bdc5-14109fcf2383","srcIp":"75.201.196.173","userId":"AWhite",
"request":"GET http://cloud.saas.me/query?type=ChatterActivity&
id=01e39290-798d-0dc9-bdc5-14109fcf2383&jsessionId=01e39290-7985-4599-bdc5-14109fcf2383 
HTTP/1.1","code":200,"size":0,"referrer":"-","userAgent":"Mozilla/5.0 (Windows NT 6.0) 
AppleWebKit/537.36 (KHTML, like Gecko) Chrome/30.0.1599.69 Safari/537.36","responseTime":883,
"logTime":1392142812204,"logSessionId":"01e39290-7985-4599-bdc5-14109fcf2383",
"level":"WARN","message":"Issue in API call [api=query] [session=01e39290-7985-4599-bdc5-
14109fcf2383] [user=AWhite] [sobject=ChatterActivity]","api":"query",
"sobject":"ChatterActivity","xception":"com.me.saas.SaasMultiApplication$SaasException: 
Issue in API call [api=query] [session=01e39290-7985-4599-bdc5-14109fcf2383] [user=AWhite] 
[sobject=ChatterActivity]\n\tat com.me.saas.SaasMultiApplication.query
(SaasMultiApplication.java:1069)\n\tat sun.reflect.GeneratedMethodAccessor2.invoke
(Unknown Source)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:606)
\n\tat com.me.saas.SaasMultiApplication$ObjectApiCall.invoke(SaasMultiApplication.java:216)
\n\tat com.me.saas.SaasMultiApplication$Session.invokeAPI(SaasMultiApplication.java:1500)
\n\tat com.me.saas.SaasMultiApplication.main(SaasMultiApplication.java:1626)",
"className":"com.me.saas.SaasMultiApplication","method":"query",
"fileName":"SaasMultiApplication.java","lineNum":"1072",
"idstring":"01e6fa1a-0ce9-0413-a5e4-685b3587069e"}]}

Last Event Time - 14:47:27
Last Event - {"timeStamp":"2017-02-23T14:47:27.038-08:00","data":["206.93.30.161","-",
"EMorris","11/Feb/2014:10:20:52.043 -0800","GET http://cloud.saas.me/getUpdated?
type=ChatterMessage&id=01e39290-79a3-2dd2-bdc5-14109fcf2383&jsessionId=
01e39290-799f-3637-bdc5-14109fcf2383 HTTP/1.1","200","35712","-",
"Mozilla/5.0 (X11; Ubuntu; Linux i686; rv:24.0) Gecko/20100101 Firefox/24.0","972"],
"metadata":{"RecordOffset":479236678,"RecordStatus":"VALID_RECORD","FileName":"access_log",
"RecordEnd":479236986,"FileOffset":0},"before":null,"dataPresenceBitMap":"AAA=",
"beforePresenceBitMap":"AAA=","typeUUID":null,"idstring":"01e6fa1a-0cb0-b625-a5e4-685b3587069e"}

Average Throughput for this interval - 51000
Total Wactions created - 5850
Last Waction created at - 14:47:27

Last Waction - {"internalWactionStoreName":"Samples_UnusualActivity","wactionTs":
"2017-02-23T14:47:27.408-08:00","key":"75.201.196.173","mapKey":
{"id":"01e6fa1a-0ce9-2b03-a5e4-685b3587069e","key":"75.201.196.173"},"wactionStatus":0,
"position":null,"typeOfActivity":"ZeroContent","accessTime":1392142812204,
"accessSessionId":"01e39290-7985-4599-bdc5-14109fcf2383","srcIp":"75.201.196.173",
"userId":"AWhite","country":"United States","city":null,"lat":38.0,"lon":-97.0,
"accessTimeAsLong":1392142812204,"events":[{"_id":null,"timeStamp":1487890047407,
"originTimeStamp":0,"key":null,"accessTime":1392142812204,"accessSessionId":
"01e39290-7985-4599-bdc5-14109fcf2383","srcIp":"75.201.196.173","userId":"AWhite",
"request":"GET http://cloud.saas.me/query?type=ChatterActivity&
id=01e39290-798d-0dc9-bdc5-14109fcf2383&jsessionId=01e39290-7985-4599-bdc5-14109fcf2383 
HTTP/1.1","code":200,"size":0,"referrer":"-","userAgent":"Mozilla/5.0 (Windows NT 6.0) 
AppleWebKit/537.36 (KHTML, like Gecko) Chrome/30.0.1599.69 Safari/537.36","responseTime":883,
"logTime":1392142812204,"logSessionId":"01e39290-7985-4599-bdc5-14109fcf2383",
"level":"WARN","message":"Issue in API call [api=query] [session=01e39290-7985-4599-bdc5-
14109fcf2383] [user=AWhite] [sobject=ChatterActivity]","api":"query",
"sobject":"ChatterActivity","xception":"com.me.saas.SaasMultiApplication$SaasException: 
Issue in API call [api=query] [session=01e39290-7985-4599-bdc5-14109fcf2383] [user=AWhite] 
[sobject=ChatterActivity]\n\tat com.me.saas.SaasMultiApplication.query
(SaasMultiApplication.java:1069)\n\tat sun.reflect.GeneratedMethodAccessor2.invoke
(Unknown Source)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke
(DelegatingMethodAccessorImpl.java:43)\n\tat java.lang.reflect.Method.invoke(Method.java:606)
\n\tat com.me.saas.SaasMultiApplication$ObjectApiCall.invoke(SaasMultiApplication.java:216)
\n\tat com.me.saas.SaasMultiApplication$Session.invokeAPI(SaasMultiApplication.java:1500)
\n\tat com.me.saas.SaasMultiApplication.main(SaasMultiApplication.java:1626)",
"className":"com.me.saas.SaasMultiApplication","method":"query",
"fileName":"SaasMultiApplication.java","lineNum":"1072",
"idstring":"01e6fa1a-0ce9-0413-a5e4-685b3587069e"}]}
```

--------------------------------

### Output of setupOJet.sh check option

Source: https://www.striim.com/docs/en/configuring-oracle-and-striim-to-use-ojet.html

Example output when running setupOJet.sh with the check option. Shows warnings for missing patches that must be installed before running the setup script.

```text
Configuration check for OJet using user sys as sysdba started.
Settings for downstream capture connecting to the capture database, using user sys as sysdba

Checking existing configuration:
Apply server owners: 0
Rule owners: 0
Queue table owners: 0
Capture owners: 0
Queue owners: 0
Rule set owners: 0
Checking required database options
Checking if required patches are installed
Warning: patch 31254535 not found to be installed
Warning: patch 28209272 not found to be installed
Warning: patch 34470389 not found to be installed
Warning: patch 32338220 not found to be installed
Warning: patch 34010877 not found to be installed
```

--------------------------------

### Example setupOJet.sh command

Source: https://www.striim.com/docs/en/configuring-oracle-and-striim-to-use-ojet.html

Example command to run setupOJet.sh with a sample IP address, SID, and password.

```bash
setupOJet.sh 203.0.113.49:1521/orcl sys ******** OJET_USER
```

--------------------------------

### Configuration Example

Source: https://www.striim.com/docs/platform/en/switching-from-initial-load-to-continuous-replication-of-snowflake-sources.html

Shows how to configure the product for specific use cases.

```yaml
version: '3'
services:
  app:
    image: example/app
```

--------------------------------

### Start Kafka commands for DEB/RPM/TGZ/ZIP installation

Source: https://www.striim.com/docs/platform/en/configuring-kafka-for-persisted-streams.html

Commands to start Zookeeper and Kafka when Striim is installed from a DEB, RPM, TGZ, or ZIP package. Run these from the `Striim/Kafka` directory in separate terminals.

```bash
bin/zookeeper-server-start.sh config/zookeeper.properties
```

```bash
JMX_PORT=9998 bin/kafka-server-start.sh config/server.properties
```

--------------------------------

### Example metadata repository configuration for Azure PostgreSQL

Source: https://www.striim.com/docs/platform/en/running-striim-in-azure.html

Example startUp.properties values using a sample Azure PostgreSQL server name and hostname.

```properties
MetadataDb=azurepostgres
MetaDataRepositoryLocation=striimtest1.postgres.database.azure.com:5432/striimrepo
MetaDataRepositoryDBname=striimrepo
MetaDataRepositoryUname=striim@striimtest1
```

--------------------------------

### Start the agent

Source: https://www.striim.com/docs/en/connecting-striim-cloud-on-azure-to-data-services-behind-striim-forwarding-agent.html

Commands to start the Striim Forwarding Agent. Run from the agent installation directory.

```bash
cd /opt/striim/Agent/bin
sudo ./agent.sh
```

--------------------------------

### Successful agent start output

Source: https://www.striim.com/docs/en/connecting-striim-cloud-on-azure-to-data-services-behind-striim-forwarding-agent.html

Example output from a successful agent start showing version and connection status.

```text
Striim Agent: Version 5.4.0.6 (...)
Connecting to cluster Striim.......connected

```

--------------------------------

### Expected output of setupOJet.sh

Source: https://www.striim.com/docs/en/configuring-oracle-and-striim-to-use-ojet.html

Example output after running setupOJet.sh successfully, showing granted resources and enabled features.

```text
./setupOJet.sh localhost:1521/ORCL sys oracle OJET_USER
  Configuration for OJet using user OJET_USER started: 
  Granted resources to user OJET_USER
  Granted select any dictionary privilege to user OJET_USER
  Enabled replication
  Enabled streaming
  Enabled supplemental logging
  Building dictionary log …
  Done
```

--------------------------------

### Striim configuration: PARTITION BY example

Source: https://www.striim.com/docs/en/create-a-clickhouse-writer-application.html

Shows how to supply PARTITION BY via TargetTableDefinition. The example partitions by month using toYYYYMM(placed_at).

```Text
TargetTableDefinition: '{
  "tgt.mytable": {
    "Partition BY": "toYYYYMM(placed_at)"
  }
}'
```

--------------------------------

### Enable and start Striim Agent on Ubuntu 16.04+

Source: https://www.striim.com/docs/platform/en/striim-forwarding-agent-installation-and-configuration.html

Enables and starts the Striim Agent service on Ubuntu 16.04 or later. Use after installation and configuration.

```bash
systemctl enable striim-agent && systemctl start striim-agent
```

--------------------------------

### Example Usage

Source: https://www.striim.com/docs/platform/en/switching-from-initial-load-to-continuous-replication-of-snowflake-sources.html

A basic example demonstrating the product's core functionality.

```bash
echo 'Hello, World!'
```

--------------------------------

### Start console from terminal

Source: https://www.striim.com/docs/en/console-commands.html

Command to start the Striim console from a terminal when Striim is installed in /opt. Replace <cluster name> with the actual cluster name.

```bash
/opt/Striim/bin/console.sh -c <cluster name>
```

--------------------------------

### Get current timestamp from MySQL source

Source: https://www.striim.com/docs/en/switching-from-initial-load-to-continuous-replication-of-mysql-sources.html

Run this command on the source database before starting the initial load to capture the starting point for real-time replication.

```sql
select current_timestamp;
```

--------------------------------

### Set up the keystore

Source: https://www.striim.com/docs/en/connecting-striim-cloud-on-google-cloud-platform-to-data-services-behind-striim-forwarding-agent.html

Commands to run the keystore setup utility and set proper ownership for the keystore files. Requires the Striim sys user password.

```bash
cd /opt/striim/Agent/bin
sudo ./aksConfig.sh
sudo chown striim /opt/striim/Agent/conf/aks.jks
sudo chown striim /opt/striim/Agent/conf/aksKey.pwd
```

--------------------------------

### Start console on Windows

Source: https://www.striim.com/docs/en/console-commands.html

Command to start the Striim console from a Windows command prompt when Striim is installed in c:\striim. Replace <cluster name> with the actual cluster name.

```bash
\striim\bin\console -c <cluster name>
```

--------------------------------

### Start pipeline with setupDb2.sh

Source: https://www.striim.com/docs/en/db2-for-z-os-initial-setup-for-cdc.html

Starts the pipeline that was created with the create command.

```bash
setupDb2.sh -a start -p <path to configuration file>
```
Tokens:
Raw