### Example: Install v1.11.0 Installer Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/Selecting_MapR_Installer.html This example demonstrates how to use the MAPR_INSTALLER_REPO_DIR environment variable to instruct mapr-setup.sh to install a specific older version of the Installer, in this case, v1.11.0. ```bash export MAPR_INSTALLER_REPO_DIR=installer-v1.11.0 ``` -------------------------------- ### Node Expression Examples for Installer Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/c_installer_faq.html Illustrates various syntaxes for specifying node ranges and rack assignments when configuring the installer. ```text host1, host2, host3 ``` ```text host[A-Z][0-99] ``` ```text host[000-333] ``` ```text host[0-3],otherhost[00-05] ``` ```text host[0-5]:rack1,host[6-10]:rack2 ``` -------------------------------- ### Installer Stanza Command Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/Env_Variables_Installer_Container.html This example shows how to use the MAPR_STANZA_FILE variable when issuing the Stanza install command as an argument to the script. ```bash mapr-docker-installer.sh install -nv ``` -------------------------------- ### Installer CLI Probe Command Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/Stanzas/SilentInstallerCommands.html Example of using the probe command with overrides, demonstrating correct syntax for host list specification. ```bash ./mapr-installer-cli probe -o config.hosts='["host1", "host2", "host3"]' ..... ``` ```bash ./mapr-installer-cli probe -o config.hosts='["host1","host2","host3"]' ..... ``` -------------------------------- ### Download Installer Logs Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/ReferenceGuide/installer-logs.html Demonstrates downloading installer logs for a specific fabric. The output shows the status and the path where the log archive is saved. ```bash # maprcli installer logs -c fabric-25 -i true -a true -json { "timestamp":1715853237475, "timeofday":"2024-05-16 02:53:57.475 GMT-0700 AM", "status":"OK", "total":0, "data":[ ], "messages":[ "{'cluster_name': 'fabric-25', 'installer_logs': 'true', 'log_path': '/var/mapr/fabriclogs/fabric-25_installer/archive.zip'}" ] } ``` -------------------------------- ### Start Hive Shell Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Hive/HiveAndMapR-DBIntegration-GettingStarted.html Navigate to your Hive installation directory and start the Hive shell. Ensure Hive is installed and configured. ```bash cd $HIVE_HOME bin/hive ``` -------------------------------- ### Example: Primary-Secondary Replication Setup Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/MapR-DB/SettingUpMultiMasterReplicationAuto.html This example shows how to set up primary-secondary replication between 'customersA' and 'customersB' tables within the same 'sanfrancisco' cluster. ```bash maprcli table replica autosetup -path /mapr/sanfrancisco/customersA -replica /mapr/sanfrancisco/customersB ``` -------------------------------- ### Example: Multi-Master Replication Setup Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/MapR-DB/SettingUpMultiMasterReplicationAuto.html This example demonstrates setting up multi-master replication between the 'customers' table in the 'sanfrancisco' cluster and a new 'customers' table in the 'newyork' cluster. ```bash maprcli table replica autosetup -path /mapr/sanfrancisco/customers -replica /mapr/newyork/customers -multimaster true ``` -------------------------------- ### Full Static Provisioning Example (PV, PVC, Pod) Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/CSIdriver/csi_example_static_provisioning.html This example demonstrates a complete static provisioning setup. It includes the definition of a PersistentVolume, a PersistentVolumeClaim, and a Pod that utilizes the claim. ```yaml apiVersion: v1 kind: PersistentVolume metadata: name: test-simplepv namespace: test-csi labels: name: pv-simplepv-test spec: accessModes: - ReadWriteOnce persistentVolumeReclaimPolicy: Delete capacity: storage: 5Gi csi: nodePublishSecretRef: name: "mapr-ticket-secret" namespace: "test-csi" driver: com.mapr.csi-kdf volumeHandle: test-simplepv volumeAttributes: volumePath: "/" cluster: "clusterA" cldbHosts: "10.10.102.96" securityType: "secure" platinum: "true" --- apiVersion: v1 kind: Pod metadata: name: test-pv namespace: test-csi spec: securityContext: runAsUser: 1000 fsGroup: 2000 containers: - name: busybox image: busybox args: - sleep - "1000000" resources: requests: memory: "2Gi" cpu: "500m" volumeMounts: - mountPath: /mapr name: maprflex volumes: - name: maprflex persistentVolumeClaim: claimName: test-simplepvc --- kind: PersistentVolumeClaim apiVersion: v1 metadata: name: test-simplepvc namespace: test-csi spec: accessModes: - ReadWriteOnce resources: requests: storage: 5G ``` -------------------------------- ### Starting the Drill Cluster Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Drill/drill_on_yarn_command_line_tool.html This example shows how to start the Drill cluster after setting the DRILL_CONF_DIR environment variable. ```bash $DRILL_HOME/bin/drill-on-yarn.sh start ``` -------------------------------- ### Example User Creation Prompt Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/CreatingPACCImage.html This is an example of the interactive prompts encountered when creating a new cluster user account within the container setup process. ```bash Testing for cluster user account... Enter MapR cluster user name: robertjones User 'robertjones' does not exist. Creating new cluster user account... Enter 'robertjones' uid: 502 Enter 'robertjones' group name: users Enter 'robertjones' password: ...Success Configuring MapR client ( -c -C perfnode134.perf.lab -N my.cluster.com)... create /opt/mapr/conf/conf.old Configuring Hadoop-2.7.0 at /opt/mapr/hadoop/hadoop-2.7.0 Done configuring Hadoop CLDB node list: perfnode134.perf.lab:7222 Zookeeper node list: Node setup configuration: hbinternal Log can be found at: /opt/mapr/logs/configure.log ...Success ``` -------------------------------- ### Access Installer Web UI Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/pre_built_installer_container_images.html After starting the installer service, access the web-based Installer through the provided URL in a web browser. Use the external address if the internal one is not accessible. ```text installer (380) started with log /opt/mapr/installer/logs/installer.log Started service mapr-installer ...Success To continue installing MapR software, open the following URL in a web browser If the address '172.17.0.2' is internal and not accessible from your browser, use the external address mapped to it instead https://172.17.0.2:9443 ``` -------------------------------- ### Example Host List in Stanza File Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/Stanzas/WorkingWithYAML.html Demonstrates how to specify a list of hosts for package installation using a range notation. ```yaml - examplenode[1-3].example.com ``` -------------------------------- ### Installer CLI Override Syntax Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/Stanzas/SilentInstallerCommands.html Illustrates how to specify multiple key=value pairs as overrides on the command line. ```bash -o ``` -------------------------------- ### Start POSIX Client Service Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdministratorGuide/MapRfusePOSIXClient-Managing.html Use this command to start the POSIX client service. Replace '*' with 'basic' or 'platinum' based on your installed package. ```bash mkdir /mapr service mapr-posix-client-* start ``` -------------------------------- ### CLI Example: Get Table Info Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/ReferenceGuide/table-info.html Example of how to list information for a specific table using the CLI, including the `-json` option for formatted output. The path should be absolute and include the cluster name. ```bash maprcli table info -path /mapr/my.cluster.com/volume1/mytable -json ``` -------------------------------- ### Install the Installer and Definition Files Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/c_installer_how_it_works.html Use this option to install the Installer and definition files. This is the default behavior if no other option is specified. ```bash ./mapr-setup.sh install ``` -------------------------------- ### Filtering GET Operation Results Example - C Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/MapR-DB/SupportforHBaseJavaFilter-C-get.html Shows how to filter results from a GET operation using the libMapRClient C API. The mapr-client package must be installed. ```c #include #include #include #include #include #include #include #include #define HBASE_CONF_FILE "core-site.xml" // Example: Filter on the results of a GET operation // This example is a placeholder and requires actual implementation details // for setting up the MapRClient, table, row key, filter, and processing results. int main(int argc, char **argv) { // Placeholder for actual C code implementation printf("This is a placeholder for the GET operation filtering example.\n"); printf("Actual implementation would involve MapRClient initialization, fetching a specific row, applying a filter, and processing the result.\n"); return 0; } ``` -------------------------------- ### MapRFileSystem ACE Management Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/DevelopmentGuide/SampleApplications-Java-API.html A comprehensive example demonstrating setting, getting, modifying, and deleting Access Control Entries (ACEs) for directories and files using the MapRFileSystem API. It includes setup, operations, and verification steps. ```Java String rootDir = "maprfs:///"; Configuration conf = new Configuration(); FileSystem fs = FileSystem.get(conf); Path testDir = new Path(rootDir + "FileAceTest"); mkDir(fs, testDir); Path testFile = new Path(testDir + "/testFile"); createFile(fs, testFile); ArrayList aces = new ArrayList(); // Set System.out.println("SETTING ACES"); MapRFileAce ace = new MapRFileAce(MapRFileAce.AccessType.READFILE); ace.setBooleanExpression("u:m7user1"); aces.add(ace); ace = new MapRFileAce(MapRFileAce.AccessType.READDIR); ace.setBooleanExpression("u:m7user1|u:root"); aces.add(ace); ((MapRFileSystem)fs).setAces(testDir, aces); ((MapRFileSystem)fs).setAces(testFile, aces); // Get System.out.println("GETTING ACES"); List newDirAces = ((MapRFileSystem)fs).getAces(testDir); System.out.println("Path: " + testDir); for (int i = 0; i < newDirAces.size(); ++i) { System.out.println(newDirAces.get(i).getAccessType() + ": " + newDirAces.get(i).getBooleanExpression()); } System.out.println(""); List newFileAces = ((MapRFileSystem)fs).getAces(testFile); System.out.println("Path: " + testFile); for (int i = 0; i < newFileAces.size(); ++i) { System.out.println(newFileAces.get(i).getAccessType() + ": " + newFileAces.get(i).getBooleanExpression()); } // Modify System.out.println("MODIFYING ACES"); aces = new ArrayList(); ace = new MapRFileAce(MapRFileAce.AccessType.READDIR); ace.setBooleanExpression("u:m7user1|u:root|u:m7user2"); aces.add(ace); ace = new MapRFileAce(MapRFileAce.AccessType.WRITEFILE); ace.setBooleanExpression("u:m7user2"); aces.add(ace); ((MapRFileSystem)fs).modifyAces(testDir, aces); ((MapRFileSystem)fs).modifyAces(testFile, aces); // Get System.out.println("GETTING ACES"); newDirAces = ((MapRFileSystem)fs).getAces(testDir); System.out.println("Path: " + testDir); for (int i = 0; i < newDirAces.size(); ++i) { System.out.println(newDirAces.get(i).getAccessType() + ": " + newDirAces.get(i).getBooleanExpression()); } System.out.println(""); newFileAces = ((MapRFileSystem)fs).getAces(testFile); System.out.println("Path: " + testFile); for (int i = 0; i < newFileAces.size(); ++i) { System.out.println(newFileAces.get(i).getAccessType() + ": " + newFileAces.get(i).getBooleanExpression()); } // Delete System.out.println("DELETING ACES"); ((MapRFileSystem)fs).deleteAces(testDir); ((MapRFileSystem)fs).deleteAces(testFile); // Get System.out.println("GETTING ACES"); newDirAces = ((MapRFileSystem)fs).getAces(testDir); System.out.println("Path: " + testDir); if (newDirAces == null || newDirAces.size() == 0) System.out.println("AceCount: 0"); else System.out.println("AceCount: " + newDirAces.size()); System.out.println(""); newFileAces = ((MapRFileSystem)fs).getAces(testFile); System.out.println("Path: " + testFile); if (newFileAces == null || newFileAces.size() == 0) System.out.println("AceCount: 0"); else System.out.println("AceCount: " + newFileAces.size()); // Get System.out.println("GETTING ACES"); newDirAces = ((MapRFileSystem)fs).getAces(testDir); System.out.println("Path: " + testDir); for (int i = 0; i < newDirAces.size(); ++i) { System.out.println(newDirAces.get(i).getAccessType() + ": " + newDirAces.get(i).getBooleanExpression()); } System.out.println(""); ``` -------------------------------- ### Getting Started with cURL Commands for MapR-DB JSON REST API Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/MapR-DB/JSON_DB/UsingMapRDBJSONRESTAPI.html Use cURL commands to invoke the MapR-DB JSON REST API for basic operations. These examples demonstrate the core functionality. ```bash curl -X POST -d '{"name":"John Doe", "age":30}' http://:/ ``` ```bash curl http://:// ``` ```bash curl -X PUT -d '{"name":"Jane Doe", "age":31}' http://:// ``` ```bash curl -X DELETE http://:// ``` ```bash curl -X POST -d '{"name":"John Doe", "age":30}' http://:/?_id= ``` ```bash curl http://:/?query={"age":{"$gt":25}} ``` ```bash curl http://:/?query={"name":"John Doe"}&fields=name,age ``` ```bash curl http://:/?query={"age":{"$gt":25}}&sort={"age":-1} ``` -------------------------------- ### Start Hue Webserver on Edge Node Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Hue/StartingHueWebserver.html Use this command to start the Hue webserver when it's installed on an edge node. This is not the recommended installation method. ```bash /opt/mapr/hue/hue-/bin/hue-server start ``` -------------------------------- ### Start ZooKeeper Service Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/UpgradeGuide/RestartingClusterServices.html Start the ZooKeeper service if it is installed on the node. ```bash # service mapr-zookeeper start ``` -------------------------------- ### Kafka Connect REST API: Get Connector Tasks Request Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Kafka/Connect-rest-get-connectors-tasks.html An example HTTP request to the Kafka Connect REST API to get tasks for the 'hdfs-sink-connector'. ```http GET /connectors/hdfs-sink-connector/tasks HTTP/1.1 Host: connect.example.com ``` -------------------------------- ### Set Up CDC with Default Topic Partitions Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/MapR-DB/DB-ChangeData/setting-up-cdc-example1.html This example demonstrates creating a volume, a JSON table, a Streams changelog stream with default partitions, and establishing a changelog relationship. It then views the changelog information. ```bash maprcli volume create -name cdcvol maprcli table create -path /user/mapr/cdcvol/tab1 -tabletype JSON maprcli stream create -path /user/mapr/cdcvol/stream1 -source /user/mapr/cdcvol/tab1 -source_type TABLE -source_topic default maprcli stream topic add -path /user/mapr/cdcvol/stream1 -topic default -source /user/mapr/cdcvol/tab1 -source_type TABLE maprcli stream changelog list -path /user/mapr/cdcvol/stream1 ``` -------------------------------- ### Start or Restart Installer Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/StartingandStoppingInstaller.html Execute this command to initiate the `mapr-installer` service or to restart it if it is already running. Requires root privileges. ```bash systemctl start mapr-installer ``` -------------------------------- ### Remove Installer Data with Installer 1.10+ Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/troubleshoot_repo_url_errors.html Use the 'remove' command to delete properties.json, the installer database, and installer packages for Installer 1.10 and later. The setup script itself is not removed. ```bash bash /tmp/mapr-setup.sh remove ``` -------------------------------- ### Example Output of Get Controller Command Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/ReferenceGuide/kafkatopic_getcontroller.html This JSON output displays details of the Apache Kafka Wire Protocol broker, including its ID, host, port, security protocol, and start time. This is the result of running the `maprcli kafkatopic getcontroller -json` command. ```json { "timestamp":1687176345951, "timeofday":"2023-06-19 05:05:45.951 GMT-0700 AM", "status":"OK", "total":1, "data":[ { "id":0, "host":"m2-sm2027-14-n2.mip.storage.hpecorp.net", "port":"9092", "security.protocol":"SASL_PLAINTEXT", "sasl.mechanism":"PLAIN", "starttime":"1687008489078" } ] } ``` -------------------------------- ### Example gateway.conf File Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/ReferenceGuide/gateway.conf.html This is an example of a gateway.conf file, showing commented-out properties that can be configured. Properties are loaded at startup and are specific to the Gateway instance that loads them. ```properties # # Gateway Config file. # Properties defined in this file are loaded during startup # and are valid for only Gateway which loaded the config. # These parameters are not persisted anywhere else. # # Gateway listening port #gateway.port=7660 # Number of worker threads to receive replication stream requests #gateway.receive.numthreads=128 # Number of flush threads to send put requests to replicas #gateway.flush.numthreads=128 # # Max limit on putbuffer memory in MB #gateway.put.mem.mb=128 # # Max limit on log file size #gateway.logfile.size.mb=1024 # # # Gateway ES properties #gateway.es.request.maxsize.kb=128 #gateway.es.cluster.maxClients=1 ``` -------------------------------- ### Get Consumer Instance Subscription Request Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Kafka/REST-get-consumers-instances-subscription.html Example of an HTTP GET request to retrieve the subscription list for a Kafka consumer instance. Ensure the Content-Type header is set to application/vnd.kafka.v2+json. ```curl curl -X GET -H "Content-Type: application/vnd.kafka.v2+json" https://localhost:8082/consumers/grouptest/instances/user/subscription ``` -------------------------------- ### Install Go OJAI Client Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/MapR-DB/JSON_DB/GettingStartedGoOJAI.html Install the Go OJAI client using the go get command. Ensure Golang 1.10 or later is installed. ```bash go get github.com/mapr/maprdb-go-client ``` -------------------------------- ### Install with Local Repository using Archive Files Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/c_local_repo_install.html Run the `mapr-setup.sh` script with the `-a` flag followed by the full path to the archive files. This bypasses the internet connectivity check and automatically creates a local repository. ```bash ./mapr-setup.sh -a ``` -------------------------------- ### CLI Example: Setting Up CDC Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/MapR-DB/DB-ChangeData/setting-up-cdc-example1.html Use these CLI commands to set up CDC by creating volumes, a JSON table, a changelog stream, and a changelog relationship. View changelog information using the info command. ```bash // Creating and mounting a volume for the source table maprcli volume create -name tableVolume -path /tableVolume // Creating and mounting a volume for the destination stream maprcli volume create -name streamVolume -path /streamVolume // Creating a new JSON table maprcli table create -path /tableVolume/cdcTable -tabletype json // Creating a stream for CDC data maprcli stream create -path /streamVolume/changelogStream -ischangelog true // Creating a changelog relationship between the source table and the stream maprcli table changelog add -path /tableVolume/cdcTable -changelog /streamVolume/changelogStream:cdcTopic1 // Viewing the changelog information maprcli table changelog info -changelog /streamVolume/changelogStream:cdcTopic1 -json ``` -------------------------------- ### Drill JDBC URL for Single-Node Installation Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Drill/Downloading-Configuring-Driver.html Example connection URLs for a Drill installation on a single node. ```text jdbc:drill:zk=10.10.100.56:5181/drill/demo_mapr_com-drillbits jdbc:drill:zk=10.10.100.24:2181/drill/drillbits1 ``` -------------------------------- ### Start ZooKeeper Service Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/patch_datanodes.html Use this command to start the ZooKeeper service on a data node after patching, if it was installed. ```bash sudo service mapr-zookeeper start ``` -------------------------------- ### Run MapR Installer Container Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/pre_built_installer_container_images.html Execute the sample-run script to start the MapR Installer services within a Docker container. Ensure Docker is installed and running. ```bash $ ./docker_images/installer/mapr-docker-installer.sh ``` -------------------------------- ### Example Configuration for configure.sh Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdministratorGuide/t_CLDBFailover_restart_nodes.html An example of how to use the `configure.sh` script with specific CLDB and ZooKeeper hostnames and ports, along with a cluster name. ```bash /opt/mapr/server/configure.sh -C r1n1.sj.us:7222 -Z r1n1.sj.us:5181,r2n1.sj.us:5181,r3n1.sj.us:5181,r4n1.sj.us:5181,r5n1.sj.us:5181 -N MyCluster ``` -------------------------------- ### Example db.conf File Configuration Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/ReferenceGuide/db.conf.html This example shows a typical configuration for the db.conf file, illustrating various parameters for database connection and data retention. ```properties db.url=localhost:3306 db.user=root db.passwd=mapr db.schema=metrics db.mode=mysql db.driverclass=com.mysql.jdbc.Driver db.joblastacessed.limit.hours=48 db.partition.finest.count.days=3 db.partition.fine.count.days=15 db.partition.coarse.count.years=100 ### How many files with raw node metrics data to keep metric.file.rotate=365 ``` -------------------------------- ### Drill JDBC URL for Distributed Installation Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Drill/Downloading-Configuring-Driver.html Example connection URL for a distributed Drill installation connecting to a ZooKeeper quorum. ```text jdbc:drill:zk=10.10.100.30:5181,10.10.100.31:5181,10.10.100.32:5181/drill/drillbits1 ``` -------------------------------- ### Create Storage Pool Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/ReferenceGuide/mrconfig-sp-make.html Demonstrates how to create a storage pool on a disk group with the device path `/dev/sdc` on the local node. Ensure data on `/dev/sdc` is backed up before execution. ```bash /opt/mapr/server/mrconfig sp make /dev/sdc ``` -------------------------------- ### Get Connector Status Request Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Kafka/Connect-rest-put-connectors-status.html This example shows how to make a GET request to the Kafka Connect REST API to retrieve the status of a connector named 'hdfs-sink-connector'. Ensure the Host header is set to your Connect cluster's address. ```http GET /connectors/hdfs-sink-connector/status HTTP/1.1 Host: connect.example.com ``` -------------------------------- ### Example: Enable Access Key Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/ReferenceGuide/mc-admin-creds-enable-access-key.html Example of enabling a specific access key for the 'salesobject' deployment. Ensure you replace 'XyAbZpo123tuY' with the actual access key. ```cli /opt/mapr/bin/mc admin creds enable-access-key salesobject XyAbZpo123tuY ``` -------------------------------- ### Run the Installer Container Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/CreatingInstallerContainer.html Execute the generated mapr-docker-installer.sh script to start the MapR installer services within the container. This command launches the installer, making it accessible via a web browser. ```bash ./docker_images/installer/mapr-docker-installer.sh ``` -------------------------------- ### Example Queue Configuration with Label Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdministratorGuide/LabelBasedScheduling-YARN-QueueLabels-FairScheduler.html An example demonstrating how to define a queue named 'Customer Data Analysis' with a weight of 2.0 and assign it the 'Fast' label. ```xml 2.0 ``` -------------------------------- ### Start Ecosystem Component Service Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/applying_patch_ecosystem_component.html On all nodes where the service is installed, start the ecosystem component service. Replace `` with the actual IP. ```bash maprcli node services -name livy -action start -nodes ``` -------------------------------- ### Configure and Start ATS 1.0 Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/MapROverview/c_configuring_ATS_for_yarn.html Run this script to configure and automatically start ATS 1.0. Replace `` with your actual hostname. ```bash configure.sh -R -TL ``` -------------------------------- ### MapR CLI Volume Mount Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/ReferenceGuide/CLI-Syntax.html Provides a practical example of the 'volume mount' command with specific parameters. This demonstrates how to type the command and its options on a single line for actual usage. ```bash maprcli volume mount -name test-volume -path /test ``` -------------------------------- ### Display Command-Line Help Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/c_installer_how_it_works.html Use this option to display the command-line help for the Installer. If used with other options, only -h is considered. ```bash ./mapr-setup.sh -h ``` -------------------------------- ### List All Installed Services, Groups, and Hosts Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/Stanzas/GettingInfoServices.html Use this command to get a comprehensive overview of all installed services, groups, and hosts in the cluster. ```bash ./bin/mapr-installer-cli list installed -n ``` -------------------------------- ### KSQL Demo Example Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Kafka/KSQL/ksql-reference.html Demonstrates creating a stream, performing a non-persistent query, and a persistent query in KSQL. ```ksql CREATE STREAM clicks (clicktime BIGINT, url VARCHAR,){ kafka_topic = 'kafka-topic-clicks', value_format = 'JSON' }; SELECT url FROM clicks WHERE clicktime > 1000000000000; CREATE TABLE redirects AS SELECT url, COUNT(*) as count FROM clicks GROUP BY url; ``` -------------------------------- ### Install POSIX Client on Ubuntu Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/t_MapRPOSIXfuseClient_install.html Use apt-get to install the POSIX client package. Replace '*' with 'basic' or 'platinum' as needed. ```bash # sudo apt-get install mapr-posix-client-*, where * is either the basic or the platinum package For example: apt-get install mapr-posix-client-basic ``` -------------------------------- ### Start ZooKeeper Service Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdministratorGuide/StartCluster.html Use this command to start the ZooKeeper service on nodes where it is installed. Ensure you are running as the root user or using sudo. ```bash service mapr-zookeeper start ``` -------------------------------- ### Make Setup Script Executable Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/MapRContainerDevelopers/RunMapRContainerDevelopers.html Before running the setup script, ensure it has execute permissions. ```bash chmod +x mapr_devsandbox_container_setup.sh ``` -------------------------------- ### Start FUSE-based POSIX Client Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdministratorGuide/Multitenancy-SampleWorkflow.html Start the FUSE-based POSIX client service after configuring fuse.conf. Ensure the service name matches your installation. ```bash $ service mapr-posix-client-* start ``` -------------------------------- ### Installer CLI Top-Level Help Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/Stanzas/SilentInstallerCommands.html Command to display top-level help information for the installer CLI. ```bash ./bin/mapr-installer-cli -h ``` -------------------------------- ### Example GET Request for Connector Configuration Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Kafka/Connect-rest-get-connector-config.html An example HTTP request to retrieve the configuration of the 'hdfs-sink-connector' using the Kafka Connect REST API. ```http GET /connectors/hdfs-sink-connector/config HTTP/1.1 Host: connect.example.com Accept: application/json ``` -------------------------------- ### Installer Service Status and Access URL Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/CreatingInstallerContainer.html This output indicates that the MapR installer service has started successfully within the container. It provides the log file location and the URL to access the web-based installer interface. ```text installer (380) started with log /opt/mapr/installer/logs/installer.log Started service mapr-installer ...Success To continue installing MapR software, open the following URL in a web browser If the address '172.17.0.2' is internal and not accessible from your browser, use the external address mapped to it instead https://172.17.0.2:9443 ``` -------------------------------- ### Install Hive, HiveServer2, and HiveMetastore on Ubuntu Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/InstallingHive.html Install Hive, HiveServer2, and HiveMetastore packages using apt-get on Ubuntu. ```bash apt-get install mapr-hive mapr-hiveserver2 mapr-hivemetastore ``` -------------------------------- ### Remove Installer Files with mapr-setup.sh Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/c_installer_faq.html Use this command to remove installer files, including properties.json and the installer database, when you need to rerun mapr-setup.sh with a new repository URL. This action does not remove the setup script itself. ```bash mapr-setup.sh remove ``` -------------------------------- ### Copy MapReduce Example Job to MapRFS Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/Hive/t_run_jobs_webhcat_server.html Copies the MapReduce example JAR file to the MapRFS layer. Ensure the Hadoop version matches your installation. ```bash hadoop fs -put /opt/mapr/hadoop/hadoop-/hadoop--dev-examples.jar /user/mapr/webhcat/examples.jar ``` -------------------------------- ### Start MySQL Command Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/UpgradeGuide/TroubleshootingHiveUpgradeIssues.html Use this command to start the MySQL client. Replace and with your actual credentials. ```bash mysql -u -p ``` -------------------------------- ### Install or Upgrade Core with Stanza Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/Stanzas/SilentInstallerCommands.html Use the `install` command for fresh installs, incremental installs, or upgrades. It requires a template file and supports optional overrides, certificate checking, URL, force, and verbose flags. ```bash install [-h] [--overrides [OVERRIDES [OVERRIDES …]]] [--no_check_certificate][--url URL] [--force][--verbose] --template TEMPLATE ``` -------------------------------- ### Example Installed Packages Output Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/Checking_MEP_version.html Examine the output of 'yum list installed' to find package versions, such as mapr-hadoop-util, which can be used to infer the EEP version. ```text Installed Packages ... mapr-cldb.x86_64 6.2.0.0.20200618050710.GA-1 @MapR_Core mapr-client.x86_64 6.2.0.0.20200618050710.GA-1 @MapR_Core mapr-core.x86_64 6.2.0.0.20200618050710.GA-1 @MapR_Core mapr-core-internal.x86_64 6.2.0.0.20200618050710.GA-1 @MapR_Core mapr-fileserver.x86_64 6.2.0.0.20200618050710.GA-1 @MapR_Core mapr-hadoop-util.x86_64 2.7.4.0.202006180214-1 @MapR_Ecosystem mapr-librdkafka.x86_64 0.11.3.202006031114-1 @MapR_Core mapr-zk-internal.x86_64 6.2.0.0.20200618050710.GA-1 @MapR_Core mapr-zookeeper.x86_64 6.2.0.0.20200618050710.GA-1 @MapR_Core ... ``` -------------------------------- ### Download mapr-setup.sh using wget Source: https://docs.ezmeral.hpe.com/datafabric-customer-managed/79/AdvancedInstallation/CreatingInstallerContainer.html Download the mapr-setup.sh script directly from the HPE Ezmeral package repository using wget. Ensure you have the correct user credentials and URL. This script is required to build the installer container image. ```bash wget --user= --password= https://package.ezmeral.hpe.com/releases/installer/mapr-setup.sh -P /tmp ```