### Install mrfparse with go install Source: https://github.com/danielchalef/mrfparse/blob/main/README.md Install the latest version of mrfparse using the go install command. ```bash go install github.com/danielchalef/mrfparse@latest ``` -------------------------------- ### mrfparse Configuration Example Source: https://github.com/danielchalef/mrfparse/blob/main/README.md Example configuration for mrfparse using a YAML file. This sets logging level, service file location, writer parameters, and pipeline timeouts. ```yaml log: level: info services: file: services.csv writer: max_rows_per_file: 100_000_000 filename_template: "_%04d.zstd.parquet" max_rows_per_group: 1_000_000 tmp: path: /tmp pipeline: download_timeout: 20 # minutes ``` -------------------------------- ### Build mrfparse binary with Makefile Source: https://github.com/danielchalef/mrfparse/blob/main/README.md Build the mrfparse binary using the default Makefile target. ```bash make ``` -------------------------------- ### Build mrfparse Docker image with Makefile Source: https://github.com/danielchalef/mrfparse/blob/main/README.md Build the Docker image for mrfparse using the 'docker-build' target in the Makefile. ```bash make docker-build ``` -------------------------------- ### Release mrfparse Docker image with Makefile Source: https://github.com/danielchalef/mrfparse/blob/main/README.md Release the mrfparse Docker image to a registry after editing the Makefile for registry and tag. Use the 'docker-release' target. ```bash make docker-release ``` -------------------------------- ### Parse Gzipped MRF to S3 Source: https://github.com/danielchalef/mrfparse/blob/main/README.md Use this command to parse a gzipped MRF file from a URL and output the resulting parquet dataset to an S3 bucket. The `-p` flag specifies the number of parallel workers. ```bash mrfparse pipeline -i https://mrf.healthsparq.com/aetnacvs/inNetworkRates/2022-12-05_Innovation-Health-Plan-Inc.json.gz \ -o s3://mrfdata/staging/2022-12-05/aetnacvs/ \ -p 99 ``` -------------------------------- ### Parse Gzipped MRF to Local Filesystem Source: https://github.com/danielchalef/mrfparse/blob/main/README.md This command parses a gzipped MRF file from a Google Cloud Storage bucket and saves the parquet dataset to the local filesystem. Ensure you have the necessary GCS credentials configured. ```bash mrfparse pipeline -i gs://mrfdata/staging/2022-12-05_Innovation-Health-Plan-Inc.json.gz \ -o mrfdata/staging/2022-12-05/aetnacvs/ \ -p 99 ``` === COMPLETE CONTENT === This response contains all available snippets from this library. No additional content exists. Do not make further requests.