GROBID

https://grobid.readthedocs.io/en/latest/
Admin
GROBID is a machine learning library for extracting, parsing and re-structuring raw documents such...
Tokens:62,732
Snippets:778
Trust Score:9.6
Update:2 months ago
Show doc for...
Tokens:
Raw
### Start Monitoring Stack

Source: https://grobid.readthedocs.io/en/latest/Monitoring

Execute this command to start the services defined in the docker-compose.yml file.

```bash
docker compose up -d
```

--------------------------------

### Install JEP Library

Source: https://grobid.readthedocs.io/en/latest/Deep-Learning-models

Execute the provided script to install the native JEP library required for the Java-Python bridge.

```bash
./grobid-home/scripts/install_jep_lib.sh 
```

--------------------------------

### Run GROBID Service

Source: https://grobid.readthedocs.io/en/latest/Deep-Learning-models

Start the GROBID service using Gradle.

```bash
./gradlew run
```

--------------------------------

### Verify Java Installation

Source: https://grobid.readthedocs.io/en/latest/Install-Grobid

Commands to verify the installed versions of the Java runtime and compiler.

```bash
# Check Java version
java -version

# Check JDK version (should show 21+ for building)
javac -version
```

--------------------------------

### Install OpenJDK 21 on Linux (CentOS/RHEL/Fedora)

Source: https://grobid.readthedocs.io/en/latest/Install-Grobid

Command to install the OpenJDK 21 development kit using the dnf package manager.

```bash
# For JDK 21
sudo dnf install java-21-openjdk-devel
```

--------------------------------

### Test DeLFT Installation

Source: https://grobid.readthedocs.io/en/latest/Deep-Learning-models

Verify the DeLFT environment by running the citation tagger application.

```bash
cd delft/
python -m delft.applications.grobidTagger citation tag --architecture BidLSTM_CRF
```

--------------------------------

### Run the PDF-TEI-Editor with Docker

Source: https://grobid.readthedocs.io/en/latest/PDF-TEI-Editor

Starts the editor container, configuring the admin password and the GROBID server URL.

```bash
docker run -p 8000:8000 \
  -e APP_ADMIN_PASSWORD=secure_password \
  -e GROBID_SERVER_URL=https://grobidOrg-grobid-full.hf.space \
  cboulanger/pdf-tei-editor:latest
```

--------------------------------

### GET /api/isalive

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Checks if the service has completed initialization successfully.

```APIDOC
## GET /api/isalive

### Description
Returns true/false as plain text indicating whether the service completed initialization successfully. Suitable for use as a liveness probe.

### Method
GET

### Endpoint
/api/isalive

### Response
#### Success Response (200)
- **body** (string) - Returns 'true' if alive.

#### Error Response (503)
- **status** (integer) - Returns 503 when not initialized or initialization failed.
```

--------------------------------

### Standalone installation directory structure

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Expected directory layout after extracting the standalone service distributions.

```text
.
├── grobid-home
└── grobid-service
```

--------------------------------

### Install JNI JAR

Source: https://grobid.readthedocs.io/en/latest/Recompiling-and-integrating-CRF-libraries

Deploy the JNI JAR file to the local repository within grobid-core.

```bash
> mvn install:install-file -Dfile=wapiti-1.5.0.jar -DgroupId="fr.limsi.wapiti" -DartifactId="wapiti" -Dversion="1.5.0" -Dpackaging="jar" -DlocalRepositoryPath="GROBID-ROOT-DIRECTORY/grobid-core/lib"
```

--------------------------------

### Install OpenJDK 21 on Linux (Ubuntu/Debian)

Source: https://grobid.readthedocs.io/en/latest/Install-Grobid

Commands to update package lists and install the OpenJDK 21 development kit on Debian-based systems.

```bash
# Ubuntu 22.04+ or Debian 12+
sudo apt update
sudo apt install openjdk-21-jdk
```

--------------------------------

### TEI Citation Output Example

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Example of the TEI-structured output returned by the service, including raw reference notes.

```xml
<biblStruct >
    <analytic>
        <title/>
        <author>
            <persName xmlns="http://www.tei-c.org/ns/1.0"><forename type="first">T</forename><forename type="middle">J</forename><surname>Vaughan</surname></persName>
        </author>
    </analytic>
    <monogr>
        <title level="j">Nat.Biotech</title>
        <imprint>
            <biblScope unit="volume">14</biblScope>
            <biblScope unit="page" from="309" to="314" />
            <date type="published" when="1996" />
        </imprint>
    </monogr>
    <note type="raw_reference"> Vaughan, T.J. et al., Nat.Biotech., 14:309-314(1996)</note>
</biblStruct>


<biblStruct >
    <monogr>
        <title/>
        <author>
            <persName xmlns="http://www.tei-c.org/ns/1.0"><forename type="first">Perkin</forename><surname>Elmer</surname></persName>
        </author>
        <imprint>
            <biblScope unit="volume">1</biblScope>
            <biblScope unit="page">1000</biblScope>
        </imprint>
    </monogr>
    <note type="report_type">Cat.1244-360</note>
    <note type="raw_reference">Perkin Elmer, Cat.1244-360, 1:1000</note>
</biblStruct>
```

--------------------------------

### Install OpenJDK 21 on macOS

Source: https://grobid.readthedocs.io/en/latest/Install-Grobid

Commands to install OpenJDK 21 via Homebrew and configure the JAVA_HOME environment variable.

```bash
# Install JDK 21
brew install openjdk@21

# Set JAVA_HOME (add to ~/.zshrc or ~/.bash_profile)
export JAVA_HOME=$(brew --prefix)/opt/openjdk@21/libexec/openjdk.jdk/Contents/Home
```

--------------------------------

### Build and run standalone service

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Commands to build the distribution, create an installation directory, and execute the standalone service binary.

```bash
./gradlew clean assemble
cd ..
mkdir grobid-installation
cd grobid-installation
unzip ../grobid/grobid-service/build/distributions/grobid-service-0.9.1.zip
mv grobid-service-0.9.1 grobid-service
unzip ../grobid/grobid-home/build/distributions/grobid-home-0.9.1.zip
./grobid-service/bin/grobid-service
```

--------------------------------

### Running the Grobid container

Source: https://grobid.readthedocs.io/en/latest/Grobid-docker

Commands to start the Grobid container with default or custom port mappings.

```bash
> docker run --rm --init --ulimit core=0 -p 8070:8070 grobid/grobid:${latest_grobid_version}-crf
```

```bash
> docker run --rm --init --ulimit core=0 -p 8070:8070 grobid/grobid:0.9.1-crf
```

```bash
docker run --rm --init --ulimit core=0 -p 8080:8070 -p 8081:8071 grobid/grobid:${latest_grobid_version}-crf
```

--------------------------------

### GET /api/allTraining

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Lists all training tokens currently running in the server instance.

```APIDOC
## GET /api/allTraining

### Description
List the tokens of the trainings currently running in this server instance.

### Method
GET

### Endpoint
/api/allTraining

### Response
#### Success Response (200)
- **tokens** (array) - List of active training tokens

#### Error Handling
- 500: Internal service error
```

--------------------------------

### Run Deep Learning GROBID Container

Source: https://grobid.readthedocs.io/en/latest/Grobid-docker

Starts a container with GPU support and optional configuration mounting.

```bash
docker run --rm --gpus all --init --ulimit core=0 -p 8080:8070 -p 8081:8071 grobid/grobid:0.9.2-SNAPSHOT
```

```bash
docker run --rm --gpus all --init --ulimit core=0 -p 8080:8070 -p 8081:8071 -v /home/lopez/grobid/grobid-home/config/grobid.yaml:/opt/grobid/grobid-home/config/grobid.yaml:ro grobid/grobid:0.9.2-SNAPSHOT
```

--------------------------------

### Run a full GROBID instance with Docker

Source: https://grobid.readthedocs.io/en/latest/PDF-TEI-Editor

Starts a GROBID server container with deep learning models enabled on port 8070.

```bash
docker run --rm --gpus all --init --ulimit core=0 -p 8070:8070 grobid/grobid:0.9.1-full
```

--------------------------------

### Install native libraries

Source: https://grobid.readthedocs.io/en/latest/Recompiling-and-integrating-CRF-libraries

Copy the compiled native libraries to the appropriate Grobid home directory for Linux or Mac OS X.

```bash
> cp ld-linux-x86-64.so.2 libc.so.6 libgcc_s.so.1 libm.so.6 libstdc++.so.6 libwapiti.so GROBID-ROOT-DIRECTORY/grobid-home/lib/lin-<nb bits of the OS>
```

```bash
> cp libwapiti.dylib GROBID-ROOT-DIRECTORY/grobid-home/lib/mac-64/
```

--------------------------------

### Run Grobid Container

Source: https://grobid.readthedocs.io/en/latest/Grobid-docker

Standard command to start the Grobid container with GPU support and core dump limits.

```bash
> docker run --rm --gpus all --init --ulimit core=0 -p 8070:8070 grobid/grobid:0.9.1-full
```

--------------------------------

### Start the GROBID service via Docker

Source: https://grobid.readthedocs.io/en/latest/Upgrading

Command to launch the GROBID service using a Docker container.

```bash
docker run ... grobid/grobid:0.9.1-full
```

--------------------------------

### Example CXXABI Linker Error

Source: https://grobid.readthedocs.io/en/latest/Frequently-asked-questions

An example of the ImportError encountered when the system's libstdc++ version is incompatible with the Python environment's requirements.

```text
ImportError: /home/user/miniconda3/envs/myenv/lib/python3.10/lib-dynload/../../libicui18n.so.78:
  version `CXXABI_1.3.15' not found (required by .../libstdc++.so.6)
```

--------------------------------

### GET /metrics/prometheus

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Retrieves application and JVM metrics in Prometheus exposition format.

```APIDOC
## GET /metrics/prometheus

### Description
Returns application metrics (rate/throughput per entry point) and JVM/process metrics (heap, GC, threads, CPU) in Prometheus exposition format.

### Method
GET

### Endpoint
/metrics/prometheus
```

--------------------------------

### GET /api/version

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Retrieves the current version and revision of the running GROBID service.

```APIDOC
## GET /api/version

### Description
Returns the current version and the revision of the running service.

### Method
GET

### Endpoint
/api/version
```

--------------------------------

### Create Anaconda environment

Source: https://grobid.readthedocs.io/en/latest/Deep-Learning-models

Initializes a new conda environment named grobidDelft with pip installed.

```bash
conda create --name grobidDelft pip
```

--------------------------------

### Start Model Training with cURL

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Initiates a training process for a specified model using the /api/modelTraining endpoint.

```bash
curl -v -X POST -d "model=date" -d "type=holdout" localhost:8070/api/modelTraining
```

--------------------------------

### Tagging Web References

Source: https://grobid.readthedocs.io/en/latest/training/Bibliographical-references

Example of tagging a web-based reference including publisher, date, and URL pointer.

```xml
<?xml version="1.0" encoding="UTF-8"?>
<tei xmlns="http://www.tei-c.org/ns/1.0" 
      xmlns:xlink="http://www.w3.org/1999/xlink" 
      xmlns:mml="http://www.w3.org/1998/Math/MathML">

    <listBibl>
        <bibl>
            <publisher>Microsoft</publisher>. <date>2019</date>.
            <title level="m">Azure REST API Specifications</title>.
            <ptr type="web">https://github.com/Azure/azurerest-api-specs</ptr> Last accessed <date>2019-11-22</date>.
        </bibl>
    </listBibl>

</tei>
```

--------------------------------

### Run GROBID Lightweight Docker Image

Source: https://grobid.readthedocs.io/en/latest/getting_started

Starts the CPU-only lightweight container for high-performance, low-resource environments. Suitable for processing large volumes of PDFs where maximum accuracy is not the primary requirement.

```bash
docker run --rm --init --ulimit core=0 -p 8070:8070 grobid/grobid:0.9.1-crf
```

--------------------------------

### Configure DeLFT Global Parameters

Source: https://grobid.readthedocs.io/en/latest/Configuration

Defines the installation path and virtual environment for the DeLFT library. Required when using Deep Learning architectures.

```yaml
  delft:
    # delft installation path if Deep Learning architectures are used to implement one of the sequence labeling model, 
    # embeddings are usually compiled as lmdb under delft/data (this parameter is ignored if only featured-engineered CRF are used)
    install: "../delft"
    pythonVirtualEnv: "../delft/env"

```

--------------------------------

### Configure GROBID for DeLFT

Source: https://grobid.readthedocs.io/en/latest/Deep-Learning-models

Define the DeLFT installation path and model architectures in the grobid.yaml configuration file.

```yaml
  delft:
    install: "../delft"
```

```yaml
  models:
    - name: "citation"
      engine: "delft"
      architecture: "BidLSTM_CRF_FEATURES"
```

```yaml
  models:
    - name: "citation"
      engine: "delft"
      architecture: "BERT_CRF"
      transformer: "allenai/scibert_scivocab_cased"
```

```yaml
  delft:
    pythonVirtualEnv: /where/my/damned/python/virtualenv/is/ 
```

--------------------------------

### GET /api/health

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Provides detailed health status and engine pool metrics.

```APIDOC
## GET /api/health

### Description
Returns a JSON object with detailed status including initialization state, engine pool metrics, and configuration checks. Suitable for use as a readiness probe.

### Method
GET

### Endpoint
/api/health

### Response
#### Success Response (200)
- **body** (JSON) - Detailed status object including initialization state and engine pool metrics.

#### Error Response (503)
- **status** (integer) - Returns 503 when not ready to process requests.
```

--------------------------------

### Configure model engine and architecture

Source: https://grobid.readthedocs.io/en/latest/Deep-Learning-models

Example configuration block to set the citation model to use the delft engine with BidLSTM_CRF_FEATURES architecture.

```yaml
  models:
    - name: "citation"
      engine: "delft"
      architecture: "BidLSTM_CRF_FEATURES"
```

--------------------------------

### Example Prometheus metrics output

Source: https://grobid.readthedocs.io/en/latest/Monitoring

Sample of the plain-text format returned by the metrics endpoint, including JVM memory usage.

```text
# HELP jvm_memory_bytes_used Used bytes of a given JVM memory area.
# TYPE jvm_memory_bytes_used gauge
jvm_memory_bytes_used{area="heap",} 1.34217728E8
...
```

--------------------------------

### Resolve GLIBCXX library errors

Source: https://grobid.readthedocs.io/en/latest/Deep-Learning-models

Commands to install libgcc and set the LD_PRELOAD environment variable to resolve library version conflicts.

```bash
conda install libgcc

export export LD_PRELOAD=$anaconda_path/lib/libstdc++.so.6.0.25

./gradlew run
```

--------------------------------

### Parse patent citations with cURL

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Example command to send raw text to the processCitationPatentTXT endpoint for citation extraction.

```bash
curl -X POST -d "input=In EP0123456B1 nothing interesting." localhost:8070/api/processCitationPatentTXT
```

--------------------------------

### Process ST.36 Patent Citations via cURL

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Example request to the processCitationPatentST36 endpoint with raw citation inclusion enabled.

```bash
curl --form input=@/home/lopez/grobid/grobid-core/src/test/resources/s/006271747.xml --form includeRawCitations=1 localhost:8070/api/processCitationPatentST36
```

--------------------------------

### Initialize Grobid Engine

Source: https://grobid.readthedocs.io/en/latest/Grobid-java-library

Demonstrates how to set up the Grobid environment and process a PDF header using the Engine class.

```java
    import org.grobid.core.*;
    import org.grobid.core.data.*;
    import org.grobid.core.factory.*;
    import org.grobid.core.mock.*;
    import org.grobid.core.utilities.*;
    import org.grobid.core.engines.Engine;

    ...
    String pdfPath = "mypdffile.pdf";
    ...

    try {
        String pGrobidHome = "/Users/lopez/grobid/grobid-home";

        // The GrobidHomeFinder can be instantiate without parameters to verify the grobid home in the standard
        // location (classpath, ../grobid-home, ../../grobid-home)

        // If the location is customised: 
        GrobidHomeFinder grobidHomeFinder = new GrobidHomeFinder(Arrays.asList(pGrobidHome));       

        //The grobid yaml config file needs to be instantiate using the correct grobidHomeFinder or it will use the default 
        //locations
        GrobidProperties.getInstance(grobidHomeFinder);

        System.out.println(">>>>>>>> GROBID_HOME="+GrobidProperties.getGrobidHome());

        Engine engine = GrobidFactory.getInstance().createEngine();

        // Biblio object for the result
        BiblioItem resHeader = new BiblioItem();
        String tei = engine.processHeader(pdfPath, 1, resHeader);
    } 
    catch (Exception e) {
        // If an exception is generated, print a stack trace
        e.printStackTrace();
    } 
```

--------------------------------

### Fulltext Processing with Page Range

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Process a PDF starting from a specific page index, where the first page is indexed as 1.

```bash
curl -v --form input=@./thefile.pdf --form start=3 localhost:8070/api/processFulltextDocument
```

--------------------------------

### Deploy the bundled demo

Source: https://grobid.readthedocs.io/en/latest/PDF-TEI-Editor

Clones the repository and runs the demo deployment script.

```bash
git clone https://github.com/mpilhlt/pdf-tei-editor.git
cd pdf-tei-editor
npm run deploy .env.deploy.demo.localhost
```

--------------------------------

### Retrieve model archive with cURL

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Download a model archive using either POST or GET requests by specifying the model name and optional architecture.

```bash
curl -v -X POST -d "model=date" "architecture=crf" localhost:8070/api/model > model.zip
```

```bash
curl -v -X GET localhost:8070/api/model?model=date > model.zip
```

--------------------------------

### Extract PDF header metadata via cURL

Source: https://grobid.readthedocs.io/en/latest/Grobid-service

Use these commands to extract header information from a PDF file. The first example returns TEI XML, while the second returns BibTeX format.

```bash
curl -v -H "Accept: application/xml" --form input=@./thefile.pdf localhost:8070/api/processHeaderDocument
```

```bash
curl -v -H "Accept: application/x-bibtex" --form input=@./thefile.pdf localhost:8070/api/processHeaderDocument
```

--------------------------------

### Navigate to GROBID Directory

Source: https://grobid.readthedocs.io/en/latest/Grobid-batch

Change the current working directory to the project root.

```bash
> cd grobid/
```

--------------------------------

### Display Batch Command Help

Source: https://grobid.readthedocs.io/en/latest/Grobid-batch

View available batch commands and options for the GROBID core JAR.

```bash
> java -Djava.library.path=grobid-home/lib/lin-64:grobid-home/lib/lin-64/jep -jar grobid-core/build/libs/grobid-core-<current version>-onejar.jar -h
```

```bash
> java -Djava.library.path=grobid-home/lib/lin-64:grobid-home/lib/lin-64/jep -jar grobid-core/build/libs/grobid-core-0.9.0-onejar.jar -h
```

--------------------------------

### Run CRF-only GROBID Container

Source: https://grobid.readthedocs.io/en/latest/Grobid-docker

Starts a container configured for CRF-only model execution.

```bash
docker run --rm --init --ulimit core=0 -p 8080:8070 -p 8081:8071 grobid/grobid:0.9.2-SNAPSHOT
```

--------------------------------

### Execute training and evaluation via Gradle

Source: https://grobid.readthedocs.io/en/latest/Training-the-models-of-Grobid

Run the training and evaluation process for a specific model using the Gradle task command.

```bash
> ./gradlew train_<name_of_model>
```

```bash
> ./gradlew train_header
```

```bash
> ./gradlew train_name_header
```

--------------------------------

### Labeling Keywords

Source: https://grobid.readthedocs.io/en/latest/training/header

Examples of tagging keywords and classification schemes, excluding generic labels.

```xml
<keyword>Mathematics Subject Classification: 83C15, 81U15, 81V80, 17B80, 81R12<lb/></keyword> 

<keywords type="pacs">PACS numbers: 02.30.Ik, 03.65.Fd Fd<lb/></keywords>
```

```xml
<date>17 July 2007<lb/></date>

Keywords: 
<keyword>body mass index; weight change; coronary heart disease; 
    follow-up study; Japanese Japanese<lb/></keyword>
```

--------------------------------

### TEI Author Coordinates

Source: https://grobid.readthedocs.io/en/latest/Coordinates-in-PDF

Example of the coords attribute in TEI for a single bounding box.

```xml
<author>
    <persName coords="1,53.80,194.57,58.71,9.29">
        <forename type="first">Ron</forename>
        <forename type="middle">J</forename>
        <surname>Keizer</surname>
    </persName>
</author>
```

--------------------------------

### Configure Model Preloading

Source: https://grobid.readthedocs.io/en/latest/Configuration

Toggle model preloading to balance startup time against memory usage.

```yaml
  # for **service only**: how to load the models, 
  # false -> models are loaded when needed, avoiding putting in memory useless models (only in case of CRF) but slow down 
  #          significantly the service at first call
  # true -> all the models are loaded into memory at the server startup (default), slow the start of the services 
  #         and models not used will take some more memory (only in case of CRF), but server is immediately warm and ready
  modelPreload: true
```

--------------------------------

### Verify OTLP Metrics Startup Log

Source: https://grobid.readthedocs.io/en/latest/Monitoring

Check the application logs for this confirmation line to ensure metrics reporting is active.

```text
OtlpMetricsReporter: OTLP metrics push enabled -> https://otlp-gateway-prod-eu-central-0.grafana.net/otlp (http/protobuf), every 60s, service.name=grobid-service
```

--------------------------------

### Example of range citation callout text

Source: https://grobid.readthedocs.io/en/latest/End-to-end-evaluation

Shows a citation range in plain text format.

```text
Recent studies have described the use of contrast material with high iodine content (370 mg I/ml or 400 mg I/ml) for coronary CT angiography (CCTA) (1 – 4).
```

--------------------------------

### Rosetta error message

Source: https://grobid.readthedocs.io/en/latest/Grobid-docker

Example of the error message encountered when the platform flag is missing on ARM64.

```text
rosetta error: failed to open elf at /lib64/ld-linux-x86-64.so.2
```

--------------------------------

### Build GROBID with Gradle

Source: https://grobid.readthedocs.io/en/latest/Install-Grobid

Standard command to clean and build the GROBID project from the main directory.

```bash
> ./gradlew clean build
```

--------------------------------

### Initialize a new model programmatically

Source: https://grobid.readthedocs.io/en/latest/Notes-grobid-developers

Load the YAML configuration and register the model with GrobidProperties.

```java
        NewModuleConfiguration newModuleConfiguration = null;
        try {
            ObjectMapper mapper = new ObjectMapper(new YAMLFactory());
            newModuleConfiguration = mapper.readValue(new File("resources/config/config.yml"), NewModuleConfiguration.class);
        } catch(Exception e) {
            LOGGER.error("The config file does not appear valid, see resources/config/config.yml", e);
        }

        if (newModuleConfiguration != null && newModuleConfiguration.getModel() != null)
            GrobidProperties.getInstance().addModel(newModuleConfiguration.getModel());
        LibraryLoader.load();
```

--------------------------------

### GPL FAQ on Mere Aggregation

Source: https://grobid.readthedocs.io/en/latest/Frequently-asked-questions

Excerpt regarding the distribution of GPL and non-GPL software in an aggregate.

```text
The GPL permits you to create and distribute an aggregate, even when the licenses of the
other software are nonfree or GPL-incompatible. The only condition is that you cannot
release the aggregate under a license that prohibits users from exercising rights that
each program's individual license would grant them.
```

--------------------------------

### Tagging Years with Suffixes

Source: https://grobid.readthedocs.io/en/latest/training/Bibliographical-references

Example of tagging a year that includes a letter suffix, common in Harvard-style references.

```xml
<listBibl>
    <bibl>
        <author>Gavazzi G., Piertini D., Boselli A., Tuffs R.</author>, <date>1996c</date>, 
        <title level="j">A&amp;AS</title>, <biblScope unit="volume">120</biblScope>, 
        <biblScope unit="page">489</biblScope>(<note>Paper I</note>) 
    </bibl>
</listBibl>
```

--------------------------------

### Identify GLIBCXX dependency error

Source: https://grobid.readthedocs.io/en/latest/Deep-Learning-models

Example of an ImportError indicating a missing GLIBCXX version required by TensorFlow.

```text
! ImportError: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.20' not found (required by /home/Luca/.conda/envs/tensorflow/lib/python3.6/site-packages/tensorflow/python/_pywrap_tensorflow_internal.so)
```

--------------------------------

### TEI biblStruct consolidation attributes

Source: https://grobid.readthedocs.io/en/latest/Consolidation

Example of the status and source attributes applied to a biblStruct element after consolidation.

```xml
<biblStruct status="consolidated" source="crossref">
    ...
</biblStruct>
```

--------------------------------

### Run Grobid Docker with custom configuration

Source: https://grobid.readthedocs.io/en/latest/Grobid-docker

Mounts a local grobid.yaml file to the container using an absolute path.

```bash
docker run --rm --gpus all --init --ulimit core=0 -p 8080:8070 -p 8081:8071 -v /home/lopez/grobid/grobid-home/config/grobid.yaml:/opt/grobid/grobid-home/config/grobid.yaml:ro  grobid/grobid:0.9.1
```

--------------------------------

### Generate Training Data with createTraining

Source: https://grobid.readthedocs.io/en/latest/Grobid-batch

Executes the createTraining command to generate training data from PDF files.

```bash
> java -Xmx4G -Djava.library.path=grobid-home/lib/lin-64:grobid-home/lib/lin-64/jep -jar grobid-core/build/libs/grobid-core-0.9.0-onejar.jar -gH grobid-home -dIn /path/to/input/directory -dOut /path/to/output/directory -exe createTraining
```

--------------------------------

### Train specialized header model

Source: https://grobid.readthedocs.io/en/latest/Grobid-specialized-processes

Command to initiate training for the article/light-ref header model.

```bash
./gradlew train_header_article_light_ref
```

--------------------------------

### Execute Gradle Release

Source: https://grobid.readthedocs.io/en/latest/Notes-grobid-developers

Run this command from a release branch to initiate the versioning process and create the release commits and tag.

```bash
git checkout -b release/<X.Y.Z>
./gradlew release \
    -Prelease.useAutomaticVersion=true \
    -Prelease.releaseVersion=<X.Y.Z> \
    -Prelease.newVersion=<X.Y.(Z+1)>-SNAPSHOT
```

--------------------------------

### Annotate affiliation and address structure

Source: https://grobid.readthedocs.io/en/latest/training/affiliation-address

Example of tagging an affiliation block including department, institution, and address components.

```xml
<affiliation>
    <orgName type="department">Institute of Materials Science</orgName>
    of the 
    <orgName type="institution">Technische Universität Darmstadt</orgName>,
    address:
    <lb/>
    <address>
        <addrLine>Petersenstraße 23</addrLine>,
        <postCode>D-64287</postCode>
        <settlement>Darmstadt</settlement>,
        <country>Germany</country>.
    </address>
</affiliation>
```

--------------------------------

### Docker machine inspection output

Source: https://grobid.readthedocs.io/en/latest/Grobid-docker

Example JSON output from the docker-machine inspect command showing memory allocation.

```json
{
    "ConfigVersion": 3,
    "Driver": {
        "IPAddress": "192.168.99.100",
        "MachineName": "default",
        "SSHUser": "docker",
        "SSHPort": 55933,
        "SSHKeyPath": "/Users/lfoppiano/.docker/machine/machines/default/id_rsa",
        "StorePath": "/Users/lfoppiano/.docker/machine",
        "SwarmMaster": false,
        "SwarmHost": "tcp://0.0.0.0:3376",
        "SwarmDiscovery": "",
        "VBoxManager": {},
        "HostInterfaces": {},
        "CPU": 1,
        "Memory": 2048,     #<---- Memory: 2GB
        "DiskSize": 204800,
        "NatNicType": "82540EM",
        "Boot2DockerURL": "",
        "Boot2DockerImportVM": "",
        "HostDNSResolver": false,
        "HostOnlyCIDR": "192.168.99.1/24",
        "HostOnlyNicType": "82540EM",
        "HostOnlyPromiscMode": "deny",
        "NoShare": false,
        "DNSProxy": true,
        "NoVTXCheck": false
    },
    "DriverName": "virtualbox",
    "HostOptions": {
      [...]
        },
        "SwarmOptions": {
         [...]
        },
        "AuthOptions": {
           [...]
        }
    },
    "Name": "default"
}
```

--------------------------------

### Generate Blank Training Data with createTrainingBlank

Source: https://grobid.readthedocs.io/en/latest/Grobid-batch

Executes the createTrainingBlank command to generate a blank TEI file and default feature file from PDFs.

```bash
> java -Xmx4G -Djava.library.path=grobid-home/lib/lin-64:grobid-home/lib/lin-64/jep -jar grobid-core/build/libs/grobid-core-0.9.0-onejar.jar -gH grobid-home -dIn /path/to/input/directory -dOut /path/to/output/directory -exe createTrainingBlank
```

--------------------------------

### JSON Bounding Box Structure

Source: https://grobid.readthedocs.io/en/latest/Coordinates-in-PDF

Example of the pos attribute in JSON, representing a list of bounding boxes for an entity.

```json
"pos": [{  "p": 1,
            "x": 20,
            "y": 20,
            "h": 10,
            "w": 30 }, 
        {  "p": 1,
            "x": 30,
            "y": 20,
            "h": 10,
            "w": 30 } ]
```

--------------------------------

### JSON Page Dimensions Structure

Source: https://grobid.readthedocs.io/en/latest/Coordinates-in-PDF

Example of the pages attribute in JSON, defining the height and width of document pages.

```json
    "pages": [  {"page_height":792.0, "page_width":612.0}, 
                {"page_height":792.0, "page_width":612.0}, 
                {"page_height":792.0, "page_width":612.0}  ]
```
Tokens:
Raw