### Run Multimodal Evaluation Step 1

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

Execute this command to obtain evaluation data from the LLM for multimodal tasks.

```bash
1_prompt_chem
```

--------------------------------

### Run Multimodal Evaluation Step 2

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

Execute this command to obtain evaluation results from the LLM for multimodal tasks.

```bash
2_LLM_evaluate
```

--------------------------------

### Run Multimodal Evaluation Step 3

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

Execute this command to obtain evaluation results using code for multimodal tasks.

```bash
3_code_evaluate
```

--------------------------------

### Other Task Evaluation Script

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

Use this Python script to obtain metrics for abstract writing, outlining, reaction intermediates, single-step synthesis, multi-step synthesis, and physicochemical property tasks. Update 'foler_path' and 'excel_path'. Results are output to an Excel file.

```python
foler_path
excel_path
python 3_other_task_eval.py
```

--------------------------------

### Prompt for Chemical Evaluation

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

Execute this Python script to submit data for LLM evaluation. Adjust 'folder_path' and 'output_file' as needed.

```python
folder_path
output_file
python 1_prompt_chem.py
```

--------------------------------

### Evaluate Script

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

Run this Python script to obtain evaluation results after data extraction. Update 'root_path' to the directory containing the extracted results.

```python
root_path=path/to/result_ntimes
python 3_Evaluate.py
```

--------------------------------

### L1 Task Evaluation Script

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

This Python script calculates metrics for various task types including multiple-choice, true/false, fill-in-the-blank, short answer, and calculation. Modify 'file_path' to the relevant data file. Results are output to an Excel file.

```python
file_path
python 2_L1_task_eval.py
```

--------------------------------

### Split Filename Script

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

Use this Python script to split task files based on the 'filename' field. Modify the 'dir_path' variable to point to your dataset directory.

```python
dir_path=path/to/dataset_ntimes
python 1_Split_filename.py
```

--------------------------------

### Extract Answers Script

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

This Python script extracts answers from model responses and generates JSONL files. Ensure 'file_dir' points to the dataset directory. Output is saved in the 'result_ntimes' folder.

```python
file_dir=path/to/dataset_ntimes
python 2_Extract.py
```

--------------------------------

### ChemEval Citation

Source: https://github.com/ustc-starteam/chemeval/blob/main/README.md

This is the citation information for the ChemEval paper. Please cite this when using the dataset.

```bibtex
@article{huang2024chemeval,
  title={ChemEval: A Comprehensive Multi-Level Chemical Evaluation for Large Language Models},
  author={Huang, Yuqing and Zhang, Rongyang and He, Xuesong and Zhi, Xuyang and Wang, Hao and Li, Xin and Xu, Feiyang and Liu, Deguang and Liang, Huadong and Li, Yi and others},
  journal={arXiv preprint arXiv:2409.13989},
  year={2024}
}
```

=== COMPLETE CONTENT === This response contains all available snippets from this library. No additional content exists. Do not make further requests.