### Run Discovery Agents Source: https://github.com/allenai/discoverybench/blob/main/README.md Execute discovery agents using the discovery_agent.py script with specified agent types and model configurations. ```bash Usage: discovery_agent.py [OPTIONS] QUERY Options: --agent_type [coder|react] Agent type to use for discovery, default is coder --model_name TEXT Model name, default is gpt-4o, available models are [gpt-4-turbo|llama-3-70b-chat|claud e-3-opus|gemini-pro]. Exhaustive list can be found in config/model_config.json --api_config TEXT API config file, default is config/api_config.json --log_file TEXT Log file --metadata_path TEXT Metadata file path [required] --metadata_type [real|synth] Metadata type [required] --add_domain_knowledge Add domain knowledge to query --add_workflow_tags Add Workflow Tags to query --help Show this message and exit. ``` -------------------------------- ### Evaluate Discovery Agents Source: https://github.com/allenai/discoverybench/blob/main/README.md Evaluate agent outputs against gold hypotheses and workflows using the discovery_eval.py script. ```bash Usage: discovery_eval.py [OPTIONS] QUERY Options: --gold_hypo TEXT Gold Hypothesis [required] --gold_workflow TEXT Gold Workflow --pred_hypo TEXT Predicted Hypothesis [required] --pred_workflow TEXT Predicted Workflow --metadata_path TEXT Metadata file path [required] --metadata_type [real|synth] Metadata type [required] --eval_output_path TEXT Evaluation output path --help Show this message and exit. ``` -------------------------------- ### Citation BibTeX Source: https://github.com/allenai/discoverybench/blob/main/README.md BibTeX citation for the DiscoveryBench research paper. ```bibtex @article{majumder2024discoverybench, author = "Bodhisattwa Prasad Majumder, Harshit Surana, Dhruv Agarwal, Bhavana Dalvi Mishra, Abhijeetsingh Meena, Aryan Prakhar, Tirth Vora, Tushar Khot, Ashish Sabharwal, Peter Clark", title = "DiscoveryBench: Towards Data-Driven Discovery with Large Language Models", journal = "arXiv", year = "2024", } ``` === COMPLETE CONTENT === This response contains all available snippets from this library. No additional content exists. Do not make further requests.