Mobile-Agent

https://github.com/x-plug/mobileagent
Admin
Mobile-Agent is a family of powerful mobile device operation assistants, including versions like...
Tokens:6,694
Snippets:54
Trust Score:5.9
License:MIT
Update:1 year ago
Show doc for...
Tokens:
Raw
### Run Provided Case Script (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/Mobile-Agent-qwen/README.md

Command to execute one of the example case scripts provided in the repository (e.g., run_darkmode.py, run_tiotok.py) after the Mobile-Agent host server has been successfully started.

```Bash
python run_xxx.py
```

--------------------------------

### Start Mobile-Agent Host (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/Mobile-Agent-qwen/README.md

Command to start the Mobile-Agent host server using the host.py script. This requires specifying the file path to the downloaded Grounding DINO checkpoint and providing your DashScope API key.

```Bash
cd MobileAgent-qwen
python host.py --grounding_ckpt /path/to/GroundingDION --api "your DashScopeAPI-KEY"
```

--------------------------------

### Install Mobile-Agent Dependencies (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/Mobile-Agent-qwen/README.md

Commands to clone the MobileAgent repository from GitHub, navigate into the directory, and install the required Python packages using pip, including the dashscope library and its upgrade.

```Bash
git clone https://github.com/X-PLUG/MobileAgent.git
cd MobileAgent
pip install -r requirements.txt
pip install dashscope
pip install dashscope --upgrade
```

--------------------------------

### Send Initial Inference Request (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/Mobile-Agent-qwen/README.md

Python script snippet using the requests library to send the first POST request to the local Mobile-Agent host. It includes the initial screenshot path, the user instruction (query), an empty session ID, and a guiding tutorial text.

```Python
import requests

tutorial = '''The following content may help you complete the instruction:
1. Dark mode is in \"Display & brightness\" of Settings.
2. \"Display & brightness\" can be found by scrolling down the setting page.
3. Tap the \"Dark mode\" to turn on the dark mode.
'''

image = "../results/Settings/1/1.jpg"
query_data = {'screenshot': image, 'query': 'Turn on the dark mode', 'session_id':'', 'tutorial': tutorial}
response_query = requests.post('http://127.0.0.1:5000/a', json=query_data)
print(response_query.json())
```

--------------------------------

### Install Mobile-Agent-E Dependencies

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Creates a new conda environment named 'mobile_agent_e' with Python 3.10, activates it, and then installs the project dependencies listed in the 'requirements.txt' file using pip.

```bash
conda create -n mobile_agent_e python=3.10 -y
conda activate mobile_agent_e
pip install -r requirements.txt
```

--------------------------------

### Installing Dependencies with pip (Shell)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-v2/README.md

Installs the required Python packages listed in the `requirements.txt` file. This is the first step after cloning the repository to set up the project environment.

```Shell
pip install -r requirements.txt
```

--------------------------------

### Installing PC-Agent Dependencies (Shell)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/README.md

Commands to set up a conda environment, activate it, install required libraries for either Windows or Mac, clone the OpenOCR repository, and install the openocr-python package. This prepares the environment for running PC-Agent.

```Shell
conda create --name pcagent python=3.10
source activate pcagent

# For Windows
pip install -r requirements.txt

# For Mac
pip install -r requirements_mac.txt

git clone https://github.com/Topdu/OpenOCR.git
pip install openocr-python
```

--------------------------------

### Test ADB Device Connection

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Executes the 'adb devices' command to list connected Android devices, verifying that ADB is correctly installed and configured to communicate with the device.

```bash
/path/to/adb devices
```

--------------------------------

### Test ADB Connection (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/Mobile-Agent-qwen/README.md

Command to verify that the Android Debug Bridge (ADB) environment is correctly set up and that your connected Android device is recognized by the system.

```Bash
/path/to/adb devices
```

--------------------------------

### Configuring OpenAI Backbone and API Key (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Configures the agent to use OpenAI as the backbone model by setting the `BACKBONE_TYPE` to "OpenAI" and providing the corresponding `OPENAI_API_KEY`.

```bash
export BACKBONE_TYPE="OpenAI"
export OPENAI_API_KEY="your-openai-key"
```

--------------------------------

### BibTeX Citation for Mobile-Agent-E

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Provides the BibTeX entry for citing the Mobile-Agent-E project, including authors, title, journal, and year. This is used for academic referencing.

```bibtex
@article{wang2025mobile,
  title={Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks},
  author={Wang, Zhenhailong and Xu, Haiyang and Wang, Junyang and Zhang, Xi and Yan, Ming and Zhang, Ji and Huang, Fei and Ji, Heng},
  journal={arXiv preprint arXiv:2501.11733},
  year={2025}
}
```

--------------------------------

### Setting Qwen API Key for Perceptor (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Sets the `QWEN_API_KEY` environment variable required for the default icon captioning model (`CAPTION_MODEL`) in the Perceptor component, which uses the Qwen API.

```bash
export QWEN_API_KEY="your-qwen-api-key"
```

--------------------------------

### Install Dependencies (Windows)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/README_v1.md

Installs required Python packages for PC-Agent on Windows using pip and the requirements_win.txt file.

```Shell
pip install -r requirements_win.txt
```

--------------------------------

### Install Dependencies (MacOS)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/README_v1.md

Installs required Python packages for PC-Agent on MacOS using pip and the requirements.txt file.

```Shell
pip install -r requirements.txt
```

--------------------------------

### Configuring Gemini Backbone and API Key (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Configures the agent to use Gemini as the backbone model by setting the `BACKBONE_TYPE` to "Gemini" and providing the corresponding `GEMINI_API_KEY`.

```bash
export BACKBONE_TYPE="Gemini"
export GEMINI_API_KEY="your-gemini-key"
```

--------------------------------

### Send Subsequent Inference Request (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/Mobile-Agent-qwen/README.md

Python script snippet for sending follow-up POST requests to the Mobile-Agent host after an operation has been performed on the device. It includes the new screenshot path, an empty query, the session ID received from the previous response, and the tutorial text.

```Python
image = "../results/Settings/1/2.jpg"
query_data = {'screenshot': image, 'query': '', 'session_id': response_query.json()['session_id'], 'tutorial': tutorial}
response_query = requests.post('http://127.0.0.1:5000/a', json=query_data)
print(response_query.json())
```

--------------------------------

### Installing Mobile-Agent Dependencies (Shell)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/README.md

This snippet provides the commands to clone the Mobile-Agent repository, navigate into the directory, and install the required Python dependencies using pip.

```Shell
git clone https://github.com/X-PLUG/MobileAgent.git
cd MobileAgent
pip install -r requirements.txt
```

--------------------------------

### Run Inference with Connected Device (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/Mobile-Agent-qwen/README.md

Command to initiate Mobile-Agent inference using a directly connected Android device via ADB. Requires specifying paths to the Grounding DINO checkpoint and ADB executable, your DashScope API key, and the instruction for the agent.

```Bash
python run.py --grounding_ckpt /path/to/GroundingDION --adb_path /path/to/adb --api "your DashScope API-KEY" --instruction "your instruction"
```

--------------------------------

### Running Tasks with Self-Evolution (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Executes the `run_tasks_evolution.sh` script to run the mobile agent on a sequence of tasks, utilizing the self-evolution capability. It loads task definitions from `data/custom_tasks_example.json`.

```bash
bash scripts/run_tasks_evolution.sh
```

--------------------------------

### Set ADB Execute Permissions (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/Mobile-Agent-qwen/README.md

Command for MAC or Linux systems to grant execute permissions to the ADB executable using sudo and chmod +x, which is necessary for running ADB commands.

```Bash
sudo chmod +x /path/to/adb
```

--------------------------------

### Configuring Claude Backbone and API Key (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Configures the agent to use Claude as the backbone model by setting the `BACKBONE_TYPE` to "Claude" and providing the corresponding `CLAUDE_API_KEY`.

```bash
export BACKBONE_TYPE="Claude"
export CLAUDE_API_KEY="your-claude-key"
```

--------------------------------

### Project Dependencies - Python

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/requirements.txt

This snippet lists the core Python packages and their pinned versions that the project relies on. Installing these dependencies ensures a consistent environment for running the application.

```Python
aiohappyeyeballs==2.4.6
aiohttp==3.11.12
aiosignal==1.3.2
async-timeout==5.0.1
attrs==25.1.0
certifi==2025.1.31
charset-normalizer==3.4.1
comtypes==1.4.10
dashscope==1.22.1
frozenlist==1.5.0
idna==3.10
MouseInfo==0.1.3
multidict==6.1.0
numpy==2.2.3
pillow==11.1.0
propcache==0.3.0
psutil==7.0.0
PyAutoGUI==0.9.54
PyGetWindow==0.0.9
PyMsgBox==1.0.9
pynput==1.7.7
pyperclip==1.9.0
pypiwin32==223
PyRect==0.2.0
PyScreeze==1.0.1
pytweening==1.2.0
pywin32==308
pywinauto==0.6.9
requests==2.32.3
six==1.17.0
typing_extensions==4.12.2
urllib3==2.3.0
websocket-client==1.8.0
yarl==1.18.3
openai
alibabacloud_tea_util
alibabacloud_ocr_api20210707
alibabacloud_tea_openapi
modelscope==1.15.0
```

--------------------------------

### Running a Standalone Task (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Executes the `run_task.sh` script to run the mobile agent on a single, standalone task. This is used for testing or performing individual operations.

```bash
bash scripts/run_task.sh
```

--------------------------------

### Set ADB Permissions on Linux/MAC

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Grants execute permissions to the ADB executable file located at '/path/to/adb' on Linux or macOS systems using the 'chmod +x' command with superuser privileges.

```bash
sudo chmod +x /path/to/adb
```

--------------------------------

### List Python Dependencies

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/requirements_win_v1.txt

This snippet lists the exact versions of Python packages required for the project. It is commonly found in a requirements.txt file and used to install dependencies using pip install -r requirements.txt.

```Python
absl-py==2.1.0
addict==2.4.0
aiohttp==3.9.5
aiosignal==1.3.1
aliyun-python-sdk-core==2.15.1
aliyun-python-sdk-kms==2.16.3
astunparse==1.6.3
async-timeout==4.0.3
attrs==23.2.0
cachetools==5.3.3
certifi==2024.6.2
cffi==1.16.0
charset-normalizer==3.3.2
clip
colorama==0.4.6
contourpy==1.2.1
crcmod==1.7
cryptography==42.0.8
cycler==0.12.1
dashscope==1.20.0
datasets==2.18.0
defusedxml==0.7.1
dill==0.3.8
einops==0.8.0
filelock==3.15.3
flatbuffers==1.12
fonttools==4.53.0
frozenlist==1.4.1
fsspec==2024.2.0
ftfy==6.2.0
gast==0.4.0
google-auth==2.30.0
google-auth-oauthlib==0.4.6
google-pasta==0.2.0
grpcio==1.64.1
h5py==3.11.0
huggingface-hub==0.23.4
idna==3.7
importlib_metadata==7.2.0
intel-openmp==2021.4.0
Jinja2==3.1.4
jmespath==0.10.0
keras==2.9.0
Keras-Preprocessing==1.1.2
kiwisolver==1.4.5
libclang==18.1.1
Markdown==3.6
markdown-it-py==3.0.0
MarkupSafe==2.1.5
matplotlib==3.9.0
mdurl==0.1.2
mkl==2021.4.0
ml-dtypes==0.3.2
modelscope==1.15.0
MouseInfo==0.1.3
mpmath==1.3.0
multidict==6.0.5
multiprocess==0.70.16
namex==0.0.8
networkx==3.3
numpy==1.24.3
oauthlib==3.2.2
opencv-python==4.10.0.84
opencv-python-headless==4.10.0.84
opt-einsum==3.3.0
optree==0.11.0
oss2==2.18.6
packaging==24.1
pandas==2.2.2
pillow==10.3.0
platformdirs==4.2.2
protobuf==3.19.6
pyarrow==16.1.0
pyarrow-hotfix==0.6
pyasn1==0.6.0
pyasn1_modules==0.4.0
PyAutoGUI==0.9.54
pyclipper==1.3.0.post5
pycocotools==2.0.8
pycparser==2.22
pycryptodome==3.20.0
PyGetWindow==0.0.9
Pygments==2.18.0
PyMsgBox==1.0.9
pynput==1.7.7
pyparsing==3.1.2
pyperclip==1.9.0
PyRect==0.2.0
PyScreeze==0.1.30
python-dateutil==2.9.0.post0
pytweening==1.2.0
pytz==2024.1
PyYAML==6.0.1
regex==2024.5.15
requests==2.32.3
requests-oauthlib==2.0.0
rich==13.7.1
rsa==4.9
rubicon-objc==0.4.9
safetensors==0.4.3
scipy==1.13.1
sentencepiece==0.2.0
shapely==2.0.4
simplejson==3.19.2
six==1.16.0
sortedcontainers==2.4.0
supervision==0.21.0
sympy==1.12.1
tbb==2021.13.1
tensorboard==2.9.1
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.9.0
tensorflow-estimator==2.9.0
tensorflow-io-gcs-filesystem==0.31.0
termcolor==2.4.0
tf-keras==2.15.0
tf-slim==1.1.0
timm==1.0.7
tokenizers==0.19.1
tomli==2.0.1
torch==2.3.1
torchvision==0.18.1
tqdm==4.66.4
transformers==4.41.2
typing_extensions==4.12.2
tzdata==2024.1
urllib3==2.2.2
wcwidth==0.2.13
websocket-client==1.8.0
Werkzeug==3.0.3
wrapt==1.16.0
```

--------------------------------

### Testing ADB Connection (Shell)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-v2/README.md

Tests if the Android Debug Bridge (ADB) is correctly installed and if a mobile device is connected and recognized. Replace `/path/to/adb` with the actual path to your adb executable.

```Shell
/path/to/adb devices
```

--------------------------------

### Configuring PC-Agent API Keys (JSON)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/README.md

Example JSON structure for the config.json file used to configure API keys and model names for PC-Agent. Users must replace the placeholder token with their actual API key.

```JSON
{
  "vl_model_name": "gpt-4o",
  "llm_model_name": "gpt-4o",
  "token": "sk-...",
  "url": "https://api.openai.com/v1"
}
```

--------------------------------

### Running PC-Agent on Windows (Shell)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/README.md

Command to execute the main PC-Agent script (run.py) on a Windows system. It includes an example instruction and specifies the platform using the --Mac 0 flag.

```Shell
python run.py --instruction="Open Chrome and search the PC-Agent paper." --Mac 0
```

--------------------------------

### Running PC-Agent on Mac (Shell)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/README.md

Command to execute the main PC-Agent script (run.py) on a Mac system. It includes an example instruction and specifies the platform using the --Mac 1 flag.

```Shell
python run.py --instruction="Open Chrome and search the PC-Agent paper." --Mac 1
```

--------------------------------

### Testing ADB Connection (Shell)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/README.md

This command is used to test if the Android Debug Bridge (ADB) is correctly installed and if a mobile device is connected and recognized by the system.

```Shell
/path/to/adb devices
```

--------------------------------

### Setting ADB Path Environment Variable (Bash)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/README.md

Sets the `ADB_PATH` environment variable to the location of the Android Debug Bridge executable. This is required for the agent to interact with Android devices.

```bash
export ADB_PATH="your/path/to/adb"
```

--------------------------------

### BibTeX Citation for Mobile-Agent

Source: https://github.com/x-plug/mobileagent/blob/main/README.md

BibTeX entry for citing the original Mobile-Agent paper, 'Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception'. Use this entry for citing the initial version of the project.

```BibTeX
@article{wang2024mobile,
  title={Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception},
  author={Wang, Junyang and Xu, Haiyang and Ye, Jiabo and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2401.16158},
  year={2024}
}
```

--------------------------------

### BibTeX Citation for Mobile-Agent-v2

Source: https://github.com/x-plug/mobileagent/blob/main/README.md

BibTeX entry for citing the Mobile-Agent-v2 paper, 'Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration'. Use this citation when referencing the v2 version.

```BibTeX
@article{wang2024mobile2,
  title={Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration},
  author={Wang, Junyang and Xu, Haiyang and Jia, Haitao and Zhang, Xi and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2406.01014},
  year={2024}
}
```

--------------------------------

### BibTeX Citation for PC-Agent

Source: https://github.com/x-plug/mobileagent/blob/main/README.md

BibTeX entry for citing the PC-Agent paper, 'PC-Agent: A Hierarchical Multi-Agent Collaboration Framework for Complex Task Automation on PC'. Use this entry in your LaTeX document's bibliography.

```BibTeX
@article{liu2025pc,
  title={PC-Agent: A Hierarchical Multi-Agent Collaboration Framework for Complex Task Automation on PC},
  author={Liu, Haowei and Zhang, Xi and Xu, Haiyang and Wanyan, Yuyang and Wang, Junyang and Yan, Ming and Zhang, Ji and Yuan, Chunfeng and Xu, Changsheng and Hu, Weiming and Huang, Fei},
  journal={arXiv preprint arXiv:2502.14282},
  year={2025}
}
```

--------------------------------

### BibTeX Citation for Mobile-Agent-E

Source: https://github.com/x-plug/mobileagent/blob/main/README.md

BibTeX entry for citing the Mobile-Agent-E paper, 'Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks'. Include this entry in your bibliography when referencing this work.

```BibTeX
@article{wang2025mobile,
  title={Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks},
  author={Wang, Zhenhailong and Xu, Haiyang and Wang, Junyang and Zhang, Xi and Yan, Ming and Zhang, Ji and Huang, Fei and Ji, Heng},
  journal={arXiv preprint arXiv:2501.11733},
  year={2025}
}
```

--------------------------------

### Running Mobile-Agent Script (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-v2/README.md

This command executes the main Mobile-Agent script (`run.py`) after the necessary configuration steps have been completed. It initiates the agent's operation based on the settings defined in the file.

```Python
python run.py
```

--------------------------------

### Run PC-Agent with Instruction

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/README_v1.md

Executes the PC-Agent script run.py with a specific instruction and GPT-4o API token. This command initiates the task automation process.

```Shell
python run.py --instruction="Create a new doc on Word, write a brief introduction of Alibaba, and save the document." --api_token='Your GPT-4o API token.'
```

--------------------------------

### BibTeX Citation for PC-Agent Paper

Source: https://github.com/x-plug/mobileagent/blob/main/README_zh.md

Provides the BibTeX entry for citing the PC-Agent paper titled "PC-Agent: A Hierarchical Multi-Agent Collaboration Framework for Complex Task Automation on PC". Includes authors, journal (arXiv preprint), and year.

```BibTeX
@article{liu2025pc,
  title={PC-Agent: A Hierarchical Multi-Agent Collaboration Framework for Complex Task Automation on PC},
  author={Liu, Haowei and Zhang, Xi and Xu, Haiyang and Wanyan, Yuyang and Wang, Junyang and Yan, Ming and Zhang, Ji and Yuan, Chunfeng and Xu, Changsheng and Hu, Weiming and Huang, Fei},
  journal={arXiv preprint arXiv:2502.14282},
  year={2025}
}
```

--------------------------------

### BibTeX Citation for Mobile-Agent-v2 Paper

Source: https://github.com/x-plug/mobileagent/blob/main/README_zh.md

Provides the BibTeX entry for citing the Mobile-Agent-v2 paper titled "Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration". Includes authors, journal (arXiv preprint), and year.

```BibTeX
@article{wang2024mobile2,
  title={Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration},
  author={Wang, Junyang and Xu, Haiyang and Jia, Haitao and Zhang, Xi and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2406.01014},
  year={2024}
}
```

--------------------------------

### BibTeX Citation for Mobile-Agent Paper

Source: https://github.com/x-plug/mobileagent/blob/main/README_zh.md

Provides the BibTeX entry for citing the original Mobile-Agent paper titled "Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception". Includes authors, journal (arXiv preprint), and year.

```BibTeX
@article{wang2024mobile,
  title={Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception},
  author={Wang, Junyang and Xu, Haiyang and Ye, Jiabo and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2401.16158},
  year={2024}
}
```

--------------------------------

### Listing Python Project Dependencies

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/requirements.txt

Specifies the required Python packages and their versions for the project. Includes deep learning frameworks like PyTorch and TensorFlow, computer vision libraries, and other utilities.

```Python
torch
torchvision
transformers
modelscope==1.15.0
TensorFlow==2.9.1
keras==2.9.0
opencv-python
git+https://github.com/openai/CLIP.git
matplotlib
pycocotools
timm
SentencePiece
tf_slim
tf_keras==2.15.0
pyclipper
shapely
supervision==0.21.0
```

--------------------------------

### Setting ADB Permissions (Shell)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-v2/README.md

Grants execute permissions to the ADB executable on macOS or Linux systems. This is necessary to run ADB commands. Replace `/path/to/adb` with the actual path to your adb executable.

```Shell
sudo chmod +x /path/to/adb
```

--------------------------------

### BibTeX Citation for Mobile-Agent-E Paper

Source: https://github.com/x-plug/mobileagent/blob/main/README_zh.md

Provides the BibTeX entry for citing the Mobile-Agent-E paper titled "Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks". Includes authors, journal (arXiv preprint), and year.

```BibTeX
@article{wang2025mobile,
  title={Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks},
  author={Wang, Zhenhailong and Xu, Haiyang and Wang, Junyang and Zhang, Xi and Yan, Ming and Zhang, Ji and Huang, Fei and Ji, Heng},
  journal={arXiv preprint arXiv:2501.11733},
  year={2025}
}
```

--------------------------------

### Citing Mobile-Agent Project (BibTeX)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-v2/README.md

This BibTeX entry provides the standard citation format for referencing the Mobile-Agent project in academic papers or other works. It includes details like authors, title, journal, and year.

```BibTeX
@article{wang2024mobile2,
  title={Mobile-Agent-v2: Mobile Device Operation Assistant with Effective Navigation via Multi-Agent Collaboration},
  author={Wang, Junyang and Xu, Haiyang and Jia, Haitao and Zhang, Xi and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2406.01014},
  year={2024}
}
```

--------------------------------

### Required Python Dependencies

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-v2/requirements.txt

Lists the Python packages and their specific versions needed for the project's execution. Includes deep learning frameworks, vision libraries, and utility packages.

```Python
torch
torchvision
transformers
modelscope==1.15.0
TensorFlow==2.9.1
keras==2.9.0
git+https://github.com/openai/CLIP.git
opencv-python
matplotlib
pycocotools
timm
SentencePiece
tf_slim
tf_keras==2.15.0
pyclipper
shapely
supervision==0.21.0
dashscope
numpy==1.26.4
```

--------------------------------

### Python Dependencies List

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent-E/requirements.txt

This snippet lists the Python packages required for the project, typically found in a requirements.txt file. It specifies the package names and sometimes exact versions.

```Python
torch
torchvision
transformers
opencv-python
timm
SentencePiece
pyclipper
pycocotools
yapf
sortedcontainers
supervision==0.21.0
simplejson
addict
termcolor
shapely
datasets
modelscope
matplotlib
dashscope
```

--------------------------------

### BibTeX Citation for Mobile-Agent

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/README.md

Use this BibTeX entry to cite the Mobile-Agent paper if you find the benchmark useful in your research or applications.

```BibTeX
@article{wang2024mobile,
  title={Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception},
  author={Wang, Junyang and Xu, Haiyang and Ye, Jiabo and Yan, Ming and Shen, Weizhou and Zhang, Ji and Huang, Fei and Sang, Jitao},
  journal={arXiv preprint arXiv:2401.16158},
  year={2024}
}
```

--------------------------------

### Specify zipp Dependency (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/requirements_win_v1.txt

Defines the required version for the 'zipp' package, a pathlib-compatible object for reading and writing zip files.

```Python
zipp == 3.19.2
```

--------------------------------

### Running Mobile-Agent with OpenAI API (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/README.md

This command runs the Mobile-Agent script using your own OpenAI API key. It requires specifying the path to the GroundingDION checkpoint, the ADB executable, your OpenAI API token, and the instruction for the agent.

```Shell
python run.py --grounding_ckpt /path/to/GroundingDION --adb_path /path/to/adb --api "your API_TOKEN" --instruction "your instruction"
```

--------------------------------

### Running Mobile-Agent with Provided API (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/README.md

This command executes the Mobile-Agent script using a provided API endpoint and token. It requires specifying the path to the ADB executable and the desired instruction for the agent.

```Shell
python run_api.py --adb_path /path/to/adb --url "The url you got" --token "The token you got" --instruction "your instruction"
```

--------------------------------

### Specify xhash Dependency (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/requirements_win_v1.txt

Defines the required version for the 'xhash' package.

```Python
xhash == 3.4.1
```

--------------------------------

### Specify yarl Dependency (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/requirements_win_v1.txt

Defines the required version for the 'yarl' package, Yet Another URL library.

```Python
yarl == 1.9.4
```

--------------------------------

### Setting ADB Permissions (Shell)

Source: https://github.com/x-plug/mobileagent/blob/main/Mobile-Agent/README.md

For MAC or Linux systems, this command grants execute permissions to the ADB executable, which is necessary for running ADB commands.

```Shell
sudo chmod +x /path/to/adb
```

--------------------------------

### Specify yapf Dependency (Python)

Source: https://github.com/x-plug/mobileagent/blob/main/PC-Agent/requirements_win_v1.txt

Defines the required version for the 'yapf' package, a Python code formatter.

```Python
yapf == 0.40.2
```
Tokens:
Raw