StreamMind

https://github.com/xinding-bot/streammind

Admin

StreamMind is a framework designed to unlock full frame rate streaming video dialogue through...

Tokens:620

Snippets:7

Trust Score:5

License:Apache-2.0

Update:2 months ago

Show doc for...

Tokens:

Raw

### Install StreamMind Dependencies

Source: https://github.com/xinding-bot/streammind/blob/main/README.md

Commands to clone the repository and install the required Python packages.

```bash
git clone https://github.com/xinding-sys/StreamMind
cd StreamMind
pip install -r requirements.txt
pip install flash-attn==2.5.8 --no-build-isolation
```

--------------------------------

### Run Training and Evaluation Commands

Source: https://github.com/xinding-bot/streammind/blob/main/README.md

Shell scripts to execute the two-stage training process and the evaluation pipeline.

```bash
# Streammind train stage 1
bash scripts/custom/finetune_stage1.sh
# Streammind train stage 2
bash scripts/custom/finetune_stage2.sh
# Streammind evaluate
bash scripts/custom/eval/evaluate.sh
```

--------------------------------

### View Training Data Structure

Source: https://github.com/xinding-bot/streammind/blob/main/README.md

Directory layout for online and offline datasets used by StreamMind.

```bash
StreamMind
├── Online_datasets
│   ├── ego4d
|   |   ├── v2 
|   |   |   ├── annotations 
|   |   |   ├── full_scale
│   ├── MatchTime
|   |   ├── SN-caption 
|   |   ├── Video
├── Offline_datasets
│   ├── videollava_pt
|   |   ├── llava_image/ 
|   |   ├── valley/      
|   |   └── valley_llavaimage.json 
│   ├── videollava_sft
|   |   ├── llava_image_tune/  
|   |   ├── videochatgpt_tune/ 
|   |   └── videochatgpt_llavaimage_tune.json
```

--------------------------------

### StreamMind BibTeX Citation

Source: https://github.com/xinding-bot/streammind/blob/main/README.md

BibTeX entry for citing the StreamMind research paper.

```bibtex
@article{ding2025streammind,
  title={StreamMind: Unlocking Full Frame Rate Streaming Video Dialogue through Event-Gated Cognition},
  author={Ding, Xin and Wu, Hao and Yang, Yifan and Jiang, Shiqi and Bai, Donglin and Chen, Zhibo and Cao, Ting},
  journal={arXiv preprint arXiv:2503.06220},
  year={2025}
}
```

Tokens:

Raw