| --- |
| license: apache-2.0 |
| --- |
| |
| <p align="center"> |
| <b><font size="6">Dispider</font></b> |
| <p> |
| |
| <div align="center"> |
| |
| [💻Github Repo](https://github.com/Mark12Ding/Dispider) |
|
|
| [📖Paper](https://arxiv.org/abs/2501.03218) |
|
|
| </div> |
|
|
|
|
| ## Quick Start |
| First download the checkpoints at the folder. |
|
|
|
|
| **Important**: Modify the ``mm_compressor`` path in config.json to align with your local environment. The checkpoint for ``mm_compressor`` is located within a sub-folder of this repository. |
|
|
| For detailed evaluation, please refer to [Github repo](https://github.com/Mark12Ding/Dispider). |
|
|
|
|
|
|
|
|
|
|
|
|
| ## ✒️ Citation |
| If you find our work helpful for your research, please consider giving a star ⭐ and citation 📝. |
| ```bibtex |
| @article{qian2025dispider, |
| title={Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction}, |
| author={Qian, Rui and Ding, Shuangrui and Dong, Xiaoyi and Zhang, Pan and Zang, Yuhang and Cao, Yuhang and Lin, Dahua and Wang, Jiaqi}, |
| journal={arXiv preprint arXiv:2501.03218}, |
| year={2025} |
| } |
| |
| @article{qian2025streaming, |
| title={Streaming long video understanding with large language models}, |
| author={Qian, Rui and Dong, Xiaoyi and Zhang, Pan and Zang, Yuhang and Ding, Shuangrui and Lin, Dahua and Wang, Jiaqi}, |
| journal={Advances in Neural Information Processing Systems}, |
| volume={37}, |
| pages={119336--119360}, |
| year={2025} |
| } |
| ``` |
