Edoardo A. Dominici*,
Thomas Deixelberger*,
Konstantinos Vardis,
Markus Steinberger
* denotes equal contribution
git clone --recursive https://github.com/d3ixi/ControlDINO.git
cd ControlDINO
tested with:
- Python: 3.10
- Torch: 2.11.0+cu129
- Hardware: H200
conda create -n ControlDINO python=3.10 -y
conda activate ControlDINO
pip install torch torchvision --index-url https://download.pytorch.org/whl/cu129
pip install -r requirements.txt
Download CogVideoX-5B-I2V (Base Model)
python download.py
Download Control-DINO weights:
conda install -c conda-forge git-lfs
git lfs install
git lfs pull
./scripts/inference_recon.sh # reconstruction
./scripts/inference_style.sh # styling
./scripts/inference_vkitti.sh # vkitti
python app.py
- This code mainly builds upon CogVideoX-ControlNet
- This code uses the original CogVideoX model CogVideoX
- This project also leverages DINOv3
- We thank the authors for making their dataset publicly available:
@article{dominici2026controldinofeaturespaceconditioning,
title={Control-DINO: Feature Space Conditioning for Controllable Image-to-Video Diffusion},
author={Edoardo A. Dominici and Thomas Deixelberger and Konstantinos Vardis and Markus Steinberger},
year={2026},
eprint={2604.01761},
archivePrefix={arXiv},
url={https://arxiv.org/abs/2604.01761},
}

