Skip to content

About

Official implementation of Control-DINO: Feature Space Conditioning for Controllable Image-to-Video Diffusion

Resources

Stars

8 stars

Watchers

1 watching

Forks

Repository files navigation

Control-DINO: Feature Space Conditioning for Controllable Image-to-Video Diffusion

ECCV 2026

Project Website Static Badge

Edoardo A. Dominici*, Thomas Deixelberger*, Konstantinos Vardis, Markus Steinberger
* denotes equal contribution

Teaser

📦 Setup

1. Clone ControlDINO

git clone --recursive https://github.com/d3ixi/ControlDINO.git
cd ControlDINO

2. Setup environments

tested with:

  • Python: 3.10
  • Torch: 2.11.0+cu129
  • Hardware: H200
conda create -n ControlDINO python=3.10 -y
conda activate ControlDINO
pip install torch torchvision --index-url https://download.pytorch.org/whl/cu129
pip install -r requirements.txt

3. Downloading Pretrained Models

Download CogVideoX-5B-I2V (Base Model)

python download.py 

Download Control-DINO weights:

conda install -c conda-forge git-lfs
git lfs install
git lfs pull

🚀 Demo Inference

./scripts/inference_recon.sh    # reconstruction 
./scripts/inference_style.sh    # styling
./scripts/inference_vkitti.sh   # vkitti

⭐ Gradio App

python app.py

🙏 Acknowledgements

📖 Citation

@article{dominici2026controldinofeaturespaceconditioning,
      title={Control-DINO: Feature Space Conditioning for Controllable Image-to-Video Diffusion}, 
      author={Edoardo A. Dominici and Thomas Deixelberger and Konstantinos Vardis and Markus Steinberger},
      year={2026},
      eprint={2604.01761},
      archivePrefix={arXiv},
      url={https://arxiv.org/abs/2604.01761}, 
}

About

Official implementation of Control-DINO: Feature Space Conditioning for Controllable Image-to-Video Diffusion

Resources

Stars

8 stars

Watchers

1 watching

Forks

Used by

Contributors

Languages