Move a mouse, create a video: New technology from the Technion
Technion-Israel Institute of TechnologyReports and Proceedings
Researchers at the Technion – Israel Institute of Technology have developed a new technology called Time to Move (TTM) that enables users to create realistic AI-generated videos simply by controlling motion with mouse movements. The method provides precise control over how objects and characters move over time, addressing one of the major challenges in AI video generation.
Unlike existing approaches, TTM does not require retraining video models or access to extensive computational resources, making advanced video creation more accessible to a wider range of users. The technology can be integrated into existing video-generation systems as a plug-in and operates without additional computational cost.
Developed by Dr. Or Litany, Prof. Ron Kimmel, and students Asaf Singer, Noam Rotstein, and Amir Mann from the Technion’s Henry and Marilyn Taub Faculty of Computer Science, the work was presented at the International Conference on Learning Representations (ICLR) 2026. The key innovation, known as dual-clock denoising, balances adherence to user instructions with natural-looking motion. Experimental results show that TTM matches or outperforms training-based methods in motion accuracy and realism while offering additional capabilities, including object appearance editing and the addition of new objects to a scene.
The research represents a significant step toward intuitive, controllable, and widely accessible tools for AI-powered video generation.