Text-to short video generation

Supervisor:
Dr. Szemenyei Márton
Subject:
Project Laboratory 1 - Control systems study specialization, MSc Elec.
Project Laboratory 2 - Control systems study specialization, MSc Elec.
Project Laboratory 1 - Visual informatics study specialization, MSc IT.
Project Laboratory 2 - Visual informatics study specialization, MSc IT.
Project Laboratory 1 - Intelligent embedded mechatronical systems, MSc Mecha.
Project Laboratory 1 - Control and vision systems, MSc Elec.
Project Laboratory 1 - Visual informatics, MSc IT.
Project Laboratory 2 - Control and vision systems, MSc Elec.
Project Laboratory 2 - Visual informatics, MSc IT.
Students count:
1
Continue:
Szakdolgozat / Diplomaterv
PhD
TDK dolgozat
Description:
While many text-to-image methods exist, generating consistent videos from text prompts is an open challenge. Several methods in other fields, such as "Track Everything everywhere all at once" utilize 3D representations to enforce consistency thoughout tracking. It would be interesting to see, if it is possible to use text prompts to generate 3D scenes and animations (temporal deformations) in a similar fashion.