ByteDance has introduced a cutting-edge artificial intelligence system called "X-Portrait 2" that can transform any photograph into a lifelike video performance, adding subtle expressions and emotions that make the result nearly indistinguishable from real footage. The Chinese tech giant, best known for TikTok, designed this system to recreate scenes from well-known films using still images, producing results so realistic they...

Video generation requires modeling a vast spatiotemporal space, which demands significant computational resources and data usage. To reduce the complexity, the prevailing approaches employ a cascaded architecture to avoid direct training with full resolution. Despite reducing computational demands, the separate optimization of each sub-stage hinders knowledge sharing and sacrifices flexibility. This work introduces a unified pyramidal flow matching algorithm. It...