AI video made for the 2024 AIFF @RunwayML Competition.
Movie made by Mauricio Tonon & Luigi Tedesco @awtriphop

This trailer was made with the intent of pushing the AI capabilities for video generation and stylization working with crazy camera angles and movements and difficult character movement and action scenes. The video was made using a vast number of techniques and software:
– Midjourney for style and character generation, more than 400 images created.
– CivitAI for SD model training with 265 images and descriptions, resulting in 2 Lora models.
– Runway for Titles animation and some scenes animations using gen2 img-to-vid.
– Runway green screen and AI editing features.
– ComfyUI and AnimateDiff using the pre-trained model for stylisation, doing various passes in short scenes for the main video at the end All the movements in the video also come from various sources, all with royalty-free rights. It is a mix of Pexels videos from artists like Cotton Bro Studio and others, Envato Elements videos, 3D animations generated on Cinema 4D for movement and camera control, and some footage from ourselves.

It was an incredible challenge to keep consistency and stylization, but I like the results, and I hope you enjoy them as well.