Kortfilm med AI: Dear Elf on The Shelf

Er det mulig å lage en kortfilm KUN ved hjelp av tilgjengelige AI-verktøy?

Det korte svaret er ja. Det litt lengre svaret er at det fortsatt er masse begrensninger. Men gjennom prosjektet har jeg lært mye om hva som er mulig akkurat nå – og hva som fortsatt er vanskelig å få til.

Stor takk til Audun Kvitland Røstad som tok utfordringen på strak hånd. Han har generert både musikk og lydeffekter kun via tilgjengelige AI-verktøy.

En liten advarsel: Filmen inneholder scener med grafisk innhold som kan virke forstyrrende for noen.

Spill av Dear Elf on the Shelf (Vimeo)

Beskrivelse av prosessen (på engelsk)

AI played a pivotal role in the creative process of our project, serving as both a muse and a toolset. We leveraged ChatGPT to flesh out the storyline and craft detailed prompts for Midjourney 6 alpha, which was instrumental in generating all the imagery for the film.

The incorporation of AI didn’t stop there; voiceovers were synthesized using cutting-edge technologies from Play.HT, Eleven Labs, and Runway, bringing characters to life with a diverse range of emotional tones and accents.

To animate the still images, we turned to Runway and Pika, whose algorithms added subtle movements that infused each scene with a sense of realism. Magnific was utilized for upscaling specific images to enhance details that were crucial for storytelling, while the overall film was upscaled using Topaz Video AI, ensuring high-resolution output across all scenes.

The musical score, an essential component of the film's emotional landscape, was composed with AIVA, an AI-driven platform that allowed for the creation of a unique soundtrack tailored to the film's atmosphere. Sound effects, another layer of immersion, were generated using MyEdit, providing a rich auditory experience that complemented the visuals.Finally, all elements were seamlessly integrated and polished in After Effects.

This multi-faceted use of AI across different stages of production not only streamlined the workflow but also opened up new avenues for creativity, allowing us to explore novel storytelling techniques and visual aesthetics that would have been challenging to achieve otherwise.