Cristóbal Valenzuela on How Runway's World Models Are Changing Storytelling

Runway's Valenzuela says AI video is a new medium

Runway is betting that AI video becomes a medium in its own right, not a faster camera inside existing film and advertising workflows. It builds world models for narrative video and real-time interaction, and sells the same models to robotics researchers as training data. Valenzuela argues compute, algorithms and captioned data have finally converged. Since audiences pay for stories rather than tools, he expects far more people to tell them and expects institutions to struggle to keep up.

Takeaways

• Runway builds world models with three uses. Valenzuela describes models that understand and interact with the world as humans do. Runway applies them to narrative video for film and advertising, to real-time experiences such as tutors and language learning, and to video that trains robots.
• Video models improve faster than people expect. Compute infrastructure, new algorithms and large well-captioned datasets converged over the past four or five years, and Gen-1 and Gen-2 were among the first widely used video systems. Motion, physics and long-form consistency remain the hardest research problems.
• Filmmakers treat video models as another tool. Valenzuela calls that a mistake and compares it to early photographers treating cameras as an extension of painting. Getting value means rethinking the entire work rather than making output 10 or 20 percent better.
• Cheap video generation does not devalue stories. Audiences pay for stories, not cameras or budgets, and multiplying content 10,000 times does not change its worth. He compares the flood of AI content to book publishing, when people worried about 4,000 books a year.
• Runway charges subscriptions and credits. If the product helps people make something they value, they pay. Valenzuela is surprised by how broadly it is used. His brother in media and advertising, an architect sister and a teacher sister now use Runway daily.
• AI needs many vantage points, not only technology. Valenzuela argues its impact will be massive, so it must be examined from perspectives beyond engineering, and he uses the analogy of weather apps designed around California sunshine. "Figure it out" is a mantra at Runway.

What Valenzuela expects next

• A solo Oscar winner built on Runway within a couple of years. Valenzuela says the real question is how institutions prepare, likening the resistance to Impressionism and the Salon of the Rejected.
• Agents will produce hyper-personalized n-of-one advertising, doing work now spread across people and companies. Von Tobel's hypothetical has Budweiser running 30,000 ads a month instead of two or three.