thoughts and ideas on recent ai image-generation tools. (after cinema?)
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
⠀
this is a collection of notes that i've written over time, mostly for myself. in the spirit of working with garage doors open, i've published them and open sourced this website. works under writing are original, my notes a mix of thoughts with quotes from the artwork subject of the note.
⠀
⠀
⠀
⠀⠀
⠀⠀
books
⠀⠀
articles
⠀⠀
film
⠀
philo
⠀⠀
⠀
⠀
symbols
⠀
⠀
⠀
⠀
⠀ ⠀
⠀ ⠀
writing keeps ideas in space
speech lets them travel in time
we use paintings to decorate space
and music to decorate time
⠀ ⠀
⠀ ⠀
find the way by moonlight
see the dawn before
the rest of the world
⠀ ⠀
⠀ ⠀
unconscious time, no peace of mind,
falling in space but still alive.
sketching the future in a single line,
everything's spinning, cannot sit down.
moments in space, places in time,
thoughts penciled in, now come to life.
⠀ ⠀
⠀ ⠀
As of today, no one knows how to translate paintings, flowers or music into language. Their beauty is implicit and exclusive to their form, which is why it's so hard to explain how a particular piece of art makes us feel.
⠀ ⠀
⠀ ⠀
⠀
⠀
⠀
⠀⠀
⠀⠀
⠀
text-to-image models are not creative but derivative. they use data from countless artworks, sometimes without the author's consent, to create new and original results.
the rise of photography in the 1850s is a good example.
until then, painters were judged by their ability to accurately represent reality. they felt threatened since anyone with a camera could now do their job.
⠀
⠀ ⠀
Usage of AI tools skyrocketed on launch and their impact is being felt in many fields, from financial accounting to psychologist's offices and creative studios. Image generation with AI has also evolved in a short time to a point of near-perfect photorealism and some artificial images have already gone viral worldwide.
⠀
AI models are not creative but derivative, meaning they use elements and styles of countless artworks and paintings, sometimes without their creator's consent, to create new and original results. This mechanism is particularly responsible for negative reactions and debates around copyright, misinformation and the ethical implications of artificial intelligence in the creative process.
⠀
Just recently on April 14, TikTok user Ghostwriter977 released "Heart on My Sleeve", a song that used AI to mimic the voices of singers Drake and The Weekend, without neither singer being involved in the process. Just 3 days later, their record label, Universal Music, condemned the use of AI to create the song, invoked copyright violation to take down the track, and asked streaming platforms to block AI companies from accessing their songs. The 2-minute-14-second song had already been listened to over 20 million times by then.
⠀
Not all reactions have been negative: the Japanese government became the first one to settle that they won't enforce copyright on artworks used for AI training and British singer Paul McCartney recently announced that the 'last Beatles song' will be completed using AI and released in 2023. The use and progress of these tools will only increase, soon disrupting all areas of artistic creation, from music and painting to photography and cinema. And while Record labels and Studios are currently hostile towards AI, I believe they'll embrace it as soon as they start to profit from it. (Maybe dead artists and actors will be revived to make new songs and movies with current artists, Bad Bunny+Freddie Mercury?)
⠀
⠀
But even if it seems we might be entering an new era of media creation that is hostile to artists, this is not the first time technology has disrupted art. The birth and rise of Photography in the 1850s enabled a mass reproduction of art which allowed paintings and sculptures to be seen my multitudes of people, while simultaneously degrading their individual influence and impact.
⠀
Artists who made a living making portraits of people or vedutas (hyper-realistic paintings of cities, often souvenirs for tourists) felt threatened since photography could capture reality instantly and with more accuracy than them. The jobs they had for centuries could now be done by anyone with a camera. Privacy and copyright concerns became a heated issue as well: if people can photograph others without their consent, who owns the photo? Photographer or photographed?
⠀
If photography is allowed to replace art in some of its functions, it will soon have supplanted or corrupted it completely, thanks to the natural alliance it will find in the stupidity of the multitude.
– Charles Baudelaire, Salon de 1859
⠀
Until then, painters and their art were usually judged by their ability to accurately represent reality. As photography became more adopted and accepted as a new form of art, it suddenly reduced these expectations. Artists were now free to explore and pursue their own interests, passions and ideas without needing to worry about visual accuracy. Modernists movements like Impressionism, Cubism, Surrealism and Abstract Art soon followed, and painting had its biggest revolution, both visually and philosophically.
⠀
⠀
Photography kept evolving and eventually allowed for the birth of an even more powerful art form to arrive, cinema. Although AI technologies are still in their infancy and limited to image generation, the arrival of text-to-video models is imminent and could challenge Cinema just like photography did to art. Current models already show an impressive understanding of cinematic language and it won't be long until anyone is able to create a photorealistic movie by simply writing a script and describing the rest of the movie using natural language. Users will be able to specify cameras, lenses and framings and AI models will create photorealistic sets, props, actors and dialogue that match the user's intentions.
⠀
Without the need for physical locations, crews or large budgets, the cost of making movies will be significantly reduced, allowing for a democratization of the Hollywood Film Studio that will open the door for new voices previously limited by the cost of filmmaking.
⠀
Images from these movies might not be human but knowledge behind them certainly will be. Human creativity will then ultimately determine how meaningful AI-aided cinema is: ideas and stories explored will need to be powerful to allow them to travel through minds and eventually become culture.
⠀
⠀
As of today, no one knows how to translate paintings, flowers or music into language. Their beauty is implicit and exclusive to their form, which is why it's so hard to explain how a particular piece of art makes us feel.
⠀
Traditional Cinema will always exist, but as progress in AI image and video generation continues, I believe a new epoch of cinema will emerge where anyone will be able to make a movie using natural language. For the first time, film and text will become the same thing: anyone will be able to read, write or watch a movie and every frame will be generated, not filmed.
⠀
This new Synthetic Cinema will allow movies to detach from the camera, empowering filmmakers to break free from the limits of traditional cinema and pioneer new visual styles, just like impressionists did when they created a new visual style by removing physical influence from painting a century ago.
These movies won't be better or worse, they'll just be different.