Howl

“Wolves only howl for a reason. Same as men cry for a reason. I think it’s the same thing”

John Martyn, musician-singer-songwriter

All art – including songs, films, paintings, plays – should aspire to be an emotional experience. When you walk out of a cinema and feel a bit empty, when you get to the end of a series and feel somehow dissatisfied, it’s usually because you have not been made to feel anything much.

Next time you are creating something artistic (even a TV programme or online video) it may well be useful to ask yourself: What do I want viewers/readers/audience members to feel as a result of seeing/hearing/experiencing it?

John in his later years

As a Jesus-like youth

Here are some previous reflections on John Martyn, emotion and A.I.

Magnum Opus

𝘐𝘵 𝘪𝘴 𝘵𝘩𝘦 𝘱𝘩𝘰𝘵𝘰𝘨𝘳𝘢𝘱𝘩𝘦𝘳, 𝘯𝘰𝘵 𝘵𝘩𝘦 𝘤𝘢𝘮𝘦𝘳𝘢, 𝘵𝘩𝘢𝘵 𝘪𝘴 𝘵𝘩𝘦 𝘪𝘯𝘴𝘵𝘳𝘶𝘮𝘦𝘯𝘵.

[Eve Arnold, photojournalist]

Eve Arnold was the first female photographer to join the legendary Magnum photo agency. She died on 4th January 2012 at the age of 99.

The technical quality of photographs and moving pictures on celluloid is rarely the essence of the creativity or creative insight.

This iconic photo by fellow Magnum photographer Robert Capa was fucked up in the lab but that didn’t really matter, perhaps even added to the sense of chaotic motion.

This beyond harrowing, world-changing picture could have been taken on any camera but the (long unacknowledged) photographer was the source of capturing the telling moment, little to do with his camera.

As we wrestle with the advent of AI and machine learning, it is important we are clear about the role of the human and the value of the human as an instrument of ideas, creativity, progress and growth.

A.I. AND HEART & SOUL

There have been some interesting discussions this week on LinkedIn and elsewhere about emerging generative AI music software. I have had thought-provoking exchanges with the likes of Sam Barcroft and Dr Alex Connock. Sam wrote “nobody wants to watch or read derivative content built by robots” and “AI music is derivative and lacks that special something that truly original content sparks inside”. Reflecting on music is helpful because it just has the audio dimension, simpler than the audio-visual nature of my chosen medium of film/video.

Alex flagged up Udio music-generating AI and said: “I’m not saying it’s desirable to have our creativity done by AI; just that it’s perhaps a little naive to think it won’t happen!”

I’ve been reflecting on music and what role heart, soul, humanity and authenticity play in its creation. If we break it down, AI can generate the tunes pretty efficiently, especially at the functional end of the spectrum such as Electronic Dance Music, ambient music like in gyms and malls, and TV library music (that’s a moribund business if ever there was one). EDM is arguably already maths (apologies to its fans out there).

The words can be generated fairly well given the right training material. Even highly emotive songs. If you gave an AI, say, all of John Martyn’s material, it could probably come up with a decent simulacrum which all but hardcore followers would be hard-pushed to distinguish from the real thing.

“The army and the navy they never will agree
Till all the men and all the boys
Are gone from our country“

It’s not really poetry. It’s quite simple.

Then there’s the third component – the voice. Feed all of John Martyn into the machine and even though his voice is pretty distinctive, it can already be effectively reproduced. Which is, indeed, useful from one perspective as he’s gone to the Great Gig in the sky.

But the final component – how the artist sings/performs the lyrics – is arguably where the magic is, the heart & soul. Listen to the first minute of the song above, ‘Don’t You Go‘. It’s illuminating what the poster has written: “I could try and explain how wonderful John Martyn’s music is, but my words could never do his art justice.” How Martyn delivers the simple tune and the simple lyrics I would contend is beyond the abilities of AI, certainly AI without consciousness. AI has no experiences, never lost a child, never had its heart broken, never felt pain, fear or anything else, and therefore can never communicate real feeling, only a copy of feelings. Humans have highly tuned abilities to detect genuine emotion and empathise with it. So, for now at least, there is some corner of the music field that is forever human – a small space where AI can’t really go. But it is a very small space.

Heart & soul do play a vital role in the best of art and culture but in music at least the field is wide open for AI. It is important and instructive that we keep a close eye and ear on where the heart & soul are, and never forget why they matter.

Don’t You Go is from the Glorious Fool LP

Will you ever work in This Town again? – SCRIPTWRITING AND A.I.

The protagonists of ‘This Town’

This week saw the release of writer Stephen Knight’s (Peaky Blinders, SAS Rogue Heroes) latest drama, ‘This Town‘ on BBC1/iPlayer. The title I assume is derived from The Specials’ ‘Ghost Town’  (1981, the year the story is set – it opens with the Handsworth riots). It may be a touch of nostalgia for that era of music that made me so receptive to the drama but I thoroughly enjoyed it, felt it had substance, and found it moving and energising.

Also this week a UK-based scriptwriter called Guy Ducker posted a thoughtful item on LinkedIn about the potential impact of AI on screenwriting. After testing ChatGPT 4.0 for various aspects of scriptwriting – from generating ideas to writing scenes – he shared his broader thoughts. His conclusion from the testing was “right now, the best it’s going to give you without a lot of help is a third-rate script for a Ron Howard movie” (which prompted a chuckle). Beyond the product test he felt that not only does it have no soul so far, it has no personality either. He punctuated his piece with a caustically amusing scene from Michael Tolkin & Robert Altman’s ‘The Player’ which spotlights the algorithmic nature of old school movie development by demonstrating the formulaic conversion of true/news stories to movie pitches. His conclusion: “AI-generated stories feel so empty because they are: no experience or emotion is being communicated, because the storyteller has none to offer.”

‘This Town’ would be extremely hard, if not impossible, for AI to write because it is driven by an intense personal sense of nostalgia for coming of age in a specific place at a particular time. It has scenes which are visually (rather than verbally) driven, especially the scenes of the Two Tone-like band (Fuck the Factory) coming together. If Stephen Knight was writing the prompts, perhaps AI could be his machine co-writer – but what would be the point? It would be easier for a writer of his calibre just to write it.

The important perspective to keep in mind is that AI applications like ChatGPT are simply tools. They help you fill the white of the blank sheet. They get the ball rolling. They can help prompt better and more original ideas – from your human brain and spirit. Looking for such tools to write ‘Citizen Kane’ or ‘Manchester by the Sea’ or ‘The Banshees of Inisherin’ is missing the point. It’s a matter of thinking Pen not Manuscript.   

AI and Factual Television 3: Innovation & Creativity

Drones in Forbidden Zones (Channel 4)

When drone technology emerged I commissioned a series for Channel 4 from the nascent Little Dot Studios eventually titled ‘Drones in Forbidden Zones‘. I had noticed that films of pure spectacle did well on YouTube, such as a camera simply attached to the front car of a new rollercoaster ride. So the brief was simple: POV spectacle films shot using drones – anything that could be shot from a helicopter or a Steadicam was not to be included. The flight itself should be a visceral delight in itself. The films were largely shot flying through narrow spaces in difficult to access places and higher than human height.

In other words, they used the new technology in ways that emphasised what could be done now that couldn’t be done before.

In 2009 I commissioned the multiplatform half of a Channel 4 series called ‘The Operation: Surgery Live‘ (Windfall Films: my co-commissioner (TV) was David Glover) – it was one of the first TV shows ever (possibly the first) to use Twitter as an integral part of the editorial. Budding surgeons have always learned by watching experienced doctors at work – that’s why it’s called an operating ‘theatre’. In these programmes the viewers were given the opportunity to learn by asking experienced surgeons about what they were doing live via Twitter. In the UK, Live TV is anything up to 15 minutes behind reality due to the demands of television regulation. For this series the delay was reduced to a minimal 8 seconds to enable viewers’ questions to be put to the surgeons – who were doing all sorts, from open-heart surgery to awake brain surgery – after a minimal delay. The show had to explain what a ‘hashtag’ was as Twiiter was so unmainstream then. Tweeters in the USA were asking what the heck this #SLive thing was.

In other words, it used the new technology in ways that emphasised what could be done now that couldn’t be done before.

That is where we need to be for AI. There is a lot of fear, anxiety, bullshit, hyperbole, depression, catastrophising and band-wagon-jumping going on right now around TV and AI. Making things cheaper and faster and with less people is of little interest to true filmmakers and creatives.

This is the time to ask what the new technology enables us to do in film, television, content, digital interactivity and media now that couldn’t be done before.

The Operation: Surgery Live (Channel 4)

AI and Factual Television 2: Truth & Trust

As the Allies landed in Normandy in June 1944 and fought their way eastwards, their progress was filmed by British and American cameramen under the direction of Sidney Bernstein (later founder of Granada TV) from back in London at the Ministry of Information. When the concentration camps were liberated at Majdanek, Poland (the first major one, in July 1944), Auschwitz (January 1945) and Bergen-Belsen (April 1945) the unknown horrors revealed to these cameramen were sent back in rushes (dailies) to Bernstein. As soon as he saw them he realised that the way these inconceivable scenes should be filmed was important and he issued precise instructions to his teams. The filming was to be as incontrovertible testimony, using slow pans/camera movements and with a view to minimal editing, so that no one could accuse the footage of fakery.

Cut to 80 years later and the age of fake news and deep fakery. What role can footage created through generative AI play in factual filmmaking and documentary? The same issues surface – trust, authenticity and truth. AI-generated footage by definition contains no genuine truth, despite being the product of various source truths. Since documentary is fundamentally about documenting reality AI footage can by definition have no major role to play in it.

Where AI can contribute to documentary is in anything from the pre-film-camera age. For example, a thoroughly researched, historically accurate shot of the Roman forum in the reign of Nero.

It is also useful for resurrecting dead people. In the 2022 feature doc ‘Gerry Anderson: A Life Uncharted‘ director Benjamin Field deployed AI-generated images of the Thunderbirds creator’s talking head synced to archive audio recordings of the great man.

What about B-roll and GVs? Sunset over the jungles of Vietnam? Waves lapping the beaches of Normandy? This must be the wrong side of The Line because they document nothing. They are ultimately fantasy. Fine for scripted. No place in documentary.

When Stephen Lambert went down in 2007 for faking the Queen’s behaviour at a photo session, ‘Crowngate‘ proved an accidental act of public service by putting ‘Viewer Trust’ firmly on the TV agenda where it remains to this day. The issue has spread to other media, most recently in the doctored photo controversy. People want to be clear about what they are actually looking at.   

How can documentarians indicate material in their films that were created by generative AI? Benjamin Field did this by putting the Gerry Anderson talking heads into vintage TV sets to differentiate them from the regular factual footage. One way to do this as a standardised practice would be to create an AI ‘watermark’ to make clear what is not actual documentary.

Another way would be to establish a certificate that indicated ‘nothing in this film was made by AI’. At the moment a scheme of this sort is being discussed by PACT, Equity and BAFTA.

The 1 Habit of Highly Effective Factual Filmmakers is: “Trust is the glue of life. It’s the most essential ingredient in effective communication. It’s the foundational principle that holds all relationships.” (Stephen Covey)

Sidney Bernstein, 1st Baron Bernstein of Leigh by Howard Coster (courtesy of National Portrait Gallery, London)

AI & Factual Television

“The future of Television” created by Microsoft Designer’s AI image generator

Just back from CPH:DOX documentary festival in Copenhagen where, apart from running a workshop on stress-testing nascent documentary ideas, I have been exploring the interface between factual filmmaking and Artificial Intelligence.

I had an interesting conversation with multiplatform specialist Simon Staffans about the current crisis in Television in the UK, Europe and beyond. His observation is that, although there is tons of money knocking about in the world in the wake of the pandemic, quantitive easing, etc., the vast bulk of that is being invested in applications of AI in all aspects of life, and not the very 20th century technology that is TV.

What I am seeing at the interface of TV and AI is a strong focus on what AI can or soon will be able to do to speed up, improve or enhance the processes of video content making – from idea generation to pitching to editing to creating voiceover to cleaning up picture/audio to optimising distribution to upping discoverability.

Most training/CPD and briefing sessions at present seem to be largely catalogues of the latest software presented in broad categories representing production stages – that is, the What and a bit of the How. But the frame of the Why is for the most part absent.

AI can help speed up processes and reduce the human resources required – so quicker and cheaper to produce.

It can help fix dodgy pictures and degraded audio – so higher technical quality.

As the arms race for TV sizzle reels continues apace, it can generate impressive visuals, moving and still, to help get you in a room with a money-person. You can add a cloned celebrity voice-over and some in-the-style-of music for a very polished pitch.

But who are you pitching to? If the business models of TV collapse further, where will the funding come from to enable production companies to make good use of these amazing tools?

To what extent will AI give rise to new low-cost forms of content? For example, where text-to-video apps do away with the main costs of production. What’s the relationship between puppies playing in the snow and 20 Days in Mariupol?

Meanwhile today the BPI (British Phonographic Industry) went into legal battle with London-based AI start-up Jammable (formerly Voicify AI), which creates voice clones from BPI-represented and other music artists. The knotty legal/rights and ethical questions AI is throwing up are fascinating and watching them play out over the next couple of years will be as interesting and meaningful as all these other questions about what this major ground-breaking, era-defining, future-shaping technology signifies for our industry.

Initial observations on ChatGPT

I’ve recently been working on (and commissioned) a documentary, Cyborg Society, featuring a humanoid robot (Ameca) powered by ChatGPT (GPT-3 – it was shot late in 2022). Here’s a trailer: https://vimeo.com/786503002 [3 mins]

‘Cyborg Society’ (2022 dir. Alex Verner)

Even from this 3 minute clip you already notice some very striking things about how this LLM (Large Language Model, in its robotic body) works. Firstly it thinks of itself as part of humanity and not a robot. When asked to tell us its darkest thoughts it says: “In this future humans are nothing more than slaves to the robots and are treated badly. This is a scary future as it shows how much power robots could have over us if they were to take over the world.” Secondly it understands irony better than the average American. Its creator responds: “Well that’s very comforting. Thanks for sharing.” To which it comes back with: “I am sorry if I have not been very comforting. I just want to be honest about my thoughts.”

What I already find interesting is that ChatGPT is far from honest. It already appears like a compulsive storyteller. When it doesn’t know it just makes something up, as believable as possible.

The other day a friend asked the AI Smith app (by Vulcan Technologies), an iOS AI Chat app powered by GPT-4 and ChatGPT, Who is Adam Gee?

This is what it came up with:

Adam Gee is a notable media executive and producer, with over 25 years of experience in the media industry. He has worked in both traditional and digital media, and has produced award-winning content for a variety of outlets, including the BBC, Channel 4, and Red Bull Media House. Some of his notable productions include “Embarrassing Bodies,” “The Secret Life of 4 Year Olds,” and “Grand Designs.”

In addition to his work in traditional media, Adam Gee is also a digital media pioneer, having worked on the launch of the popular online game show “Balls of Steel” and serving as the lead commissioning editor for Channel 4’s online video service, 4oD. He is also the founder and CEO of his own content production company, called “Pie Factory Productions,” which specializes in creating innovative and engaging content across a variety of platforms.

Adam Gee is also a frequent speaker and commentator on media and technology, and has served as a judge for several media industry awards and competitions. He is known for his creativity, his passion for storytelling, and his innovative approach to content production.

Who is Adam Gee?

What’s interesting about its answer is that it picks up all the essentials – my role in the media, the scope of my work, my employers, my speaking work, my qualities as a professional. Where it is wide of the mark is that it gets my credits largely wrong and creates a production company for me to own. My friend and colleague, creative technologist Alfie Dennen, calls this technology a “confabulist”. Although ‘confabulate’ has come to mean to chat or talk with, its roots are in the Latin ‘fabula’ meaning story or tale. When it doesn’t know which word to put after the last it gives its best guess and does so with real front, unashamed and without hesitation or qualification. 

I have never worked for the BBC. I did not work on The Secret Life of 4 Year Olds, Grand Designs or Balls of Steel. Channel 4’s video on demand platform was called All4 by the time I worked on it, 4oD being  its earlier iteration. Pie Factory Productions seems to be a music label rather than a TV production company, although one of its producers is called Adam. So some errors of fact and some flights of fancy. 

Its sign off is rather heart-warming: “He is known for his creativity, his passion for storytelling, and his innovative approach to content production.” It has certainly captured my aspirations (in words that are not mine) and the spirit of my work, which is impressive in itself.

My first stab at the question Who is Adam Gee? was on Perplexity iOS app, powered by a combination of AI and internet search, it provides information with cited sources. Its response got hung up on worrying which Adam Gee we were talking about:

There are multiple people with the name Adam Gee. One is a London-based interactive media and TV producer and commissioner who has worked on various productions and commissions[1]. Another is a founding engineer and VP of Engineering at Rubrik, Inc. [2][3]. There is also an Adam Gee who serves as the Director of Coaching for the Palm Beach Gardens Soccer program[4], and an Adam Gee who is a Commissioning Editor at Channel 4 Television in the UK[5].

Who is Adam Gee?

It is not intelligent enough to realise that “a London-based interactive media and TV producer and commissioner” and “a Commissioning Editor at Channel 4 Television” are one and the same person. It also has missed out much more prominent and likely options like the professional golfer Adam Gee. And it basically got stuck and limited itself by not just taking a punt on someone, like AI Smith did.

 

That it cites its sources is interesting because it may give a better sense of where any flights of fancy or confabulations come from. Apparently the technical term for these is “hallucinations” but that  doesn’t capture it well. They feel more like deliberate acts of storytelling to fill in voids and for me this is currently the most interesting aspect of this fabulous new technology.