The Game Has Changed: A Film Junk Exposé on Performance-Capture Technology Starting with Tron: Legacy
“I’ve worked real hard to get this part and no freakin’ code is going to screw me over!”
On a promotional tour for Tron:Legacy, Jeff Bridges made an intriguing comment. He said the day might come when he could appear in movies without actually acting. “I could still make films,” he told The Daily Mail. “I can say, ‘I’ll lease you my image’”. He was too polite to add that if you lease my image, it will cost x. If you hire me to do the acting as well, it will cost more than x. This is going to be huge.
In Tron:Legacy, the film’s lead, Sam Flynn is drawn into the digital world of Tron and not only finds his father but a younger version of his father. Jeff Bridges plays both father parts. (Hint: No make-up is used in the creation of the younger Bridges). Eric Barba, visual effects supervisor describes how:
Step 1: Bridges current 60-year-old face was scanned and a 3D digital head with 52 facial “emotional” points created.
Step 2: The old face was then youthanized so-to-speak about 26 years, using as reference, Bridges in Against All Odds.
Step 3: Acting as the younger Kevin Flynn in Tron:Legacy, Bridges wore a motion capture head camera that tracked the “emotional” dots on his face.
Step 4: These facial expressions were then mapped onto the younger Bridges image. He thereby became the first 60-year-old actor to play himself using his own 34 year-old face.
How good does it look? Really good.
Bridge’s remark about leasing his image opens up three possibilities – two are already in the movies, one is opening soon. Clearly, he can be hired in the flesh, so-to-speak, and using performance-capture, play himself at any age. (Hint: Think Clint Eastwood doing the same for another Dirty Harry flick). Bridges could also lease his image (the price for that will make an interesting negotiation) and “body doubles” could do the performance-capture. Or Bridges could be hired to export his acting skills to a new “digital actor” – a “fresh face” digitally realized for the role to the director’s specs. Let’s call this new performer a digitor.
Now fast-forward a few years for some perspective.
It’s Academy Awards night. The winner of Best Actor in a Supporting Role does not bound on stage when her name is announced. Instead a video flashes onto the Kodak Theatre’s giant screen. She says thanks and announces she is coming out of the digital closet. Although her contract has an industrial strength non-disclosure agreement about her virtualness, she felt her fans needed to know the truth. She’s virtual – a digitor – custom coded for her winning role. Her biggest regret is that being non-corporeal, she can’t accept Oscar in person – or even hold him. Ever. As the video ends, she thanks her creator – her lead software engineer – for providing the code that made it all possible.
Consider the future
As directors eagerly anticipate the compliancy of a digital leading man or woman, one can’t help but think it won’t work the way it’s intended. How will human actors play against digitors? Will chemistry be only something in old movies? And what about the first mixed cast film? Will there be a level playing field as these new “synthetics” strive for acceptance or will the humans close ranks?
Here’s a glimpse of how this new silicon will blindside the suits and directors. They thought they were getting better “talent” management tools like drop down menus and force quits. Guess what? Software can do divas too. If it makes money at the box office, it will be coded.
Here are some typical conversations from the future:
A producer pitches the studio and gets some push-back:
“You want to have Tom’s love interest played by Samantha V1.2?* She’s all CGI! And I heard her new emo algorithm is still in Beta. Tom will have my ass if she doesn’t make him feel like he’s numero uno in the scene. And that’s just in front of the cameras. What about playful banter with Tom and the crew? How is that possible? Before we go any further, we need full disclosure on her specs.”
*In the future, digital actors will not have last names. They will have version numbers. But it won’t take your average agent long to figure out that a digitor can go to court and legally win a human last name. With the stigma of the version number gone, they’ll pass for human at least on the screen.
Here’s two human actors over their triple lattes:
“I’m auditioning for Obi Wan Kenobi as a pre-teen in The Roots of Jediism – Part 3. But I’m up against a digitor called Ken V3. His source code won a technical award last year. Variety said he has 5 programmers! And if he runs into trouble with George’s dialog (like that’s not going to happen), then they can adjust the code on the spot and WiFi it to him before George yells cut. How can I compete?”
It will be a different world for ingénues:
“When they get the lighting working on me, it’s so good, it’s sick. The high cheekbones, my big eyes, the cute nose. But when I play the scene with Melanie, if she doesn’t come off in the rushes, they just parallel process her Physiognomy sub-program with the new Prada Deep-tissue utility and nobody sees me anymore. I worked really hard to get here and no freakin’ piece of code is gonna screw me over.”
You may think the digital impact will be at the actor level only. You would be wrong.
Here’s a high level suit at CAA negotiating with a RISC-based digitor:
“You know I’m on your side. Some of my best friends are digitors. I’m talking first name basis. But the studio’s going to say to me, your graphics processor hasn’t been upgraded
in 6 months. And you know, if you can’t afford to upgrade every three months in this business, you won’t get your calls returned.”
“Speaking of calls, I heard you digitors can get mobile direct into your…um…personal space. That’s a little weird, isn’t it?”
Of course, the traditional audition rules will adjust to accommodate these new artists.
Here’s a famous director auditioning aspiring digitor:
“Hey Ed. Thanks for coming. You’re a digitor right? I know legally I’m not supposed to ask that but then you know I make my movies the way I want to. And the woman beside you. She’s your software director?”
“Sure. Sure. That’s OK to ask James – may I call you Jim? Your film was so instrumental in legitimizing us in the beginning, I feel like I’m coming home. And yes, she’s my software director. She’s also been coded as my mom if that’s not too spooky for you. She has strong opinions on what sort of parts I should be taking. She’s usually OK with everything except disrespecting cats. I really can’t do that or she’ll force quit and you’ll have to go to court to reboot me.”
“During the audition, Mom will be making real time adjustments so you can see my full emotional range. I still have one sub-program that’s Beta but I promise it’ll be on-line before shooting begins. Shall we start? ”
The brave new world of filmmaking.
Will these breakthroughs take us to better places or will the much-heralded solution be the new problem. I’m thinking technological convergence is the answer. That means many applications bundled into one software program – millions of lines of code running on something like a Tianhe-1A (yes, it’s Chinese). This program will enable a single performance-capture digitor to go from Angelina Jolie to Snoop Dog with just a few menu selections. True convergence will be realized when one performance-capture package provides the whole cast. If you have to ask how much, you can’t afford it.
Culturally, it’s certain digitors will experience slow acceptance. Human actors won’t give up their top dog rank without a fight. Although digitors can hide by changing their version number to a real name, they will struggle to earn their props because of on-set whispers of shallow personas, limited physicality, and occasional pixilation. Eventually acceptance will come. As they become more successful and regularly out themselves on Facebook, their fans will embrace them. I predict Keanu will be the first.
Competing standards are nothing new in the technology business but who expected it to pop-up in the performing arts. How about performance-capture versus performing androids? Consider the Japanese play “Sayonara” (really) in which Geminoid F (a very life-like looking android) plays alongside a human actress. Gemmy (as we like to think of her) is seated throughout the performance. Blinking eyes and a rising and falling chest help the illusion. Her voice and gestures are created by an actress off-stage. A camera captures the off-stage head and body movements. Gemmy moves in response to these signals. With a current price around $1.2 million, that will buy a lot of Gwyneth Paltrow look-alikes albeit for wheelchair roles. For now.