Personal Democracy Plus Our premium content network. LEARN MORE You are not logged in. LOG IN NOW >

A Computer Made These Eerily Human Portraits From the Last Presidential Debate

BY Nick Judd | Tuesday, October 16 2012

Among the millions of eyes expected to turn to tonight's presidential debate between President Barack Obama and Mitt Romney will be the cycloptic gaze of a single mechanical painter, a computer placed in front of a television set with the job of sketching what it sees like a courtroom artist. The tools of its trade are "particle brushes," programs repurposed from an earlier life helping to draw explosions in video games.

"It's not really a robot artist but this is basically a computer and it takes those brushes and tries to render the image," explained Don Relyea, the computer programmer, artist and designer whose automated creation is expected to watch the debates tonight.

During the last presidential debate, Relyea tasked a series of facial recognition and particle brush algorithms with watching the action, latching on whenever it recognized a face, and painting what it saw. The algorithms take the crispness of high-def television and break it down into something more random, something that looks eerily like the work of a human hand. It's called generative art: Done entirely on a computer, virtually, with an algorithm.

"The thing is, it doesn't render the image exactly," Relyea explained. "It's got lots of sort of looseness and errors built into the system ... I wrote the algorithm to kind of emulate the way I would do a really quick painting sketch, just colors on a small canvas or something with a brush that's kind of a little bigger than I would do if I was going to do something photorealistic."

The artist found this method of viewing the debates entirely by accident, he says. After plans to use this technology at an art festival did not pan out, he needed some material to "train" his facial recognition algorithms with, faces the program could see in order to be calibrated to better understand what a face looks like. The debate seemed as good a corpus as any.

"It takes about a minute to a minute and a half for it to draw the picture once it's found the face, and there's no intervention from me," he explained. "So the computer is watching a video projection or TV and it'll find a face. Sometimes there's a mistake, like it seems like it was finding Romney's ear quite a bit and I don't totally know why that was. You never know with these things, [with] technology ... that's kind of the fun of it."

Without the help of a human, Relyea's machine captured moments during the first Romney-Obama faceoff that seem surprisingly apt, he said.

"I didn't really know what to expect, but I was actually surprised that it did sort of capture the tone and the expressions of those guys much better than I thought it was," he said.

"You can see the tension on the faces," he explained. "That's actually what was exciting to me, was capturing the tension. You can see aggression, expressions of aggression and then expressions of almost recoil."

Relyea's computer will be watching the debate tonight, too, a tiny, artistic HAL-9000 with digital paintbrushes in hand. Unless there's a glitch, of course.

This is technology, after all. You never know what to expect.

All images: Don Relyea / Flickr

See all the generative art from the last presidential debate

News Briefs

RSS Feed today >

First POST: Outgassing

How Beijing is throttling expressions of solidarity with the Hong Kong democracy protests; is the DCCC going overboard with its online fundraising tactics?; SumOfUs's innovative new engagement metric; and much, much more. GO

tuesday >

With Vision of Internet Magna Carta, Web We Want Campaign Aims To Go Beyond Protest Mode

On Saturday, Tim Berners-Lee reiterated his call for an Internet Magna Carta to ensure the independence and openness of the World Wide Web and protection of user privacy. His remarks were part of the opening of the Web We Want Festival at the Southbank Centre in London, which the Web We Want campaign envisioned as only the start of a year long international process underlying his call to formulate concrete visions for the open web of the future, going beyond protests and the usual advocacy groups. GO

First POST: Lifestyles

Google's CEO on "work-life balance"; how CloudFlare just doubled the size of the encrypted web; Dems like Twitter; Reps like Pinterest; and much, much more. GO

monday >

First POST: Showdown

How demonstrators in Hong Kong are using mobile tech to route around government control; will the news penetrate mainland China?; dueling spin from Dems and Reps on which party's tech efforts will matter more in November; and much, much more. GO

friday >

Pirate MEP Crowdsources Internet Policy Questions For Designated EU Commissioners

While the Pirate Party within Germany was facing internal disputes over the last week, the German Pirate Party member in the European Parliament, Julia Reda, is seeking to make the European Commission appointment process more transparent by crowdsourcing questions for the designated Commissioner for Digital Economy & Society and the designated Vice President for the Digital Single Market. GO

First POST: Dogfood

What ethical social networking might look like; can the iPhone promise more privacy?; how Obama did on transparency; and much, much more. GO

thursday >

First POST: Sucks

How the FCC can't communicate; tech is getting more political; Facebook might see a lawsuit for its mood manipulation experiment; and much, much more. GO

More