Personal Democracy Plus Our premium content network. LEARN MORE You are not logged in. LOG IN NOW >

A Computer Made These Eerily Human Portraits From the Last Presidential Debate

BY Nick Judd | Tuesday, October 16 2012

Among the millions of eyes expected to turn to tonight's presidential debate between President Barack Obama and Mitt Romney will be the cycloptic gaze of a single mechanical painter, a computer placed in front of a television set with the job of sketching what it sees like a courtroom artist. The tools of its trade are "particle brushes," programs repurposed from an earlier life helping to draw explosions in video games.

"It's not really a robot artist but this is basically a computer and it takes those brushes and tries to render the image," explained Don Relyea, the computer programmer, artist and designer whose automated creation is expected to watch the debates tonight.

During the last presidential debate, Relyea tasked a series of facial recognition and particle brush algorithms with watching the action, latching on whenever it recognized a face, and painting what it saw. The algorithms take the crispness of high-def television and break it down into something more random, something that looks eerily like the work of a human hand. It's called generative art: Done entirely on a computer, virtually, with an algorithm.

"The thing is, it doesn't render the image exactly," Relyea explained. "It's got lots of sort of looseness and errors built into the system ... I wrote the algorithm to kind of emulate the way I would do a really quick painting sketch, just colors on a small canvas or something with a brush that's kind of a little bigger than I would do if I was going to do something photorealistic."

The artist found this method of viewing the debates entirely by accident, he says. After plans to use this technology at an art festival did not pan out, he needed some material to "train" his facial recognition algorithms with, faces the program could see in order to be calibrated to better understand what a face looks like. The debate seemed as good a corpus as any.

"It takes about a minute to a minute and a half for it to draw the picture once it's found the face, and there's no intervention from me," he explained. "So the computer is watching a video projection or TV and it'll find a face. Sometimes there's a mistake, like it seems like it was finding Romney's ear quite a bit and I don't totally know why that was. You never know with these things, [with] technology ... that's kind of the fun of it."

Without the help of a human, Relyea's machine captured moments during the first Romney-Obama faceoff that seem surprisingly apt, he said.

"I didn't really know what to expect, but I was actually surprised that it did sort of capture the tone and the expressions of those guys much better than I thought it was," he said.

"You can see the tension on the faces," he explained. "That's actually what was exciting to me, was capturing the tension. You can see aggression, expressions of aggression and then expressions of almost recoil."

Relyea's computer will be watching the debate tonight, too, a tiny, artistic HAL-9000 with digital paintbrushes in hand. Unless there's a glitch, of course.

This is technology, after all. You never know what to expect.

All images: Don Relyea / Flickr

See all the generative art from the last presidential debate

Transparency and Public Shaming: Pakistan Tackles Tax Evasion

In Pakistan, where only one in 200 citizens files their income tax return, authorities published a directory of taxpayers' details for the first time. Officials explained the decision as an attempt to shame defaulters into paying up.

GO

wednesday >

Facebook Seeks Approval as Financial Service in Ireland. Is the Developing World Next?

On April 13 the Financial Times reported that Facebook is only weeks away from being approved as a financial service in Ireland. Is this foray into e-money motivated by Facebook's desire to conquer the developing world before other corporate Internet giants do? Maybe.

GO

The Rise and Fall of Iran's “Blogestan”

The robust community of Iranian bloggers—sometimes nicknamed “Blogestan”—has shrunk since its heyday between 2002 – 2010. “Whither Blogestan,” a recent report from the University of Pennsylvania's Iran Media Program sought to find out how and why. The researchers performed a web crawling analysis of Blogestan, survey 165 Persian blog users, and conducted 20 interviews with influential bloggers in the Persian community. They found multiple causes of the decline in blogging, including increased social media use and interference from authorities.

GO

tuesday >

Weekly Readings: What the Govt Wants to Know

A roundup of interesting reads and stories from around the web. GO

Russia to Treat Bloggers Like Mass Media Because "the F*cking Journalists Won't Stop Writing"

The worldwide debate over who is and who isn't a journalist has raged since digital media made it much easier for citizen journalists and other “amateurs” to compete with the big guys. In the United States, journalists are entitled to certain protections under the law, such as the right to confidential sources. As such, many argue that blogging should qualify as journalism because independent writers deserve the same legal protections as corporate employees. In Russia, however, earning a place equal to mass media means additional regulations and obligations, which some say will lead to the repression of free speech.

GO

Politics for People: Demanding Transparent and Ethical Lobbying in the EU

Today the Alliance for Lobbying Transparency and Ethics Regulation (ALTER-EU) launched a campaign called Politics for People that asks candidates for the European Parliament to pledge to stand up to secretive industry lobbyists and to advocate for transparency. The Politics for People website connects voters with information about their MEP candidates and encourages them to reach out on Facebook, Twitter or by email to ask them to sign the pledge.

GO

monday >

Security Agencies Given Full Access to Telecom Data Even Though "All Lebanese Can Not Be Suspects"

In late March, Lebanese government ministers granted security agencies unrestricted access to telecommunications data in spite of some ministers objections that it violates privacy rights. Global Voices reports that the policy violates Lebanon's existing surveillance and privacy law, Law 140, but has gotten little coverage from the country's mainstream media.

GO

More