Personal Democracy Plus Our premium content network. LEARN MORE You are not logged in. LOG IN NOW >

[BackChannel] Three Problems With Civic Hackathons

BY Mike Mathieu | Wednesday, June 6 2012

techPresident's Backchannel series is an ongoing conversation between practitioners and close observers at the intersection of technology and politics. Mike Mathieu is a founder of or investor in many civic and political tech startups, including Walk Score, Upworthy, NationalField, and He is also a founding board member of New Media Ventures, a political tech angel network. We're pleased to repost this essay from Mathieu's blog at In it, he raises some valuable questions on the eve of this weekend's PDF:Applied hackathon.

This weekend in New York, I’ll be a judge at the two-day PDF:Applied civic hackathon (June 9-10), along with Anne-Marie Slaughter, in advance of PDF 2012. The focus is ideas that enhance our electoral process, engage citizens in their communities, or facilitate online activism, and the attendee list looks like it’s shaping up to be an all-star cast. (Get tickets, or weigh in with ideas.)

As a judge at the first Startup Weekend GOV event 6 weeks ago in Seattle, and now PDF:Applied, I wanted to write about the kind of innovation I’d love to see come out of PDF:Applied and all of the other civic-minded apps contests and hackathons.

Broad Distribution

Poor distribution is a chronic problem for civic apps. To have impact, we need new ways to get the right apps into the hands of the right citizens, at the right time. For example, the awesome transparency efforts of the Sunlight Foundation will only achieve their true potential when that open data is put in the hands of citizens right at the moment when they can use it to make an informed decision — whether it’s voting or making a purchase.

In the 1960s when the U.S. wanted to provide distribution to civic broadcast media, we passed the Public Broadcasting Act of 1967, which leveraged 250 FCC broadcast licenses that had been set aside for educational purposes. This led to the establishment of brands like PBS and NPR that provided editorial voice. Now that’s a lot of distribution!

What’s our 21st century solution for distribution of civic software? Steven VanRoekel, the Federal CIO, knows that it’s not about adding new .gov domains. At Walk Score we invested millions of dollars and years of effort to build a network of more than 15,000 real estate web sites that distribute services that “help apartment renters and homebuyers find neighborhoods where they can drive less and live more” 6 million times a day. But what about the rest of the civic software ecosystem?

I’m hoping that the all-star cast at PDF:Applied will have more innovative ideas here.

App Roaming

It’s not as sexy for politicians as a new iPhone app, but for techies, it doesn’t get any more foundational. Simply put, civic apps don’t roam across political jurisdictions. It’s like cell phones before McCaw Cellular/Cellular One first brought nation-wide roaming to the U.S. in 1990.

The reasons are many — missing standards for schemas, semantics, data dictionaries, naming conventions (think data balkinization); lack of universal directories for programmatic data access, authentication, metering; incomplete, disparate, non-scalable licensing agreements; export and post models rather than interface-level access to transactional data and methods. And plenty more. Data hosting services like Socrata, even with API access, are promising but only scratch the surface.

Michael Porter would call this a fragmented industry, and fragmentation hurts. Not only is it a major pain for end-users, but developers lose the economies of scale that make the commercial internet so powerful. Instead of one app that can take the world by storm, you get a series of one-off IT projects with no chance of going viral, let alone providing financial incentive to make a living doing this stuff. It’s why you see the same apps, time and again, when different cities host app contests.

Code for America is doing some great organizing work with The Brigade, a sort of hand-crafted, barn-raising approach to standing up their local apps in new cities. And My Society in the UK has a similar volunteer-driven approach to porting their apps. But what are the new civic innovations that can take this artisanal approach and industrialize it to gain scale economies across cities, counties, transit areas, states, and countries?

Meaningful Problems

Software is empowering. It’s magic. Even after 20 years of the internet. An unemployed developer can spend a month and build something with the potential to change the world. But developers need context. They need exposure to meaningful problems. Walk Score’s CTO, Matt Lerner, was inspired by ideas from a local sustainability think tank. Then he used his own creativity and teamed up with Jesse Kocher to build a seminal piece of civic software in just two weeks.

A developer without context who is pissed off politically will rely on the only context they know – as an ordinary citizen. In a tech-infused fit of rage, they’ll write one of two iPhone apps: the “who was my representative again?” app, or the “where do I go to vote again?” app. They’ve been written dozens of times, and I’m sorry to say, the true problem here is distribution, not tech. And they’re not the biggest civic opportunities either.

We need to organize the civic hackers, sure. But we also need to organize the domain experts who can shed light on how the world really works. The Presidential Innovation Fellows program, launched last week, sets a new high bar in this direction. Rather than a call for ideas, it lays out 5 specific digital government innovation challenges that the White House wants solved and makes an open call for applicants to rise to the challenge. True, they’re not the 5 largest problems facing government. But they’ve been carefully selected both for their impact on government priorities, their potential for completion within 6 months, and their ability to help show the way forward for digital innovation in government.

It’s time to end the hollow calls to “create innovative apps” using our “high value data sets” and to usher in a new era of curated problem statements. Save the Ideascale pages for sharing and voting ideas for technical solutions, not for crowdsourcing problem statements.

What’s the innovative new platform for locating the domain experts, and then collecting and curating the problem statements they produce?

The Future

There’s no doubt it’s fun to open up a new data source. Whether it’s the handy new work of the Voter Information Project, the mind-bending scale of‘s 300,000 data sets, or the rigorous independent aggregation efforts of GTFS-Data-Exchange for public transit feeds, opening data brings a strong sense of accomplishment. But the future of civic software rests not purely in the data. Challenges like distribution, roaming, and the knowledge and technical infrastructure to enable scalable, high-impact systems have become more central.

Developments like NYCFacets by Ontodia, the winner of the NYC BigApps 3.0 competition, give a hopeful glimpse of the future. Their service builds on the NYC open data catalog to provide searchable crowdsourced and algorithmic metadata services. This makes undigestable data catalogs like those in many major metro areas, suddenly much more useful for developers. Expanding their federated search model to include multiple governmental jurisdictions is an obvous and welcome next step. By itself, this isn’t a sexy end-user app. But like Socrata, it’s a piece of the infrastructure that should enable many more high-impact apps in the future.

My hope for PDF:Applied and other apps contests and hackathons like it, is to start moving beyond the feel-good apps (that die in short order), and the useful community building (that offers promise, but not significant impact), and into a new era of high-impact civic software infrastructure that enables national distribution of scalable, roaming solutions to important problems.

Transparency and Public Shaming: Pakistan Tackles Tax Evasion

In Pakistan, where only one in 200 citizens files their income tax return, authorities published a directory of taxpayers' details for the first time. Officials explained the decision as an attempt to shame defaulters into paying up.


wednesday >

Facebook Seeks Approval as Financial Service in Ireland. Is the Developing World Next?

On April 13 the Financial Times reported that Facebook is only weeks away from being approved as a financial service in Ireland. Is this foray into e-money motivated by Facebook's desire to conquer the developing world before other corporate Internet giants do? Maybe.


The Rise and Fall of Iran's “Blogestan”

The robust community of Iranian bloggers—sometimes nicknamed “Blogestan”—has shrunk since its heyday between 2002 – 2010. “Whither Blogestan,” a recent report from the University of Pennsylvania's Iran Media Program sought to find out how and why. The researchers performed a web crawling analysis of Blogestan, survey 165 Persian blog users, and conducted 20 interviews with influential bloggers in the Persian community. They found multiple causes of the decline in blogging, including increased social media use and interference from authorities.


tuesday >

Weekly Readings: What the Govt Wants to Know

A roundup of interesting reads and stories from around the web. GO

Russia to Treat Bloggers Like Mass Media Because "the F*cking Journalists Won't Stop Writing"

The worldwide debate over who is and who isn't a journalist has raged since digital media made it much easier for citizen journalists and other “amateurs” to compete with the big guys. In the United States, journalists are entitled to certain protections under the law, such as the right to confidential sources. As such, many argue that blogging should qualify as journalism because independent writers deserve the same legal protections as corporate employees. In Russia, however, earning a place equal to mass media means additional regulations and obligations, which some say will lead to the repression of free speech.


Politics for People: Demanding Transparent and Ethical Lobbying in the EU

Today the Alliance for Lobbying Transparency and Ethics Regulation (ALTER-EU) launched a campaign called Politics for People that asks candidates for the European Parliament to pledge to stand up to secretive industry lobbyists and to advocate for transparency. The Politics for People website connects voters with information about their MEP candidates and encourages them to reach out on Facebook, Twitter or by email to ask them to sign the pledge.


monday >

Security Agencies Given Full Access to Telecom Data Even Though "All Lebanese Can Not Be Suspects"

In late March, Lebanese government ministers granted security agencies unrestricted access to telecommunications data in spite of some ministers objections that it violates privacy rights. Global Voices reports that the policy violates Lebanon's existing surveillance and privacy law, Law 140, but has gotten little coverage from the country's mainstream media.