Government Needs Smart-sourcing, Not Crowdsourcing

Pete Peterson's picture

The prophet is having second thoughts. In comments that have received remarkably scant coverage on this side of the pond, Clay Shirky, while in London last month promoting the release of Here Comes Everybody in paperback, said the following: “All the rhetoric, including - I'm embarrassed to say - some of mine, has assumed in the past that democratic legitimation is itself enough to regard aggregate public opinion [online] as being clearly binding on the government. I've changed my mind.” This is a momentous admission from someone as influential as Shirky, and timely, as the White House hires former Google exec’s into new positions like the “Director of Citizen Participation,” and considers its web strategy for involving Americans in Federal policy-making. The good people making these decisions at 1600 Pennsylvania have some tough jobs, since the challenges to national level online participation are inherent in both the available web tools, and in the nature of our representative government system.

From the campaign through the transition period participation has been kept to the crowd-sourcing of questions or priorities, which have been, ostensibly, passed on to then candidate (or his staff), and now, President. The crowdsourcing tool, “Moderator” was released by Google last September, and, like the candidate who used it, went from long shot to prime-time in a matter of months. Interestingly, as described by its lead project engineer, Talliver Heath, local governments were the original target market for Moderator. They would use it to elicit and evaluate questions or concerns of local import. In an interview with the tech site, Ars Technica, Heath propounded, “How many city council meetings have you been to? How about school boards? There are always questions you may have about the running of your city, town, state, etc. I believe a public application like Moderator can make civil participation significantly higher in local governments." So from prioritizing policy questions like trash pick-up, and teacher pay, then President-elect Obama, had the tool installed onto his Transition website: Change.gov.

But things were lost in the transition from Main Street to Pennsylvania Avenue in two specific areas, which, while they’re evident in all crowd-sourcing efforts were highlighted in the move to the national stage: participation and facilitation. It quickly became evident in several instances that online participants were, to put it nicely, not entirely representative of the United States. Hailed by then Transition-team Co-chair, Valerie Jarrett (now head of the Office of Public Liaison) as coming “directly from the American people,” the “Citizen’s Briefing Book” was an online compilation of crowd-sourced policies, meant to inform the incoming President as to what Americans wanted him to focus on. So what did the “American people” during a time of war and financial crisis want their president to address? Taking two of the top five spots (including the top “vote” getter) were issues related to marijuana legalization. Other popular policy issues were support for online gambling and alternative energy research. Over 500,000 Americans cast over three times as many votes (no “one man, one vote” here) in support of over 40,000 issues.

Who were these “American people”? Well, we don’t know. There were no restrictions on age to participate, so we’re not quite sure how many of these half million respondents were of voting age. Still, even if all were, they would only constitute .2% of voting age eligible Americans – hardly representative of anything. Results from the “Briefing Book” exercise were extolled in the micro-press of the gaming and pro-marijuana communities, which in turn used their focused bullhorns to encourage “voting” on the transition site. The results were quickly discounted by Obama, who has no intention of pushing these policies.

Similar questions of representation and participation were raised when Change.gov’s “Join the Discussion” section posted the rather innocuous question, “What social causes and service organizations are you a part of that make a difference in your community?”, and waited for feedback. More of a blog/response than a crowd-sourcing effort, the “conversation” quickly degenerated into a rather vicious online altercation between supporters and detractors of Rick Warren – the mega-church pastor selected by Obama to give the invocation at the inauguration. Google “Rick Warren/Join the Discussion/change.gov”, and you get back almost 1,000 hits showing various blogs calling on their loyal readers to sign on to the Transition site and offer their opinions. The Transition team had to shut down the online exchange within days.

In both of these instances, the very popular Change.gov site provided a billboard for extraneous groups to promote their views. Americans more concerned about bank bailouts and troop escalations in Afghanistan had to roll their eyes at seeing such outlying issues rate so highly. This would be a joke if a Sr. White House Advisor didn’t describe the results as the opinions of the “American people,” and if they weren’t being assembled into a briefing document for the President of the United States. Change.gov and now, WhiteHouse.gov are meant to be the internet’s most representative “real estate” where vital questions of public policy can be discussed – not some graffiti-splattered wall on the web’s back streets.

This is not to say that all of Change.gov’s online involvement campaigns disappeared down back allies. But even the ones that were serious revealed problems in utilizing the web to somehow inform national policy. In the site’s, “Open for Questions” section, Obama’s staff asked Americans to submit their questions on one or more of eight categories (from “Foreign Policy” to “Energy & Environment”), which will then be answered by the President and/or his staff at some point this year. Utilizing Moderator, the crowdsourced questions were both supplied and voted on by just over 103,000 people. The results were announced in January, and while the top questions were more deliberate than aforementioned efforts, we did not derive anything uniquely insightful. Here were the top three:

1. “What strategies other than bailouts can we employ to keep jobs in America?” (Economy)
2. “How do we unlink from our addiction to fossil fuels?” (Economy)
3. “When will President Obama start doing drawback of the Service Members (troops) from Iraq and Afghanistan? It becomes a stress on the families, the soldiers and divorce rates are high.” (Foreign Policy)

Now these are all good questions, but did crowd-sourcing really help uncover a distinct and weighty issue inquiring Americans want their president to consider? Reviewing these results, I am reminded of last year’s CNN/YouTube Debates, which failed to proffer any interesting questions – just interesting people asking those questions.

This, of course, is not the Administration’s fault, but is the nature of national policy-making. The scope of the issues are often so broad and complex, asking the general public to send in question ideas is a bit like sending Paris Hilton in to ask questions of a brain surgeon during surgery: she might look the part in her scrubs and mask, she might even ask a couple interesting questions, but she’s not really helping the surgical team. She’s just…participating.

This takes us to the final, and perhaps most pertinent question regarding the entire online engagement effort: how will the Administration utilize America’s participation? With terminology like “Citizen’s Briefing Book”, “Join the Discussion”, and “Your Seat at the Table” used during the Transition, there was at least a rhetorical commitment to having online submissions somehow inform in policy-making. The homepage for the Office of Public Liaison (OPL) on the new WhiteHouse.gov site proclaims that it is “the front door to the White House through which everyone can participate and inform the work of the President.” But in a nation of 300 million people (230 million eligible voters) it is just not realistic to expect our crowd-sourced offerings to be pored over by the President and his staff. Given the results from these exercises during the Transition, I would rather my president and his team spend their time on more productive pursuits…like combing their hair.

Linked to this is the straightforward political question whether the Administration should even consider policy suggestions that run counter to the platform on which the president ran and won. We have already seen him throw the last Citizen’s Briefing Book into the garbage (and for good reason) - what if in a future online discussion about education reform, an overwhelming number of responses support something contrary to what the Administration has proposed? The OPL website says the president supports “stimulating honest dialogue.” Does this mean informing Americans about competing policy views? When the Obama team used Change.gov to generate “Community Conversations” around health care reform, the leader/participant “Guides”, which could be downloaded from the site, only promulgated the Administration’s plan. This is all understandable politically, but it gives the appearance of an Administration that only supports civic participation, which agrees with stated policy.

In the face of all these challenges to formulating an online participation strategy, I suggest that the White House should “go small, and go home (local)”. The web is a powerful idea creation platform, but as we have seen in enterprises like Wikipedia and countless others, it works best when smart people in specific subject areas are asked to accomplish specific things. At times sounding more oligarchic than democratic, Shirky made similar points in London, telling an audience at the London School of Economics, “If you want to know where new interesting useful ideas are going to come from, don’t look at crowds and don’t look at individuals, look at small groups of smart people arguing with each other. Historically that’s been a big source of change.” This can happen both intra-governmentally and with select groups of citizens. The government can serve a vital role as convener – bringing together smart people from a variety of viewpoints to collaborate and debate online over particular policy initiatives. These policy discussions – whether in wiki or blog format – can be kept transparent and open to the public’s view, but as we have seen during the Transition, these must be controlled in such a way as to prevent hijacking by small, organized groups.

Lastly, the Administration should focus its online engagement efforts at the local level. In a sense this means using tools like Moderator as they were originally intended. The advantage of this strategy is that the content and political decision-making process involved in localized issues tend to be less complex than at the national level. Participants can more readily see the impact they will have on a community concern than a national one. This does not mean the subject of the engagement is not Federal in nature. Many Federal agencies from the EPA to Homeland Security are tasked with conforming policies to cities and regions throughout the country. Answering the “how” question of policy – specifically, “how does that rule fit here?” – can be supported legitimately by online tools.

The Administration can also support cities and states as they attempt to employ these online participation platforms through financial support, developing “Best Practices” criteria, and promoting localities and Federal projects that have effectively involved the public. In this there may not be a direct political benefits for the president, but the indirect benefit – of being perceived as a leader who supports democratic practices throughout the country - would be considerable.

It was the late, great Daniel Patrick Moynihan who once offered sardonically, “Civic Engagement is a device whereby public officials induce non-public individuals to act in a way the public officials desire.” This is a challenge to all governments that involve their citizens in policymaking, including the current Administration. At the same time, recent crowdsourcing efforts have proven an alternative hypothesis in which “non-public individuals” (or small groups of them) who are both non-representative and often unidentified can have unprecedented influence on public policy…if they are permitted. This is the tension, which should be felt by White House officials. I don’t envy them.

Pete Peterson is executive director of Common Sense California, a multi-partisan organization that supports citizen participation both online and offline in policymaking (his views do not necessarily represent those of CSC). He also lectures on civic engagement at Pepperdine’s School of Public Policy.

Comments

Who Decides Who Gets to Be on the Smart Committee?

Ugh. I'm not at all surprise that after the Web 2.0 Bolsheviks got done inciting a Cultural Revolution and destroying all property and liberating content and information -- as they have been doing in the last decade -- they are now doubling back and saying, "Oh, we can't *really* have the masses run things. We need an enlightened workers' avant-garde to really govern because the masses are too stupid." It's not just Shirky having second thoughts as he becomes more influential and powerful; Beth Noveck first implements a wiki in government, then doubles back and says wikis needs "group checks on the individual". Sigh. Who checks *these* individuals?!

People wonder why I call Clay Shirky and other prophets of this new destructive online culture "bolsheviks". That's because they are conforming to the classic "end justifies the means" dynamic of the Leninists. They incite destruction and invoke "Here Comes Everybody," profit themselves from books and lecture fees even as everyone else is told to free up their code and content for no pay, and then suddenly, they say, oh, we don' really need to crowdsource now, we just need smart little committees. Hey, let's get rid of those pesky workers' soviets and have the Cheka.

Smart little committees is what socialists have *always* been advocating run things from time immemorial, and crystallizing little totalitarian nodes like that out of mass, chaotic movements overturning the old has always been their specialty. It nearly always ends up in oppression and failure. And that's because of a simple problem: who gets to decide who is smart, and who gets to decide who is in the small smart people's committee?!

Shirky would just cynically wave his hand and say the "crowd" or "the community" have "decided this already". But they didn't. Obama didn't make a position on every conceivable issue, and the idea that he should only take input from "smart committees" on issues already in his platform is a preposterous proposition for a democracy.

Example: so far, Obama has not decided (or Biden hasn't decided after outsourcing foreign policy expertise) to remove the Czech radar stations. The Czech parliament and leading Czech scientists have opposed the deployment of these missiles, which are an unneeded irritant to Russia and not a demonstrable means of security against Iran anyway (they aren't even deployed yet but are planned). So just because Obama hasn't wrapped his mind around this, and has no campaign plank or program about this, why are we all supposed to shut up?! See, it was easy to call for "no democracy" and "no input" when you thought it was issues you don't like, coming from the Republicans on the bailout. Zoom out further and see its repercussions everywhere.

I fail to see why one experiment that led to one set of dopers flash-mobbing the voting levers has to discredit every single effort. That's absurd. None of this has been tried locally or nationally or internationally on any kind of proper scale or duration to really be enabling Shirky, of all people, to dump citizens' participation on a mass level in favour of little grouplets that he or Beth Noveck or Jay Rosen will draw on from their friendship cards to run things their way out of their vest pockets. No thanks!

Change.org is horribly politicized and skewed because the lefty moderators are constantly intervening with hortatory admonitions, blocking people they don't like, and thus inciting the right to flashmobbing through the blogosphere. Whitehouse.org at times hopelessly skews the propositions -- power in these "crowdsourcing" or "smart committee" situations inevitably goes right to the coders and site managers (which was the idea all along) and make for such skewed ballots that you give up participating because the platform is not viable for authentic debate.

Did it occur to anybody that trying to run political discussions like they are software bug reports on a JIRA reporting program is rather limited? Yet that's where these models come from, the reports of the opensource software mode. People don't always think in terms of yes/no, and don't always want to use up all 5 of their proposition privileges -- or have more than 5. ("Voter 5," which may be some kind of server artifact, isn't necessary even in an online democracy). Running politics from small magazines at least open to the public to read and comment in the letters like the Nation or New Republic, simply makes more sense than trying to run it through these geeky change.org type of sites where the discussion is rigged with the coders' views or allowing Shirky to harvest the mob selectively and tendentiously to fit his pre-existing agenda.

The notion that there are "hijackers" out there merely because they challenge the illegitimate power of Shirky's 'smart groups' is unproven and silly. These platforms must remain flexible and open to speech protected under the First Amendment. The U.S. government sites are using MMORPG and blogging site-like "TOS" to suppress speech on political matters, and that's wrong. That means traditional forums like the Nation or the New York Times or even this blog have to shoulder the burden of the discourse, and avoid muting and banning and suppressing speech and use moderators' tools lightly. What are needed are not smart committees, unaccountable to public criticism or the electorate; what are needed are good editors. They can pick out the political commentary that fits their "line" as long as there is tolerance for a variety of such political magazines, and they can set the tone for the discussion by not rigging it in the first place themselves.

Luddite

Be my guest and go back to the farm to bury your head in the sand.

National government isn't local: it's national.

Shouldn't citizens have a direct way to influence national policy makers?

Though I agree with you: crowdsourcing is destined to fail on that scale, given current models.

So why not help develop a new model instead? That's what I've been trying to do at The People's Agenda since the debacle of The Citizen's Briefing Book on change.gov drove me away.

It's still early days, and so far I'm the only one designing and coding it (though I welcome helpers), but some of the novel strategies I've long meditating for handling something on that scale are starting to actually work their way out in the code.

One key factor seems to be: you're going to have to manufacture your own "local" groupings on a site like this - people aren't made to really get down, discuss, and hopefully come to consensus on things in groups larger than, say, a college seminar - and figure out a way to daisy chain them together to create a national result.

But there's no reason these "local" grouping shouldn't include people who don't actually live anywhere near each other - not even in the same state. And there's no need to tie them to existing local-interest groups.

People can already go local on their own. What we need to design is a way for any and all of them, collectively, to rise up on a national stage.

Strong Arguments for Strucuture, Standards and Federalism

You have raised some excellent points. And while some may challenge your naïveté on some of the issues, they are accurate nevertheless. Based on your professional experience, I can understand the foundation from which your POV originates. It is valid.

To put your content and suggestions in perspective, let's go back in time before the Internet and consider these same challenges related to Crowd sourcing, Smart-Sourcing, Web 2.0, and Gov 2.0 etc.

Does anybody remember “tasks forces?” Aren’t these similar to the small, knowledgeable groups you suggest who contribute SME to an issue or policy that can then be presented to the public and policy makers?

Has anyone been to a Town Hall meeting that was obviously “stacked” by special interest? Again, it’s a free country to display your civic involvement in however you chose or not chose to do so. Still, even these crowds were understandably not representative of the public or electorate at large.

Has anyone ever seen or participated in a demonstration or rally where large numbers of people advocated a position that we, the public, as a whole did not think were that significant? Still, these public displays garnered media headlines and the attention of policy makers.

Enter the Internet. What the Web has enabled is to replicate or expand all this behavior at a factor or 100 or 1,000, if you get my drift.

While national dialog is important, and should happen, facilitating it at the local level has its merits. Whether national, state or community, there needs to be (more) structure and standards in how it occurs and is administered. Also, strong consideration must be given to attribution and validation, if it is to be considered “for the record.” Then there is reporting –consistent and standardized to be able compare apples to apples.

I think a good example of a national issue being addressed locally is the ARRA stimulus funds. Recovery.gov, the federal Web site, has led to hundreds of state and local “clones” that have joined it online for both political and policy reasons. I have yet to see an effective, centralized online solution to capture and facilitate dialog and debate on national issues. But who knows? Perhaps we will redefine (in the case “dummy-down”) the notion of civic involvement and public comment to say we can make sense and accept this huge, incoherent display of a lot of chatter but not much being said.

Dan Bevarly
www.aheadofideas.com

Response posted at Working Wikily

Hi Pete,

Thanks for a thoughtful post. I've posted a summary and some further thoughts on my blog, Working Wikily, where I gather news and views about the application of social software to the social sector. I've included a copy of the post below and it's available on the web here: http://workingwikily.net/?p=637.

best,
Noah Flower
Monitor Institute

--------

Should nonprofits be crowdsourcing or “smart-sourcing”?

As techPresident’s Pete Peterson reports in his piece titled “Government Needs Smart-sourcing, Not Crowdsourcing,” Clay Shirky has changed a few notes of his tune: whereas he previously was advocating for government to use Web 2.0 tools to pay more attention to public opinion writ large, he now believes that it should give greater weight to expert views. Peterson’s post builds on that idea, developing a critique of crowdsourced policy suggestions, along the lines of Cynthia Gibson’s earlier post on the stupidity of crowds: they’re too simple-minded, subject to capture by special interests who invest a disproportionate amount of effort, not representative of the public at large by virtue of low participation, and too insecure to enforce the rule of one vote per person. These flaws put the Obama administration in a tough bind, he points out, since they promised to listen to citizen input but ended up with a Citizen’s Briefing Book that argued for the legalization of marijuana and gambling to be among Obama’s top five policy priorities. The result was that the book was quietly shelved while the administration moved on to other experiments.

Nonprofit leaders clearly face a similar quandary, as do corporate leaders concerned about public engagement. On the one hand, inviting public input provides a fantastic opportunity for boosting the legitimacy of your choices in the public eye. What better way to fend off criticism and provide the public with a sense of satisfaction with your actions than to throw open the front door, invite anyone to voice their opinion, and promise to listen? After all, tools like Google Moderator let you do it simple, fast and free — and along with extra legitimacy you might also get some valuable input. Yet the results of Change.gov experiment were not encouraging; the quality of suggestions at Whitehouse2.org is arguably higher, but the stakes are also lower since Obama has not promised to listen. What if you ask “the public” and the suggestions you get are not just different from your own ideas but are simply not thoughtful? Now you’ve ended up in the Obama dilemma: how do you fulfill the public desire for input while still making the right decisions?

Shirky’s answer is effectively that you shouldn’t have made such a promise in the first place: “If you want to know where new interesting useful ideas are going to come from, don’t look at crowds and don’t look at individuals, look at small groups of smart people arguing with each other. Historically that’s been a big source of change.” Peterson more or less agrees, but designs a role for broad public input, proposing that the government should split its efforts to incorporate public input in two directions: (1) open conversations at the local level where the politics are less complex and the issues are more tangible and (2) publicly visible conversations among government-accredited experts that are carefully moderated to prevent small organized groups from hijacking the results. The latter would provide governmental leaders with only the views that they believed they needed, hobbling the chances of including deeply contrarian views, but would be far more likely to produce insight than a conversation that included the general public.

Perhaps a similar approach would be useful for nonprofit leaders.

What if the common practice of consulting with experts were opened up for public view in cases where the conversation was particularly relevant to the public debate?

What if calls for open public critique on were carefully scoped so that the issues being addressed were simple enough that they didn’t take deeply specialized knowledge to discuss?

listening to the chaos...it will always be there, my 2c dose...

thanks for getting these ideas out there pete!
yes we have some ways to go to get this to work right but let's also not be too hasty in disregarding those public voices, the mobs that have thus far spoken up, that have taken time to engage, to comment,
however representative we may or may not think they are of the rest of us, they're still saying something or trying to, taking the small token action that may lead to their next action and possibly inspiration...
it's as participatory as we've got right now, yeah it's crude, it's basic but we are in early stages yet,
let's just keep the experiment moving, even hobbling along is fine, mistakes need to be made for the people (the crowd, the mob, whatever) to slowly learn to take responsibility and make it work better, just keep them, keep us, engaged, let us comment, rant, talk and listen to one another, small bits of wisdom do arise even in the most inane, incoherent, uneducated seeming responses, it's not always immediately obvious and none of this will ever be perfect,
the most important thing is that we're ALL here, we're part of the process now, somehow...

mmm, well, i may eventually get to what i want to get to here (i'm not always naturally coherent) maybe it's better i wait a few weeks for a more fully formed opinion/argument to spout from me?
mm, sorry, something just needs to give, i'm here now, and i'm sure are a lot of others...
myself, i try to be patient with this process stuff, but is there always another thing we need to to solve?
it really tiring, i've done more than enough community meetings and conferences in my time (even facilitated some), i end up mostly sitting in back rows, waiting around, there's that next problem to be solved, still the next best idea to be discussed...
but isn't the solution is always just so simply before us, us here and now?....so, we're out here now, waiting to act...yes, at all our levels of uneducation and disorganization...
again, we're here now, this is the time,
take us or leave us, it's the state of humanity in this country,
so lets talk, lets educate and understand one another, lets just act, in whatever imperfect union that may end up, if we trust we will manage, we'll put up with it...it'll soon all change again anyhow...
meanwhile, i'm going to get up off my butt now...