Personal Democracy Plus Our premium content network. LEARN MORE You are not logged in. LOG IN NOW >

Measuring Social Media Impact: Bit.ly vs. Google Analytics

BY Alan Rosenblatt | Friday, April 23 2010

If you are using social media to raise awareness about your campaign or organization, you are likely to be sharing links there back to your website. Measuring the impact of this effort, no doubt, is high on your list of priorities. While click-throughs to your website is by no means the most important measure of success for your social media program--that honor goes to engaging your audience on social media--it is still important to drive some of your audience home.

One of the most popular ways to measure click-throughs from Twitter and other social media outreach (especially Twitter, given in 140 character limit) is the URL shortener Bit.ly. Bit.ly not only shortens your URL, but it also tracks how many people have clicked on any Bit.ly link to that destination web page. And if you register an account with Bit.ly (free), you can track how many times your specific Bit.ly link was clicked.

The problem, as Jay Rosen reported last summer, is that compared to other web metrics services, Bit.ly reports more clicks.

Our own experience at the Center for American Progress/Center for American Progress Action Fund has been that Bit.ly reports many more clicks than Google Analytics reports page views for the same page. As we use Bit.ly to measure the impact of our social media outreach program and Google Analytics to measure traffic to our website, the discrepancy is a problem that affects our ability to compare how well our social media outreach compares to our email outreach and other sources of traffic to our websites.

In order to better understand the differences between the two data sources and figure out how to reconcile them, we conducted an experiment:

We created a test webpage that was not publicized, not linked to from any other web page on our websites. We then created a corresponding Bit.ly link (http://bit.ly/bA5wXm). Bit.ly data for this link can be viewed here.

Initial returns from our test revealed that Bit.ly accurately measures clicks and Google Analytics understates page views.

Details for the test are as follows:

  • First we did a controlled internal test to confirm that Bit.ly recorded the number of clicks accurately. We clicked through the Bit.ly link several times and visually confirmed that Bit.ly registered the exact number of clicks we performed.
  • Then we recruited people via Twitter to click on the Bit.ly link in two waves. One group did so before April 20, 2010. The other clicked through after April 20, 2010.
  • For the first group, our test produced 20 clicks as reported by Bit.ly and 16 reported by Google Analytics. For this group, Google Analytics reported 80.0% of the clicks reported by Bit.ly.
  • For the second group, Bit.ly reported 43 clicks and Google Analytics reported 30 views of the test page we created. For this group, Google Analytics reported only 69.8% of the clicks reported by Bit.ly.
  • Combining both test runs, Bitl.y reports 63 clicks and Google Analytics reports 46 page views. Thus, Google Analytics reported only 73.0% of the clicks reported by Bit.ly across the entire test.

Based on our experiment, we can conclude:

  • Bit.ly accurately records exactly the number of clicks (not unique visitors) through to the URL, and
  • Google Analytics understates the number of page views by an estimated 27%.

We did notice that the second wave of the test showed Google Analytics lagging further behind than the first test, suggesting the possibility that as the number of clicks on Bit.ly get larger, the gap between Bit.ly and Google Analytics may grow. The only way to determine if this is true is to continue to collect more clicks on our link.

The next two steps to solidify the finding of this experiment are 1) for more people to click on our Bit.ly test link (http://bit.ly/bA5wXm) and 2) for other people to run their own experiments and report back the results (you can post them as comments here, to help everyone better understand this issue).

Finally, it is important that people note that the visually confirmed results that Bit.ly does record clicks accurately justifies the continued use of Bit.ly to report these statistics, until evidence to the contrary is provided. That our results suggest that Bit.ly has fixed whatever problem Jay Rosen identified last summer can only be confirmed by Bit.ly.

News Briefs

RSS Feed today >

French Authorities Want to Tap (and Tax) Skype Calls

In spite of repeated requests from the French telecommunications authorities ARCEP, Skype has refused to classify itself as an electronic communications operator in France, which would require them to route emergency calls and allow the French police to intercept conversations. ARCEP has informed the Paris public prosecutor of Skype's refusal, and criminal charges might be brought against the company for failing to comply. This is yet another instance in recent months of France making things difficult for tech companies. Some worry that the overzealous government is discouraging technological progress in France, hindering business and economic growth.

GO

New Online Platform for Crowdsourced Videos About Human Rights Issues

Anyone with a phone and an Internet connection can be a citizen journalist, as was made clear in the hours and days after the Boston Marathon Bombings. Citizen journalism has its pros and cons, but it has popped up where most needed: after natural disasters or in war torn regions where career journalists might be barred. A new human rights initiative seeks to link citizen reporting in the form of online videos with mainstream media, governments and other policy makers. The online platform, called Irrepressible Voices, will both document human rights issues and work on solutions as a community.

GO

wednesday >

Facebook Becomes Full Member of Global Network Initiative

Facebook announced today that it has opted to become a full member of the Global Network Initiative, a group founded by Google, Microsoft and Yahoo to address the challenges technology companies face when dealing with governments about issues like freedom of expression and data privacy. GO

Russia's OGP Concerns Show That Transparency Matters

Last week, Russian officials announced they have withdrawn their letter of intent to join the Open Government Partnership. The Moscow Times has a statement to the Russian paper Kommersant from a presidential spokesman, saying, "We are not talking about winding up plans to join, but corrections in timing and the scale of participation are possible." So Russia may still be in. Just not soon. And maybe never. Confused? You're not alone. I actually find it fascinating that the Kremlin acts like "openness" and transparency matter. Here's why. GO

In Denmark, Online Tracking of Citizens is an Unwieldy Failure

Six years after Denmark passed a law mandating that telecommunication companies retain and store their customers' personal data for up to two years, local advocacy groups and the telecom industry are pushing for immediate changes to the legislation. The practice of keeping records of private citizens' Internet use is an unjustifiable invasion of privacy, they say. The police, meanwhile, have concluded that requiring telecoms to store subscriber data has not helped them track criminals, which was the the ostensible purpose of the practice. But the Danish government still wants to postpone an evaluation of the law for another two years. GO

"Accidental" Blocking of Australian Websites Raises Concerns About Government Censorship

An Australian government agency admitted last week to unintentionally blocking more than 1,200 perfectly legal websites in the process of shutting down one allegedly fraudulent site. In their defense, they pointed out that they have successfully blocked a number of websites in the past nine months without such digital collateral. This assertion came as no consolation to Australian netizens concerned about Internet censorship, especially opaque and hazily legal censorship.

GO

tuesday >

Honda Campaign Rolls Out Endorsements From Asian American Stars

Rep. Mike Honda (D-Calif.) rolled out several additional endorsements from Asian American leaders and celebrities Tuesday, with one of them vouching for his high-tech bona fides. GO

Here Are The People President Obama Hopes Will Repair American Elections

The Presidential Commission on Election Administration established by President Obama after problematic 2012 elections now has a web presence at SupporttheVoter.gov. Obama established the commission by executive order on March 28 "to identify best practices in election administration and to make recommendations to improve the voting experience." GO

After Oklahoma Disaster, Neighbors Look Online for Ways To Help

In echoes of the aftermath of Hurricane Sandy in the Northeast, social media sites and small business websites in and around tornado-wracked Moore, Okla., are full of offers of help, questions about missing pets and loved ones, and evidence that neighbors are willing to reach out to help one another in a disaster. On a single Facebook group, there's a Mexican restaurant in Oklahoma City promising free meals to first responders or people hit by the tornado; a mother a few hours' drive from Moore offering to open her door for children who might need a place to stay; a resident sharing a picture of a found dog and contact information for the owner to get in touch. GO

Change.org Lands $15 Million From Omidyar

Change.org capped an extraordinary few years of growth Tuesday with the announcement that it has landed a $15 million investment led by the Omidyar Network. GO

What German Politicians Think of Google Glass

The German government led by Chancellor Angela Merkel has not had the easiest relationship with Google. The company launched a public campaign against a law backed by her coalition that would require search engines to pay to show news articles in search results, with mixed results. What's more, Google has long had to navigate the privacy waters in Germany and throughout the European Union. But that has not stopped her federal minister for economics and technology, Philipp Rösler, from giving Google Glass an enthusiastic test run as he leads a delegation of German technology companies and politicians on a trip to Silicon Valley this week as part of German Valley Week. GO

Crowdsourcing Waste Management Solutions in Montenegro

For once we aren't talking about the worldwide scarcity of toilets, just good old-fashioned household waste. Montenegro has a garbage problem so bad even the tourists are complaining about it. A new mobile app sponsored by the Agency for Environmental Protection, NGO Ozon and United Nations Development Programme in Montenegro will hopefully get citizens involved in reporting illegal garbage dumps. GO

monday >

Her Majesty's Government Wants to Monetize Open Data

A new paper from the chair of the U.K. government's Open Strategy Board outlines the best practices for the government's open data policies. The government-commissioned Shakespeare Review – after author Stephan Shakespeare – looks into ways to monetize open data, and recommends an all-encompassing National Data Strategy.

GO

Will Silicon Valley "Disrupt" Politics With a Candidate for Congress?

Sean Parker, of Napster fame and now executive general partner at venture capital firm Founders Fund, has invested in political startups before. But last week, he went a step further — co-hosting a fundraising event for a candidate for Congress. Parker and SV Angel co-founder Ron Conway organized a crowd of Internet industry luminaries to support Ro Khanna, a former assistant deputy secretary in Barack Obama's Commerce Department. Khanna is preparing a challenge to Rep. Mike Honda (D-Calif.), whose newly redrawn congressional district encompasses Silicon Valley. GO

Burma's Upcoming Telecom Revolution Will Probably Not Bring Internet Freedom

Burma (Myanmar) is on the threshold of an Internet revolution, but Human Rights Watch has warned companies to proceed with caution or risk trampling Burmese citizens' rights. GO

friday >

Chilean Anti-Corruption Resource: A Crowdsourced Database of Social and Political Connections

In countries where a small minority of social circles have a majority of the political and economic power, personal relationships can affect major decision-making, a serious concern of anti-corruption activists. A new web platform stores personal profiles of key players in Chilean business and politics, complete with biographies and personal and professional connections through family, education, social circles, employers and coworkers, to make tracking social relationships and conflict-of-interest easier. Called Poderopedia (from the Spanish word for power), the project sounds kind of like LinkedIn, but the creation and management of profiles is being crowdsourced out to journalists, activists and concerned citizens.

GO

Middle Eastern Telecom Accused of Working With Saudi Arabia to Spy on Citizens

Mobily, an arm of the state-owned Middle Eastern telecom giant Etihad Etisalat, has been accused of working with Saudi Arabia to develop software that would allow the government to bypass protections for social media users. The exposé comes from Moxie Marlinspike (neé Matthew Rosenfield), an expert in a certain type of malicious Internet attack called MITM (man-in-the-middle), whereby attackers intercept and secretly alter private messages exchanged via email and other social media platforms. GO

Saudi Religious Leader Warns Twitter Users of Consequences in the Afterlife

In late March, Saudi Arabia's top religious cleric said Twitter was for clowns and corrupters. Earlier this week, he said anyone using social media, in particular Twitter, “has lost this world and the afterlife.” His comments might be laughable, if they did not come at a time when the Saudi government is looking into monitoring or blocking social media sites and eliminating user anonymity.

GO

thursday >

What The Other Silicon Valley Immigration Group Is Doing This Month

A bipartisan coalition of political advocacy, business and tech groups are moving ahead to launch a social media blitz next week designed to persuade members of the Senate to vote in favor of immigration reform legislation supported in Silicon Valley. "We're going to create a virtual digital storm," said Jeremy Robbins in a Wednesday ... GO

The New Yorker Hopes "Strongbox" Is a Wiretap-Proof Sieve for Leaks

The New Yorker yesterday became the first outlet to implement DeadDrop, a new system for sources to submit information to journalists online in a more secure and anonymous way than, for example, email. GO

More