(TheyWorkForYou.com is a website to get information about political representatives in the UK, while WriteToThem.com can be used to contact these representatives)

These reports are for you if you want to know:

• how popular the sites are: You get detailed usage stats dating back to the inception of the sites.
• who is using the site: We carried out a survey of users, comparing their demographic profile to that of the British (Internet) population.
• what the sites cost to build and maintain: There is a summary table, comparing the costs of the respective site to other mySociety projects.
• how the site came to be what they are: You find information on the history of the sites as well as some interesting stories around them.
• and much much more

Overall, these documents offer a comprehensive picture of two political websites that have hundreds of thousands of users every year. The official release post gives a good summary of the results, as do the executive summaries at the beginning of each report. What I wanted to share here briefly, is some background on the creation of these reports and my understanding of this research:

Several years ago, Tom Steinberg of mySociety asked me carry out an evaluation of the major mySociety sites. The aim was to create a framework with some key indicators that could be measured and compared across different websites of mySociety. At that time, it was not entirely clear what aspects such an evaluation should cover. We envisaged some value-for-money analysis, but what exactly was the “value” that the sites brought? We finally decided to focus on the people who use the site: Are these the usual political animals, or can the site engage people who are traditionally rarely involved in politics, such as people with a low income and/or without a degree from higher education. We carried out extensive surveys of users of these websites and compared their demographics with data from the British population. This reference data that was provided by our very own Oxford Internet Institute’s Oxford Internet Survey – Thank you very much!

But the reports are much more than that: They collect a vast variety of information about the sites, such as statistics on visitor numbers for the last years, popular content sections or the number of messages sent to MPs and other representatives (via WriteToThem), a history of the site, some interesting anecdotes as well as some background about the ecosystem in which these sites evolve. It has turned out that compiling this information has been a major task, as it entails collecting bits and pieces from various parts of the organisation. In the process we chose to apply a new web traffic analyser (Piwik), all in order to get consistent and comparable data from all the sites.

The reports are first of all important for mySociety itself, in order to create a better understanding of how the sites work and what users are looking for. Beyond this, these reports are intended for a wide range of audiences:

1. eDemocracy practitioners – to learn for their sites
2. researchers in online political participation – to get information on the performance of large-scale projects
3. journalists – as the reports show where the sites have made an impact in the political landscape
4. potential funders – to see what can be achieved

What I hope the research results show is that engaging citizens with the help of the Internet is neither simple nor impossible, and that there are few simple answers in relation to whether the Internet is good for democracy [my PhD focuses on this question in much more detail, using some of the data from this research]. In addition, I hope it encourages other projects in this area to open up their efforts to the same level of scrutiny. From my experiences, I know that it is often somewhat difficult for NGOs to engage in evaluation, for lack of money or time, and sometimes also for a lack of understanding of why this is useful. However, I firmly believe that it is crucial to do evaluation both to get some critical assessment of one’s own achievements – to help improve the site – as well as to give other initiatives in this space the chance to learn from the successes and failures of others.

In this regard, I hope the reports reach a wide audience. We very much encourage feedback, both on the results of the report as well as on the methodology applied. We decided to start with WriteToThem and TheyWorkForYou, but the plan is to publish more reports on sites such as FixMyStreet.com, WhatDoTheyKnow.com, PledgeBank.com etc.

Disclaimer: mySociety gave me money to do this research, and they provided data, help and advice throughout the process. However, at no point did they interfere with the results or question my interpretation of the findings.

The truly amazing finding is that people who use the site are not the ones who are already politically engaged and organized. Those are using the site too but many have never before contacted their representative and most are not politically active at all – so here we observe a clear effect of engagement as the site activates people to participate politically who have not done so before.

Another interesting finding is that many citizens make very positive experiences when using the site to contact their representatives. Given a general climate of distrust between represented and representatives many user comments indicate a profound surprise at the respect and help they receive from their politicians. Crucially we can observe that the online experiences do at times translate into political participation offline e.g. in the form of voting as the quote below nicely illustrates:

“Mr [name of representative] went above and beyond what I expected to get, I thought I would just be totally ignored, this experience has made me decide to definitely vote in the next elections”

However, of course it also works exactly the other way around which should be a clear sign of warning for many of those politicians who do rarely reply to their constituents (see for example the MP responsiveness league table) as this participant makes clear:

“What’s the point when your councillor doesn’t reply? He’s not getting my vote in the next election, nor from any of my nuclear and extended families and I’ll tell everyone at work about my lack of a reply as well. 23 of them live in his constituency.“

For more details see the presentation (pdf, 2.6MB).

The results are based on a user survey I set up on behalf of mySociety as part of a bigger project that aims to evaluate the impact of many of their by now well-known eDemocracy websites (e.g. TheyWorkForYou.com or FixMyStreet.com). There is much more to come so keep an eye on this space. Also, if there are certain questions of particular interest to you in relation to mySociety projects that you think could/should/might be answered by this research, do drop me a line or comment below!

While this is mainly a summary of the problems, in the coming weeks I will talk about some of my own attempts to find answers to this question. For some time now I have been busy working for mySociety to evaluate the usage of their main sites (such as WriteToThem.com and TheyWorkForYou.com) and I will be speaking about some initial findings from this work at the upcoming e-Democracy ’08 conference in London on 11 November and earlier at an academic conference in Germany. If you cannot make it to either of them stay tuned as there should be more information on this in the near future and I would love to get your views.

Last but not least the article in the E-Government Bulletin naturally does not carry any references but I owe some of my insights to these people below:

• Forss, K. (2005). Evaluating Public Participation in Policy Making. Paris, OECD.
• Macintosh, A. and S. Coleman (2007). eParticipation Research Direction based on barriers, challenges and needs, DEMO-Net Deliverable 12.3.
• Macintosh, A. and A. Whyte (2008). “Towards an Evaluation Framework for eParticipation.” Transforming Government: People, Process & Policy 2(1)