The Guardian was the first news organization to really harness the power of crowdsourced data with its MP expenses database.

Now it has the lofty goal of distributing its technology worldwide to expose wrongdoing.

The man who has the job of opening up The Guardian‘s data technology told an audience at the Mesh technology conference in Toronto this morning: “The plan is to make the API (Application Programming Interface) open source.”

“We’re also exploring the possibility of making it a data clearinghouse,” in essence, allowing other people to upload their own data.

Chris Thorpe, The Guardian’s Developer Advocate for its Open Platform, set out the grand goal of  helping the oppressed and the impoverished worldwide. “We want to heal the world,” he said. “Openness is the friend of good.”

In June 2009, The Guardian hired a programmer for a week and built a portal to distribute more than 400,000 government documents of MPs’ expenses. The project prompted thousands of people to join The Guardian’s reporting team in pouring through claims and highlighting ones for further investigation. It was a huge step forward in newsgathering.

The Guardian API aims “to shine light on corruption,” Thorpe said. ”Let’s be a world liberal voice.”

The audience pressed Thorpe to state The Guardian’s stance on the current trend toward news paywalls. To that, he said, ”The people putting up paywalls will really reduce their influence in the world.”

“We’re seeing good advertising revenue from being open,” he added, but refused to talk numbers.

He said The Guardian is starting to realize “We have to behave more like a newspaper” by increasing audience engagement with more in-depth content.

“What we’re finding is the more pages people view, the more people are likely to click on adverts,” he said.

Captured Tues., June 23, 2009, 1:30 AT

If anyone needed evidence of the value of a competitive news industry, the Guardian provided it last week.

Its rival the Telegraph had uncovered the biggest British political scandal in decades by revealing widespread abuses in MPs’ expense claims. But the Guardian took the investigation to a new level last Thursday.

The British newspaper media outlet announced it was launching a site to crowdsource the analysis of expense records — 700,000 individual documents released by House of Commons. The records represent four years of expenses for all 646 members of parliament. The Guardian’s site offers “citizen journalists” the opportunity to comb each of a half million claims and recommend it for further investigation. On Sunday, the Guardian reported that nearly 20,000 people had examined 160,000 records.

The effort is easily the most ambitious attempt at crowdsourcing ever. Vancouver-based public policy blogger David Eaves points out three benefits:

1. the analysis would have been impossible otherwise
2. it has created a new benchmark of accountability for members of elected office
3. it has provided the Guardian a strong level of engagement with its readers

As Jay Rosen learned with Assignment Zero, crowdsourcing isn’t easy. That’s why comments by the Guardian’s developer on the project, Simon Willison, are so interesting. In an interview with Nieman Lab’s Michael Andersen, he underlines the importance of showing people the results of their collaboration:

“Any time that you’re trying to get people to give you stuff, to do stuff for you, the most important thing is that people know that what they’re doing is having an effect. It’s kind of a fundamental tenant of social software. … If you’re not giving people the ‘I rock’ vibe, you’re not getting people to stick around.”

Willison says it was important to liken the site’s user experience to a video game. (Real-time?) results on the site’s home page offer measureable encouragement to participants — the score. And photos of the MP’s smiling face above each claim provide the narrative. The combination has been a key driver of user participation, Willison says.