The challenge
As noted in Open Data Stories’ first story, there are calls from various quarters for more data on the utility of governments releasing data and other material for re-use.
The challenge would seem to be this: if people and organisations want governments to continue to invest in open data initiatives, they should jump into the feedback loop and tell governments, and the world, when they are putting open government data to good use. The scale or nature of beneficial use shouldn’t matter. It might be economic, creative, cultural or environmental. Or it could be something else. But tell us your story. Equally, interested stakeholders such as Creative Commons, the Open Knowledge Foundation and the Sunlight Foundation can tell us their stories too, even if that is only drawing us to relevant (and openly licensed ) articles that we can repost on Open Data Stories. And, of course, agencies who see the data they steward being put to good use should tell us too.
Whatever the case, share your stories with others. The more you do, the richer the feedback loop and that, in turn, is likely to enable open data policies to be better developed and refined and, ultimately, to be sustainable.
Tom Johnson on 05 Oct 11Again, US-centric, but this might generate some ideas of what could be accomplish in your city/nation. Late yesterday we announced a bunch of new features for Influence Explorer: http://sunlightlabs.com/blog/2011/ie-corporate-accountability/ As the blog post explains, you can now find information about a corporation's EPA violations, federal advisory committee memberships, and participation in the rulemaking process -- all in one place. I wanted to highlight that last feature a bit more, though. To my knowledge, this is the first time that the full corpus of public comments submitted to regulations.gov has been available for bulk download and analysis. This isn't a coincidence: regulations.gov is built using technologies that make scraping it unusually difficult. This is unfortunate, since everyone seems to agree that federal rulemakings are gaining in importance -- both because of congressional gridlock that leaves the regulatory process as a second-best option, and because of calls to simplify the regulatory landscape as a pro-growth measure. It's an area where influence is certainly exerted -- rulemakers are obliged to review every comment -- but little attention is paid to who's flooding dockets with comments, and which directions rules are being pushed. It's taken us several months to develop a reliable solution and to obtain past rulemakings, but we now have the data in hand. We plan to do much more with this dataset, and we're hoping that others will want to dig in, too. You can find a link to the bulk download options in the post above -- the full compressed archive of extracted text and metadata is ~16GB, but we've provided options for grabbing individual agencies' or dockets' data. If anyone wants the original documents (PDFs, DOCs, etc) we can talk through how to make that happen, but as they clock in at 1.5TB we'll want to make sure folks know what they're getting into before we spend the time and bandwidth. Finally, note that we currently o