Then we put the data up, but the problem with Solr was it didn’t have a user interface, so we used Project Blacklight, which is open source software normally used by librarians. We used it for the journalists. It’s simple because it allows you to do faceted search—so, for example, you can facet by the folder structure of the leak, by years, by type of file. There were more complex things—it supports queries in regular expressions, so the more advanced users were able to search for documents with a certain pattern of numbers that, for example, passports use. You could also preview and download the documents. ICIJ open-sourced the code of our document processing chain, created by our web developer Matthew Caruana Galizia.
We also developed a batch-searching feature. So say you were looking for politicians in your country—you just run it through the system, and you upload your list to Blacklight and you would get a CSV back saying yes, there are matches for these names—not only exact matches, but also matches based on proximity. So you would say “I want Mar Cabra proximity 2” and that would give you “Mar Cabra,” “Mar whatever Cabra,” “Cabra, Mar,”—so that was good, because very quickly journalists were able to see… I have this list of politicians and they are in the data!
1More
GitHub focuses on making scientific research more open | opensource.com - 0 views
2More
Open source as a tool of cultural change | Opensource.com - 0 views
2More
Beginning Git and Github for Linux Users | Linux.com - 0 views
1More
HTML5.1 begins to take shape on GitHub | InfoWorld - 0 views
1More
How to choose a license for your open source project | opensource.com - 1 views
1More
Push, Pull, Fork: GitHub for Academics | Tools | HYBRID PEDAGOGY - 0 views
2More
Readium at the London Book Fair 2014: Open Source for an Open Publishing Ecosystem: Rea... - 0 views
2More
Getting Started in Open Source Software | Linux.com - 0 views
1More
Linux workstation security checklist | lfit/itpol @ GitHub - 0 views
1More
Google Code Shutting Down - InternetNews. - 0 views
2More
Governance for the GitHub generation | Open Source Software - InfoWorld - 0 views
3More
The unique qualities of people in open source | Opensource.com [# ! Note...] - 0 views
6More
The People and Tech Behind the Panama Papers - Features - Source: An OpenNews project - 0 views
1More