GOVCOMORG FOUNDATION Tools < Issue Crawler Allied Tool Set

IssueCrawler at the exhibition

The functionality / accuracy of these scripts varies as they are pretty old and will be replaced by the Issuescraper, which is currently in pre-beta.

scrapeGoogle - Query a set of sites appearing in an issue network. Query that set of sites to see which organizations work in which sub- issue areas or use particular language.
IssueGeographer - Show on a geographical map where organizations in an issue network are based.

These tools appear in the Issue Crawler Back-End Movie.

More tools:

googleNews - query news by google
robots.txt stripper - display a site's robot exclusion policy. Enter URL and see which parts of the site are blocked from indexing (acknowledgement).
googleImages - Query a set of sites appearing in an issue network for images. Query that set of sites to see which organizations display which images for a particular sub- issue area or particular language.
imagesDeep - get all the images from a deeplink.

Scripts are written in php by Erik Borra and Koen Martens, Sonologic.nl.

 

MENU