The Dupont Group is a Concord, NH based government affairs consulting firm. (see: http://www.dupontgroup.com) Their focus is on legislation, administrative rules, government procurement and public relations. They provide advocacy and strategic planning, executive and legislative branch representation, public relations and communications services to businesses and nonprofits.
The Dupont Group needed to get daily updates on all of the bills so that they could stay on top of events and serve the needs of their clients more efficiently. The only problem was that the New Hampshire legislature website had no means of exporting data.
Keene Systems architected a solution to extract the data directly from thousands of government webpages using a technique called “Screen Scraping”. This involved building a pattern recognition rules engine to crawl the state website. It made sense of all the data on the website, parsed it and saved only the relevant information to a structured database which is used to track issues for The Dupont Group’s clients.