Pup(Parallel URL Pattern) Sniffer is an efficient multilingual web corpus tool. PupSniffer supports crawling from file systems. This is due to that the internal crawler used in PupSniffer is not a full-featured crawler. Thus external web crawling tools, such as wget or Apach Nutch, are encouraged for using. When the crawling job is done, point PupSniffer to the saving directory and it will read the local web pages and analyze
URL patterns.
Comments