Answer by guyrt for How to download a website's html source automatically
Look at scrapy for python:http://www.scrapy.orgor crawler4j for java:http://code.google.com/p/crawler4j/
View ArticleHow to download a website's html source automatically
Does anybody know of any program where I can enter a domain name, and the program will crawl the entire domain and be able to download all of the HTML source code for me - so if the site has links on...
View Article
More Pages to Explore .....
