aboutsummaryrefslogtreecommitdiffstats
path: root/www/webcrawl
Commit message (Collapse)AuthorAgeFilesLines
* WebCrawl is a program designed to download an entire web-site withoutbillf1999-02-046-0/+47
user interaction (although an interactive mode is available). It works simply by starting with a single web page, and following all links from that page to attempt to recreate the directory structure on the remote server. PR: ports/9846 Submitted By: Dima Sivachenko <dima@Chg.RU>