pkg-descr « rubygem-robotex « www - freebsd-ports-gnome - FreeBSD GNOME current development ports (https://github.com/freebsd/freebsd-ports-gnome)

index : freebsd-ports-gnome

FreeBSD GNOME current development ports (https://github.com/freebsd/freebsd-ports-gnome)

about summary refs log tree commit diff stats

path: root/www/rubygem-robotex/pkg-descr

blob: 9f080f6075c5864030e3c65c8bdc7bf70f22c474 (plain) (blame)

1
2
3

A simple library to obey robots.txt files

WWW: https://github.com/chriskite/robotex