A little like that j-thing, only in Go.
Go 15k 937
Polite, slim and concurrent web crawler.
Go 2.1k 196
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
Go 792 92
tiny Go library to normalize URLs
Go 484 61
Package rehttp implements a Go HTTP transport that handles retries.
Go 223 18
Proper URL escaping as per RFC3986
Go 27 16
There was an error while loading. Please reload this page.
Loading…