Collect URL

Vovsoft Collect URL is web software that crawls the Internet like a search engine robot. Starting with a URL entered by the user, it lists all the links found on a web page. It then recursively continues to scan the URLs in the list.
The user can limit the URL lookup to collecting only one domain or subdomain. The list of ignored (exception) file extensions is editable. Connection timeout and response timeout values can be edited. Users can also change the user agent value for HTTP and HTTPS connections.