8000 GitHub - charliequinn/web_crawler: web crawler
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

charliequinn/web_crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

8 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Simple web crawler outputting URL, title and status code into CSV file for any given site.

Run 'rake' to run specs

Example usage:

ruby crawler.rb www.google.co.uk results.txt

About

web crawler

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

0