A redis-based distributed search engine. Set configuration imformation in config.py. crawl is spider part, and so on.