"Nobody can give you freedom. Nobody can give you equality or justice or anything. If you're a man, you take it." — Malcom X
- Companies Prospecting
- Distributed Crunchbase Company Scrape
- Contact Enrichment
- Customer.Io Upload
- Setup mitmproxy
brew install mitmproxy- Start the mitmproxy to disable peremetrix
mitmproxy -s mitmproxy/crunchbase.py - Setup ENV file (including AGENT_CODENAME)
- Build a list
rake list:build- Upload the list
rake list:upload- Take companies to scrape (550 Max)
rake agent:take- Scrape with the following command
rake crunchbase:scrape- Stop the scraper with
kill $(ps aux | grep '[s]crape' | awk '{print $2}')Note: This uplo 5FEC ads all contacts not just the ones assigned to the agent. It's best to run this after 5pm (MST) so that we can run enchance right after
rake contacts:processrake contacts:enrich