GitHub - yzwetsloot/civilis: High-performance link crawler written in Rust, built using a test-driven development approach. Utilizes a custom, thread-safe graph structure underneath and uses pre-commit and a GitHub workflow to facilitate the test & build process.
More Web Proxy on the site http://driver.im/
Y
8000
ou signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
High-performance link crawler written in Rust, built using a test-driven development approach. Utilizes a custom, thread-safe graph structure underneath and uses pre-commit and a GitHub workflow to facilitate the test & build process.
Run cargo run --bin civilis -- -h for a description of available command options and flags
Run cargo run --bin civilis -- -t 30 --depth 5 -s 100
About
High-performance link crawler written in Rust, built using a test-driven development approach. Utilizes a custom, thread-safe graph structure underneath and uses pre-commit and a GitHub workflow to facilitate the test & build process.