8000 Commits · Dwarfex/robots-txt · GitHub

More Web Proxy on the site http://driver.im/

Commits

Commits on Jan 14, 2025

Added explicit matching "Allows"
Dwarfex
committed

Commits on Oct 22, 2024

Update CHANGELOG

riasvdv
authored and
github-actions[bot]
committed
avoid expensive queries that do not change certain results (#53)
elcapo
authored

Commits on Sep 25, 2024

Update CHANGELOG

riasvdv
authored and
github-actions[bot]
committed
Fixes "case-sensitive" URI matching for Disallow rules in robots.txt (#46)

mattfo0
and
matt-learneo
authored

Commits on Sep 23, 2024

Commits on Aug 9, 2024

Commits on May 14, 2024

Commits on Apr 22, 2024

Update CHANGELOG

freekmurze
authored and
github-actions[bot]
committed
wip
freekmurze
committed
Merge pull request #43 from resohead/main
freekmurze
authored

Commits on Apr 19, 2024

Commits on Apr 17, 2024

Commits on Nov 22, 2023

Update CHANGELOG

freekmurze
authored and
github-actions[bot]
committed
Update README.md
freekmurze
authored
Merge pull request #41 from buismaarten/patch-1
freekmurze
authored

Commits on Nov 20, 2023

Fix deprecation message
buismaarten
authored

0