Accept URLs on stdin, replace all query string values with a user-supplied value, only output each combination of query string parameters once per host and path.
Example input file:
▶ cat urls.txt
https://example.com/path?
https://example.com/path?two=2&
https://example.com/pathtwo?two=2&
https://example.net/a/path?two=2&
▶ cat urls.txt | qsreplace newval
https://example.com/path?
https://example.com/pathtwo?
https://example.net/a/path?
▶ cat urls.txt | qsreplace -a newval
https://example.com/path?
https://example.com/pathtwo?
https://example.net/a/path?
You can omit the argument to -a to only output each combination of URL and query string parameters once:
▶ cat urls.txt | qsreplace -a
https://example.com/path?
https://example.com/pathtwo?
https://example.net/a/path?
With Go:
▶ go install github.com/tomnomnom/qsreplace@latest
Or download a release and put it somewhere in your $PATH
(e.g. in /usr/local/bin).