This python script can be used to automated program, you can query web servers, request data, and parse it to extract the information you need.
Simple Python Webscrapper that can be used retrive sensitive fields in large chunks of data such as passwords.
- I will demonstrate using the wikipedia pages.I will extract the last edited field from the pages and url.
- Scraps musician pages to get last edited day.
-
Install the requirements.txt
python -m pip install -r requirements.txt -
Open wikipedia.py to customize settings to your preffered scrapper.
-
To run script
scrapy runspider wikipedia.py