My starter project for automatically interacting with web apps that require user login.
Uses a stealth plugin to bypass bot detection and the Google Cloud Gmail API to get MFA codes from your email.
- TypeScript, Node, TSX: run
.tsfiles on server - Playwright: interact with the web via chromium (Chrome, Edge, Brave), firefox, or webkit (Safari)
- Crawlee: Playwright is built for testing your own web apps. Crawlee adds a layer on top allowing you to turn it into a web scraping/automation tool.
playwright-extraandpuppeteer-extra-plugin-stealth- Google Cloud Gmail API to retrieve MFA codes
- Run
npm ito install dependencies - Open up
src/main.tsand look at what you're working with - Run
npm run startwhich will launch chromium and playwright codegen - Hit the record button and start doing whatever you'd like to automate
- Copy the code from the codegen window into
main.tsand modify as needed
See Setting up Google Cloud Gmail API.
- save data between sessions (cookies, etc)
- simulate mouse movements
- experiment with using stock browsers