Crawl data from AniList API and store as json in file system, MariaDB, or elasticsearch.
- Node.js >= 20.12
- MariaDB >= 10.5 (optional)
- elasticsearch >= 7.0 (optional)
-
Clone this repository
-
npm install -
copy
.env.exampleand rename to.env -
Configure
.envfor your mariaDB, or elasticsearch, leave any of DB_HOST, ES_HOST, FS_DIR empty if you don't need it
Fetch anime ID 123
node index.js --anime 123
Fetch all anime in page 240
node index.js --page 240
Fetch all anime from page 240 to 244 (inclusive)
node index.js --page 240-244
Fetch all anime from page 240 to the last page
node index.js --page 240-
Sometimes anime would be deleted from AniList, but it still exists locally in your database. You can use --clean to get a clean copy every time you start crawling.
node index.js --clean --page 240-
For details of AniList API please visit https://github.com/AniList/ApiV2-GraphQL-Docs/
You can try the interactive query tool here. https://anilist.co/graphiql
- API request limit exceed (HTTP 429) has not been handled yet. With 60 requests/min per IP, it is unlikely to hit the limit with complex query.