8000 GitHub - kenjiding/job-information-crawler: linkedin, seek job information crawler
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

kenjiding/job-information-crawler

Repository files navigation

Got it! Here's a polished and professional version of your README.md for the job-information-crawler project. I've improved clarity, structure, and consistency while preserving your original intent:


job-information-crawler

job-information-crawler is a Node.js-based web automation tool for scraping job listings from LinkedIn and Seek. It automates the job search process and exports data for further use.

演示动图


📌 Features

  • 🔍 Scrapes job information from LinkedIn and Seek
  • ⚙️ Web page automation using Puppeteer
  • 📁 CSV file generation using csv-writer
  • 📅 Date handling with dayjs
  • 🔐 Environment variable configuration support
  • 💾 Optional database interaction support
  • 📧 Email notification system for job updates

📦 Installation

Requirements:

  • Node.js (Latest LTS version recommended)

Clone the repository and install dependencies:

git clone https://github.com/kenjiding/job-information-crawler.git
cd job-information-crawler
npm install

🛠 Configuration

Before running the project, create a .env file in the root directory and provide the required credentials:

# LinkedIn credentials
LINKEDIN_EMAIL='your_linkedin_email'
LINKEDIN_PASSWORD='your_linkedin_password'

# Seek credentials
SEEK_EMAIL='your_seek_email'
SEEK_PASSWORD='your_seek_password'

# Email sender credentials (for job alerts)
SENDER_EMAIL='sender_email'
SENDER_EMAIL_PASSWORD='sender_email_password'
SENDER_EMAIL_TARGET='target_email_to_receive_notifications'

🚀 Usage

Run the crawler:

npm run start

You can customize the search behavior in ./src/index.ts:

start.linkedin(...).seek(...);
start.seek(...).linkedin(...);
start.linkedin(...);
start.seek(...);

🔎 Search Options

Here’s an example of the available options:

{
  username: 'your_email',
  password: 'your_password',
  keywords: 'developer',
  location: 'Adelaide',
  filterAlreadyApply: true, // Optional
  titleIncludes: 'engineer', // Optional
  ignores: ['senior', 'manager'], // Optional
  filter: {
    // Add custom filter logic here
  },
  pages: 3 // Number of pages to search
}

✅ To Do / Improvements

  • Add support for more job platforms (e.g., Indeed, Glassdoor)
  • Add database storage for job results
  • Enhance email formatting and scheduling
  • Add unit tests and error handling

📄 License

MIT


如果你还想添加 Logo、运行截图或数据库使用说明也可以告诉我,我可以帮你继续完善。需要我帮你生成一个 .env.example 文件也没问题!

About

linkedin, seek job information crawler

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published
0