8000 GitHub - kkkzzg/jd_spider: get_phone_info
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

kkkzzg/jd_spider

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 

Repository files navigation

jd_spider

Scrapy Samsung all the smart phone's model name and pricing from http://www.jd.com/ and save them into CSV file

An asterisk being added after the model name if it's sold by JD

Usage:

1.Make sure your mac has installed with Firefox(47.0.1) Python(2.6) Scrapy(1.3.3) Selenium(2.53.6)  

2.Open iterm and go to the below directory

  /tutorial/tutorial/

3.Make sure your python path is correct. if not, run following command

  export PYTHONPATH=$(pwd)

4.Run following command to start the project

  scrapy crawl jd_phone

The Firefox browser will automatically open

5.Once the task finished, the Firefox browser will automatically shut down and the CSV file will save into the current directory, the file name is "result_phone.csv"

About

get_phone_info

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

0