此项目实现了使用EMR on EKS的Spark 任务，从S3存储桶中读取csv文件写入到MySQL中。
环境准备工作请参考环境准备
任务执行步骤请参考任务执行
文件清单
| 文件名称 | 用途 |
|---|---|
| ny-taxi.csv | csv原始数据 |
| spark-job.py | 任务执行脚本（PySpark） |
| mysql-connector-java-5.1.47-bin.jar | MySQL JDBC连接jar包 |
| job-config.json | 任务定义文件 |
-
Notifications
You must be signed in to change notification settings - Fork 0
ywyang/emr-on-eks-demo
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published