- ClockWrapper for efficient clock management in Spark Streaming jobs.
- Base traits for testing Spark, Spark Streaming and Spark SQL to eliminate boilerplate code.
- Sample applications to show how to make your code testable.
- All tests can be run or debugged directly from IDE, or using SBT.
- All test fixtures are prepared as in-memory data structures.
- SBT is configured to avoid problems with multiple Spark contexts in the same JVM SPARK-2243.
- SBT is configured to prepare project assembly for deployment on the cluster.
-
Notifications
You must be signed in to change notification settings - Fork 137
Spark, Spark Streaming and Spark SQL unit testing strategies
License
mkuthan/example-spark
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
Spark, Spark Streaming and Spark SQL unit testing strategies
Topics
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published