8000 libjars by coyotemarin · Pull Request #1342 · Yelp/mrjob · GitHub

More Web Proxy on the site http://driver.im/

libjars#1342

Merged

coyotemarin merged 42 commits intoYelp:masterfrom

coyotemarin:libjars

Jun 30, 2016

Commits on May 27, 2016

added (inactive) libjars action to Hadoop and EMR runners
David Marin
committed

Commits on Jun 13, 2016

Merge branch 'master' into libjars
David Marin
committed
added test of Nick Nack libjar
David Marin
committed
move -D mapreduce.job.reduces=0 before hadoop_extra_args (fixes #1331)
David Marin
committed
put -D before hadoop_extra_args (fixes #1332)
David Marin
committed
whoops, we meant to run this test on the EMR runner
David Marin
committed
update tests to accomodate -D coming before hadoop_extra_args
David Marin
committed
made HadoopExtraArgsOnEMRTestCase work correctly
David Marin
committed

Commits on Jun 15, 2016

got --libjar working on Hadoop runner. still need to run tests
David Marin
committed
added tests for libjars
David Marin
committed
integrated --libjars into Hadoop end-to-end test
David Marin
committed

Commits on Jun 17, 2016

complete implementation of libjars on EMR, with master node setup script
David Marin
committed
small fixes to --libjar on EMR. it works!
David Marin
committed
get_cluster_id() has already been added to the docs
David Marin
committed
make runner._action_on_failure() a method, not a property
David Marin
committed

Commits on Jun 18, 2016

include master node setup step in steps we check
David Marin
committed
fixed reporting of master node step failure
David Marin
committed
make it explicit that we are listing step *syslogs*
David Marin
committed
crappy broken attempt to parse script-runner.jar's stderr
David Marin
committed

Commits on Jun 23, 2016

don't bother trying to fetch counters for script-runner.jar steps
David Marin
committed
correct cause of error for failed master node setup script
David Marin
committed

Commits on Jun 24, 2016

clean up handling of stderr files for step probable cause of error
David Marin
committed
took master node setup script out of self._log_interpretations
David Marin
committed
fix error formatting test
David Marin
committed
fixed MatchEMRStepLogPathTestCase
David Marin
committed
added step stderr to path match test
David Marin
committed
check previous rotations of stderr (in case current one is blank)
David Marin
committed
loosen assumption that step logs come in sorted order
David Marin
committed
break out interpretation of step stderr logs
David Marin
committed

Commits on Jun 25, 2016

unit tested breakout of step syslog and step stderr
David Marin
committed
fixed GetStepLogInterpretationTestCase, added step stderr stuff
David Marin
committed
updated tests of EMRRunners _ls_emr_step_*() methods
David Marin
committed
added tests for master node setup script
David Marin
committed
whoops, messed up my setUp() method
David Marin
committed
verify that local libjars are uploaded
David Marin
committed
patch_fs_s3() is not needed
David Marin
committed
used mocks better in BuildStreamingStepTestCase
David Marin
committed
test -libjars for streaming steps
David Marin
committed
added explicit test for _libjar_step_args()
David Marin
committed
added libjars to JarStepTestCase
David Marin
committed
added test for BuildMasterNodeSetupStep
David Marin
committed

Commits on Jun 30, 2016

added master node setup script to WaitForStepsToCompleteTestCase
David Marin
committed

0