Open
Description
Hi I left a post on the google group as well but thought it might good to cross post this here as well.
I've been using this for a while now but I thought I would say there are a few hiccups along the way when running this on a clean(-ish) mac Yosemite 10.10.x install.
Setting Java 7 home (thats my own fault...)
Maven Opts - you need to set this to something sensible or your Spark DDF Module will fail all its tests mysteriously.
Mac-mini:DDF $ java -version
java version "1.7.0_51"
Java(TM) SE Runtime Environment (build 1.7.0_51-b13)
Java HotSpot(TM) 64-Bit Server VM (build 24.51-b03, mixed mode)
Mac-mini:DDF $ echo $MAVEN_OPTS
-Xmx2048m -XX:MaxPermSize=756m
mvn --version
Apache Maven 3.1.1 (0728685237757ffbf44136acec0402957f723d9a; 2013-09-17 23:22:22+0800)
Maven home: /Users/mb_old/java/apache-maven-3.1.1
Java version: 1.7.0_51, vendor: Oracle Corporation
Java home: /Library/Java/JavaVirtualMachines/jdk1.7.0_51.jdk/Contents/Home/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "mac os x", version: "10.10.2", arch: "x86_64", family: "mac"
Pulling out MASTER from github I get this error on [mvn install]
Tests in error:
AggregationHandlerTest.setUp:19->BaseTest.createTableAirline:31 » QueryExecution
AggregationHandlerTest.setUp:19->BaseTest.createTableAirline:31 » QueryExecution
BinningHandlerTest.testBinning:22->BaseTest.createTableAirline:31 » QueryExecution
CrossValidationSuite.<init>:11->ATestSuite.createTableAirline:70 » QueryExecution
MetricsTests.testConfusionMatrix:22 » QueryExecution FAILED: Execution Error, ...
MLlibIntegrationSuite>ATestSuite.run:18->ATestSuite.org$scalatest$BeforeAndAfterAll$$super$run:18->FunSuite.org$scalatest$FunSuiteLike$$super$run:1559->FunSuite.runTests:1559->ATestSuite.runTest:18->ATestSuite.org$scalatest$BeforeAndAfterEach$$super$runTest:18->FunSuite.withFixture:1559->ATestSuite.createTableAirlineWithNA:86 » QueryExecution
MLlibIntegrationSuite>ATestSuite.run:18->ATestSuite.org$scalatest$BeforeAndAfterAll$$super$run:18->FunSuite.org$scalatest$FunSuiteLike$$super$run:1559->FunSuite.runTests:1559->ATestSuite.runTest:18->ATestSuite.org$scalatest$BeforeAndAfterEach$$super$runTest:18->FunSuite.withFixture:1559 » Hive
MLlibIntegrationSuite>ATestSuite.run:18->ATestSuite.org$scalatest$BeforeAndAfterAll$$super$run:18->FunSuite.org$scalatest$FunSuiteLike$$super$run:1559->FunSuite.runTests:1559->ATestSuite.runTest:18->ATestSuite.org$scalatest$BeforeAndAfterEach$$super$runTest:18->FunSuite.withFixture:1559 » Hive
MLSupporterSuite.<init>:10->ATestSuite.createTableAirlineSmall:54 » QueryExecution
StatisticsSupporterTest.setUp:24->BaseTest.createTableAirline:31 » QueryExecution
StatisticsSupporterTest.setUp:24->BaseTest.createTableAirline:31 » QueryExecution
StatisticsSupporterTest.setUp:24->BaseTest.createTableAirline:31 » QueryExecution
StatisticsSupporterTest.setUp:24->BaseTest.createTableAirline:31 » QueryExecution
StatisticsSupporterTest.setUp:24->BaseTest.createTableAirline:31 » QueryExecution
StatisticsSupporterTest.setUp:24->BaseTest.createTableAirline:31 » QueryExecution
StatisticsSupporterTest.setUp:24->BaseTest.createTableAirline:31 » QueryExecution
FactorSuite.<init>:8->ATestSuite.createTableMtcars:36 » QueryExecution FAILED:...
ListDDFSuite.<init>:8->ATestSuite.createTableMtcars:36 » QueryExecution FAILED...
RepresentationHandlerSuite.<init>:20->ATestSuite.createTableAirline:70 » QueryExecution
SampleSuite.<init>:8->ATestSuite.createTableMtcars:36 » QueryExecution FAILED:...
ViewHandlerTest.testRemoveColumns:17->BaseTest.createTableAirline:31 » QueryExecution
MissingDataHandlerTest.setUp:24->BaseTest.createTableAirlineWithNA:48 » QueryExecution
MissingDataHandlerTest.setUp:24->BaseTest.createTableAirlineWithNA:48 » QueryExecution
TransformationHandlerTest.setUp:20->BaseTest.createTableAirline:31 » QueryExecution
TransformationHandlerTest.setUp:20->BaseTest.createTableAirline:31 » QueryExecution
TransformationHandlerTest.setUp:20->BaseTest.createTableAirline:31 » QueryExecution
TransformationHandlerTest.setUp:20->BaseTest.createTableAirline:31 » QueryExecution
ALSTest.TestALS:13->BaseTest.createTableRatings:64 » QueryExecution FAILED: Se...
KMeansTest.TestKMeans:14->BaseTest.createTableAirline:31 » QueryExecution FAIL...
SparkDDFManagerTests.testSimpleSparkDDFManager:30->BaseTest.createTableAirline:31 » QueryExecution
Tests run: 32, Failures: 0, Errors: 30, Skipped: 0
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] ddf ............................................... SUCCESS [3.347s]
[INFO] ddf_core .......................................... SUCCESS [15.668s]
[INFO] ddf_spark ......................................... FAILURE [3:15.629s]
[INFO] ddf_examples ...................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 3:34.902s
[INFO] Finished at: Thu Apr 02 21:25:45 SGT 2015
[INFO] Final Memory: 22M/285M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.15:test (default-test) on project ddf_spark_2.10: There are test failures.
[ERROR]
[ERROR] Please refer to /Users/mb_old/scala/DDF/spark/target/scala-2.10/surefire-reports for the individual test results.
[ERROR] -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :ddf_spark_2.10
I've tried a few things but not sure what the error is or what needs fixed, any ideas?
Thanks In Advance
Michael
Metadata
Metadata
Assignees
Labels
No labels