Description
Code reference :
spark-shell --jars C:\bigdata\cos_jar\hadoop-common-3.4.0.jar,C:\bigdata\cos_jar\stocator-1.1.5.jar,C:\bigdata\cos_jar\hadoop-aws-3.3.6.jar,C:\bigdata\cos_jar\aws-java-sdk-bundle-1.12.769.jar
spark.sparkContext.hadoopConfiguration.set("fs.cos.service.endpoint", "XXXX")
spark.sparkContext.hadoopConfiguration.set("fs.cos.service.access.key","XXX")
spark.sparkContext.hadoopConfiguration.set("fs.cos.service.secret.key","XXXX")
spark.sparkContext.hadoopConfiguration.set("fs.cos.connection.ssl.enabled", "false")spark.range(5).write.format("parquet").save("cos://BucketName.service/icos_spark_test")
Even after setting this ssl verification flag as false, it is verifying ssl and getting below error
com.amazonaws.SdkClientException: Unable to execute HTTP request: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.handleRetryableException(AmazonHttpClient.java:1134)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.executeHelper(AmazonHttpClient.java:1080)
at com.amazonaws.http.AmazonHttpClient$RequestExecutor.doExecute(AmazonHttpClient.java:745)