-
Notifications
You must be signed in to change notification settings - Fork 9.1k
HDDS-1216. Change name of ozoneManager service in docker compose file… #553
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…s to om. Contributed by Ajay Kumar.
Secure S3 test Failure | ||
Run Keyword Install aws cli | ||
${rc} ${result} = Run And Return Rc And Output aws s3api --endpoint-url ${ENDPOINT_URL} create-bucket --bucket bucket-test123 | ||
Should Be True ${rc} > 0 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
whitespace:tabs in line
Execute kinit -k testuser/${hostname}@EXAMPLE.COM -t /etc/security/keytabs/testuser.keytab | ||
${result} = Execute ozone sh s3 getsecret | ||
${accessKey} = Get Regexp Matches ${result} (?<=awsAccessKey=).* | ||
${secret} = Get Regexp Matches ${result} (?<=awsSecret=).* |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
whitespace:tabs in line
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we remove this change from here? As this Jira purpose is not for this.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1 to move it to a separate Jira. Let's keep only ozoneManager -> om refactoring changes in this patch.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
removed s3 related changes, HDDS-1043 will have them.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Still we have a few of them (commonawslib, docker-config)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@elek thanks for catching that, removed from both files (commonawslib, docker-config).
💔 -1 overall
This message was automatically generated. |
Execute kinit -k testuser/${hostname}@EXAMPLE.COM -t /etc/security/keytabs/testuser.keytab | ||
${result} = Execute ozone sh s3 getsecret | ||
${accessKey} = Get Regexp Matches ${result} (?<=awsAccessKey=).* | ||
${secret} = Get Regexp Matches ${result} (?<=awsSecret=).* |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we remove this change from here? As this Jira purpose is not for this.
hadoop-ozone/dist/src/main/smoketest/security/ozone-secure.robot
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
And also can we fix jenkins checkstyle issues?
image: apache/hadoop-runner | ||
privileged: true #required by the profiler | ||
volumes: | ||
- ../..:/opt/hadoop | ||
ports: | ||
- 9874:9874 | ||
environment: | ||
ENSURE_OM_INITIALIZED: /data/metadata/ozoneManager/current/VERSION | ||
ENSURE_OM_INITIALIZED: /data/metadata/om/current/VERSION |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Here we have changed to om, will be this be same as service name when path is created?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
changed this for consistency purpose. IMO path can be independent of service name.
@@ -78,7 +78,7 @@ execute_tests(){ | |||
TITLE="Ozone $TEST tests with $COMPOSE_DIR cluster" | |||
set +e | |||
OUTPUT_NAME="$COMPOSE_DIR-${TEST//\//_}" | |||
docker-compose -f "$COMPOSE_FILE" exec -T ozoneManager python -m robot --log NONE --report NONE "${OZONE_ROBOT_OPTS[@]}" --output "smoketest/$RESULT_DIR/robot-$OUTPUT_NAME.xml" --logtitle "$TITLE" --reporttitle "$TITLE" "smoketest/$TEST" | |||
docker-compose -f "$COMPOSE_FILE" exec -T om python -m robot --log NONE --report NONE "${OZONE_ROBOT_OPTS[@]}" --output "smoketest/$RESULT_DIR/robot-$OUTPUT_NAME.xml" --logtitle "$TITLE" --reporttitle "$TITLE" "smoketest/$TEST" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
whitespace:tabs in line
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
not sure what is the problem here, change involves just rename.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
IMHO, you modified a line which already contained a tab.
This comment has been minimized.
This comment has been minimized.
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1. Tested locally, and all the acceptance tests are failed.
I can confirm that no new tabs are introduced (checked with git diff --word-diff=color --cached
)
Merged. Thanks you very much @ajayydv the contribution. I am very happy that we started to use the shorter names. |
We require visibility into how effectively host-affinity performs. The goal is to help easily answer the following questions. - How effectively is YARN matching my preferred-host requests - When does Samza fallback to abandoning locality and issuing any-host requests? design doc: https://docs.google.com/document/d/1oeNKDnG4JIGT2846us-jpnGW_RUjMjPIKDeEUlE_-jg/edit# Author: Jagadish <jvenkatraman@linkedin.com> Reviewers: Prateek M<pmaheshw@linkedin.com> Closes apache#553 from vjagadish1989/hostaffinity-metrics
…s to om. Contributed by Ajay Kumar.