8000 [Bug] When a Storage Volume path ends with '/' (Trailing slash), Automated Cluster Snapshot feature does not working properly. · Issue #58569 · StarRocks/starrocks · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

[Bug] When a Storage Volume path ends with '/' (Trailing slash), Automated Cluster Snapshot feature does not working properly. #58569

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
8000 Open
ebongzzang opened this issue Apr 29, 2025 · 1 comment
Open

[Bug] When a Storage Volume path ends with '/' (Trailing slash), Automated Cluster Snapshot feature does not working properly. #58569

ebongzzang opened this issue Apr 29, 2025 · 1 comment
Assignees
@srlch
Labels
type/bug Something isn't working

Comments

@ebongzzang
Copy link
Contributor
ebongzzang commented Apr 29, 2025 •
edited
Loading

Problem

  • When creating a Storage Volume with the last character of the location set as '/', and enabling the automated cluster snapshot feature for that volume, all snapshot jobs fail. Additionally, when trying to turn off the snapshot feature to replace the storage volume, the following error occurs and it cannot be turned off.

  • information_schema.cluster_snapshot_jobs

upload image failed, err msg: Failed to copy local /opt/starrocks/fe/meta/image to s3://${BUCKET}//${ID}/meta/image/automated_cluster_snapshot_1745852415046
  • error that occurs when running ADMIN SET AUTOMATED CLUSTER SNAPSHOT OFF
Wrong FS s3://${ID}//meta/image/automated_cluster_snapshot_1745851135850 -expected s3://${BUCKET}

Steps to reproduce the behavior (Required)

  1. Create Storage Volume with trailing slash
CREATE STORAGE VOLUME s3_backup
TYPE = S3
LOCATIONS = ("s3://{BUCKET}/")
PROPERTIES
(
    "enabled" = "true",
    "aws.s3.region" = "ap-northeast-2",
    "aws.s3.use_aws_sdk_default_behavior" = "true"
);
  1. Enable Automated cluster snapshot
ADMIN SET AUTOMATED CLUSTER SNAPSHOT ON STORAGE VOLUME s3_backup
  1. Attempting to disable the cluster snapshot feature after Snapshot Job failure
ADMIN SET AUTOMATED CLUSTER SNAPSHOT  off;

Expected behavior (Required)

  1. Even if a trailing slash is included at the end of a storage volume, it should function normally. Alternatively, when activating the Cluster snapshot function, validation should be performed to prevent setting an incorrect path for the snapshot storage location.
  2. It should be possible to terminate the cluster snapshot function even if an incorrect Storage volume path has been configured.

Real behavior (Required)

  1. All snapshot jobs are failed.
  2. Unable to deactivate automated cluster snapshot function.

StarRocks version (Required)

  • You can get the StarRocks version by executing SQL select current_version()
  • 3.4.2-c15ba7c
@ebongzzang ebongzzang added the type/bug Something isn't working label Apr 29, 2025
@ebongzzang ebongzzang changed the title When a Storage Volume path ends with '/' (Trailing slash), Automated Cluster Snapshot feature does not working properly. [Bug] When a Storage Volume path ends with '/' (Trailing slash), Automated Cluster Snapshot feature does not working properly. Apr 29, 2025
@srlch
Copy link
Contributor
srlch commented May 7, 2025

@ebongzzang Hi, could you try"aws.s3.use_aws_sdk_default_behavior" = "false"?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@srlch srlch

Labels
type/bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@ebongzzang @srlch
0