[Bug]: listWithPrefix Error Occurred When Using Milvus Backup Check Or Create

[freedomfee]

Current Behavior

When I Run Check, An error occurred : storage: copier copy object The specified bucket does not exist

here is the execution log

bash-5.2# ./milvus-backup check
0.4.26 (Built on 2024-10-30T09:28:19Z from Git SHA dd4515017a2d2f7c9493070fe321156a6c9126d4)
config:backup.yaml
[2024/11/22 12:52:42.338 +08:00] [INFO] [logutil/logutil.go:165] ["Log directory"] [configDir=]
[2024/11/22 12:52:42.338 +08:00] [INFO] [logutil/logutil.go:166] ["Set log file to "] [path=logs/backup.log]
[2024/11/22 12:52:42.338 +08:00] [DEBUG] [core/backup_context.go:68] ["Start Milvus client"] [endpoint=milvus.copilot.svc.cluster.local:19530#:tcp://11.166.235.224:19530]
[2024/11/22 12:52:42.348 +08:00] [DEBUG] [core/backup_context.go:161] ["create milvus storage client"] [address=copilot-minio:9000] [bucket=milvus-bucket] [backupBucket=backup-bucket-1121]
[2024/11/22 12:52:42.365 +08:00] [INFO] [storage/minio_chunk_manager.go:144] ["minio chunk manager init success."] [bucketname=milvus-bucket] [root=file]
[2024/11/22 12:52:42.379 +08:00] [DEBUG] [core/backup_context.go:192] ["create backup storage client"] [address=39.156.134.237:80] [bucket=milvus-bucket] [backupBucket=backup-bucket-1121]
[2024/11/22 12:52:42.510 +08:00] [INFO] [storage/minio_chunk_manager.go:144] ["minio chunk manager init success."] [bucketname=backup-bucket-1121] [root=backup]
[2024/11/22 12:52:42.604 +08:00] [DEBUG] [core/backup_context.go:708] ["check copy"] [srcBucket=milvus-bucket] [destBucket=backup-bucket-1121] [key=file/milvus_backup_check_src_1732251162] [destKey=backup/milvus_backup_check_dst_1732251162]
[2024/11/22 12:52:42.615 +08:00] [DEBUG] [storage/copier.go:260] [copyRemote] [srcBucket=milvus-bucket] [destBucket=backup-bucket-1121] [key=file/milvus_backup_check_src_1732251162] [destKey=backup/milvus_backup_check_dst_1732251162]
[2024/11/22 12:52:42.659 +08:00] [WARN] [storage/minio_chunk_manager.go:425] ["failed to list with prefix"] [bucket=milvus-bucket] [prefix=file/milvus_backup_check_src_1732251162] [error="The specified bucket does not exist"]
[2024/11/22 12:52:42.659 +08:00] [WARN] [storage/minio_chunk_manager.go:437] ["listWithPrefix error"] [bucket=milvus-bucket] [prefix=file/milvus_backup_check_src_1732251162] [error="The specified bucket does not exist"]
Failed to copy file from milvus storage to backup storage
Milvus version: v2.4.6
Storage:
milvus-bucket: milvus-bucket
milvus-rootpath: file
backup-bucket: backup-bucket-1121
backup-rootpath: backup
storage: copier copy object The specified bucket does not exist

and i alao use "mc watch " at the same time, found out the the checkobject has successfully created.

here is part of my config

# Related configuration of minio, which is responsible for data persistence for Milvus.
minio:
  # Milvus storage configs, make them the same with milvus config
  storageType: "minio" # support storage type: local, minio, s3, aws, gcp, ali(aliyun), azure, tc(tencent)
  address: copilot-minio # Address of MinIO/S3
  port: 9000   # Port of MinIO/S3
  accessKeyID: minioadmin  # accessKeyID of MinIO/S3
  secretAccessKey: minioadmin # MinIO/S3 encryption string
  useSSL: false # Access to MinIO/S3 with SSL
  useIAM: false
  iamEndpoint: ""
  bucketName: "milvus-bucket" # Milvus Bucket name in MinIO/S3, make it the same as your milvus instance
  rootPath: "file" # Milvus storage root path in MinIO/S3, make it the same as your milvus instance

Expected Behavior

No response

Steps To Reproduce

No response

Environment

No response

Anything else?

No response

[wayblink]

@freedomfee Well, the error message is clear. Does this the bucket exist?