Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: After an upsert operation on the source collection, the count of the collection obtained through backup and recovery is not equal to the count of the source collection. #456

Open
zhuwenxing opened this issue Nov 8, 2024 · 1 comment
Assignees

Comments

@zhuwenxing
Copy link
Collaborator

Current Behavior

failed ci job: https://github.com/zilliztech/milvus-backup/actions/runs/11736563186/job/32696141533

test_milvus_restore_back_with_upsert

self = <test_restore_backup.TestRestoreBackup object at 0x7f35853fecb0>
src_name = 'restore_backup_H8CFG3XF', dist_name = 'restore_backup_H8CFG3XF_bak'
output_fields = ['*'], verify_by_query = True

    def compare_collections(self, src_name, dist_name, output_fields=None, verify_by_query=False):
        if output_fields is None:
            output_fields = ["*"]
        collection_src, _ = self.collection_wrap.init_collection(name=src_name)
        collection_dist, _ = self.collection_wrap.init_collection(name=dist_name)
        log.info(f"collection_src schema: {collection_src.schema}")
        log.info(f"collection_dist schema: {collection_dist.schema}")
        assert collection_src.schema == collection_dist.schema
        # get partitions
        partitions_src = collection_src.partitions
        partitions_dist = collection_dist.partitions
        log.info(f"partitions_src: {partitions_src}, partitions_dist: {partitions_dist}")
        assert len(partitions_src) == len(partitions_dist)
        # get num entities
        src_num = collection_src.num_entities
        dist_num = collection_dist.num_entities
        log.info(f"src_num: {src_num}, dist_num: {dist_num}")
        if not verify_by_query:
            assert src_num == dist_num
            return
        for coll in [collection_src, collection_dist]:
            is_binary = self.is_binary_by_schema(coll.schema)
            try:
                if is_binary:
                    coll.create_index(ct.default_binary_vec_field_name, ct.default_bin_flat_index,
                                      index_name=cf.gen_unique_str())
                else:
                    coll.create_index(ct.default_float_vec_field_name, ct.default_index, index_name=cf.gen_unique_str())
            except Exception as e:
                log.error(f"collection {coll.name} create index failed with error: {e}")
            coll.load()
            time.sleep(5)
        # get entities by count
        src_count = collection_src.query(
            expr="",
            output_fields=["count(*)"]
        )
        dist_count = collection_dist.query(
            expr="",
            output_fields=["count(*)"]
        )
        log.info(f"src count: {src_count}, dist count: {dist_count}")
        src_res = collection_src.query(expr=f'{ct.default_int64_field_name} >= 0',
                                       output_fields=output_fields)
        # log.info(f"src res: {len(src_res)}, src res: {src_res[-1]}")
        dist_res = collection_dist.query(expr=f'{ct.default_int64_field_name} >= 0',
                                         output_fields=output_fields)
        # log.info(f"dist res: {len(dist_res)}, dist res: {dist_res[-1]}")
>       assert len(dist_res) == len(src_res)
E       AssertionError

base/client_base.py:390: AssertionError
------------------------------ Captured log setup ------------------------------
[2024-11-08 05:27:57 - INFO - ci_test]: [setup_class] Start setup class... (client_base.py:29)
[2024-11-08 05:27:57 - INFO - ci_test]: *********************************** setup *********************************** (client_base.py:35)
[2024-11-08 05:27:57 - INFO - ci_test]: [setup_method] Start setup test case test_milvus_restore_back_with_upsert. (client_base.py:36)
------------------------------ Captured log call -------------------------------
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [Connections.connect] args: ['default'], kwargs: {'host': 'localhost', 'port': 19530} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : None  (api_request.py:31)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['int64', <DataType.INT64: 5>, ''], kwargs: {'is_primary': True} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : {'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}  (api_request.py:31)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['key', <DataType.INT64: 5>, ''], kwargs: {'is_primary': False} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}  (api_request.py:31)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['json', <DataType.JSON: 23>, ''], kwargs: {'is_primary': False} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : {'name': 'json', 'description': '', 'type': <DataType.JSON: 23>}  (api_request.py:31)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['var_array', <DataType.ARRAY: 22>, ''], kwargs: {'is_primary': False, 'element_type': <DataType.VARCHAR: 21>, 'max_capacity': 2000, 'max_length': 1500} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : {'name': 'var_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': 1500, 'max_capacity': 2000}, 'element_type': <DataType.VARCHAR: 21>}  (api_request.py:31)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['int_array', <DataType.ARRAY: 22>, ''], kwargs: {'is_primary': False, 'element_type': <DataType.INT64: 5>, 'max_capacity': 2000, 'max_length': 1500} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : {'name': 'int_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': 1500, 'max_capacity': 2000}, 'element_type': <DataType.INT64: 5>}  (api_request.py:31)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['float_vector', <DataType.FLOAT_VECTOR: 101>, ''], kwargs: {'dim': [128](https://github.com/zilliztech/milvus-backup/actions/runs/11736563186/job/32696141533#step:10:129), 'is_primary': False} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}  (api_request.py:31)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [CollectionSchema] args: [[{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'json', 'description': '', 'type': <DataType.JSON: 23>}, {'name': 'var_array', 'description': '', 'type': <DataType.ARR......, kwargs: {'primary_field': None, 'auto_id': False} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'json', 'description': '', 'type': <DataType.JSON: 23>}, {'name': 'var_a......  (api_request.py:31)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [Connections.has_connection] args: ['default'], kwargs: {} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : True  (api_request.py:31)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_request)  : [Collection] args: ['restore_backup_H8CFG3XF', {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'json', 'description': '', 'type': <DataType......, kwargs: {'consistency_level': 'Strong', 'shards_num': 2} (api_request.py:56)
[2024-11-08 05:27:57 - DEBUG - ci_test]: (api_response) : <Collection>:
-------------
<name>: restore_backup_H8CFG3XF
<description>: 
<schema>: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: ......  (api_request.py:31)
[2024-11-08 05:27:58 - DEBUG - ci_test]: (api_request)  : [Collection.insert] args: [[[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76,......, kwargs: {'timeout': 120} (api_request.py:56)
[2024-11-08 05:27:58 - DEBUG - ci_test]: (api_response) : (insert count: 3000, delete count: 0, upsert count: 0, timestamp: 453782714004537349, success count: 3000, err count: 0  (api_request.py:31)
[2024-11-08 05:27:58 - INFO - ci_test]: [test][2024-11-08T05:27:58Z] [0.22896255s] restore_backup_H8CFG3XF insert -> (insert count: 3000, delete count: 0, upsert count: 0, timestamp: 453782714004537349, success count: 3000, err count: 0 (wrapper.py:30)
[2024-11-08 05:27:58 - DEBUG - ci_test]: (api_request)  : [Collection.upsert] args: [[[0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76,......, kwargs: {'timeout': 120} (api_request.py:56)
[2024-11-08 05:27:58 - DEBUG - ci_test]: (api_response) : (insert count: 100, delete count: 100, upsert count: 100, timestamp: 453782714017644545, success count: 100, err count: 0  (api_request.py:31)
[2024-11-08 05:27:58 - INFO - ci_test]: [test][2024-11-08T05:27:58Z] [0.01579456s] restore_backup_H8CFG3XF upsert -> (insert count: 100, delete count: 100, upsert count: 100, timestamp: 453782714017644545, success count: 100, err count: 0 (wrapper.py:30)
[2024-11-08 05:28:46 - DEBUG - ci_test]: 
method: post, 
url: http://localhost:8080/api/v1/create, 
cost time: 48.494401693344116, 
header: {'Content-Type': 'application/json', 'RequestId': '36a6cb4b-9d92-11ef-bd89-8[129](https://github.com/zilliztech/milvus-backup/actions/runs/11736563186/job/32696141533#step:10:130)1c22abb4'}, 
payload: {"async": false, "backup_name": "backup_4EQ0i9sH", "collection_names": ["restore_backup_H8CFG3XF"]}, 
response: {"requestId":"36e891e9-9d92-11ef-b5c9-7c1e52182904","msg":"success","data":{"id":"36e891e9-9d92-11ef-b5c9-7c1e52182904","state_code":2,"start_time":1731043678378,"end_time":1731043726856,"progress":0,"name":"backup_4EQ0i9sH","size":0,"milvus_version":"f813fb4"}} (milvus_backup.py:20)
[2024-11-08 05:28:46 - INFO - ci_test]: create_backup {'requestId': '36e891e9-9d92-11ef-b5c9-7c1e52182904', 'msg': 'success', 'data': {'id': '36e891e9-9d92-11ef-b5c9-7c1e52182904', 'state_code': 2, 'start_time': 1731043678378, 'end_time': 1731043726856, 'progress': 0, 'name': 'backup_4EQ0i9sH', 'size': 0, 'milvus_version': 'f813fb4'}} (test_restore_backup.py:827)
[2024-11-08 05:28:46 - DEBUG - ci_test]: 
method: get, 
url: http://localhost:8080/api/v1/list, 
cost time: 0.005869150161743164, 
header: {'Content-Type': 'application/json', 'RequestId': '53d01028-9d92-11ef-bd89-81291c22abb4'}, 
payload: null, 
response: {"requestId":"53d05c1f-9d92-11ef-b5c9-7c1e52182904","msg":"success","data":[{"id":"2e7fdea3-9d92-11ef-b5c9-7c1e52182904","state_code":2,"start_time":1731043664270,"end_time":1731043673836,"progress":0,"name":"backup_3nS7IV9n","size":42305,"milvus_version":"f813fb4"},{"id":"36e891e9-9d92-11ef-b5c9-7c1e52182904","state_code":2,"start_time":1731043678378,"end_time":1731043726856,"progress":0,"name":"backup_4EQ0i9sH","size":22999,"milvus_version":"f813fb4"},{"id":"36d17ec3-9d92-11ef-b5c9-7c1e52182904","state_code":2,"start_time":1731043678227,"end_time":1731043725883,"progress":0,"name":"backup_AKe2LOfx","size":3415830,"milvus_version":"f813fb4"}]} (milvus_backup.py:20)
[2024-11-08 05:28:46 - INFO - ci_test]: list_backup {'requestId': '53d05c1f-9d92-11ef-b5c9-7c1e52182904', 'msg': 'success', 'data': [{'id': '2e7fdea3-9d92-11ef-b5c9-7c1e52182904', 'state_code': 2, 'start_time': 1731043664270, 'end_time': 1731043673836, 'progress': 0, 'name': 'backup_3nS7IV9n', 'size': 42305, 'milvus_version': 'f813fb4'}, {'id': '36e891e9-9d92-11ef-b5c9-7c1e52182904', 'state_code': 2, 'start_time': 1731043678378, 'end_time': 1731043726856, 'progress': 0, 'name': 'backup_4EQ0i9sH', 'size': 22999, 'milvus_version': 'f813fb4'}, {'id': '36d17ec3-9d92-11ef-b5c9-7c1e52182904', 'state_code': 2, 'start_time': 1731043678227, 'end_time': 1731043725883, 'progress': 0, 'name': 'backup_AKe2LOfx', 'size': 3415830, 'milvus_version': 'f813fb4'}]} (test_restore_backup.py:829)
[2024-11-08 05:28:46 - DEBUG - ci_test]: 
method: get, 
url: http://localhost:8080/api/v1/get_backup, 
cost time: 0.002897977828979492, 
header: {'Content-Type': 'application/json', 'RequestId': '53d01029-9d92-11ef-bd89-81291c22abb4'}, 
payload: null, 
response: {"requestId":"53d16464-9d92-11ef-b5c9-7c1e52182904","msg":"success","data":{"id":"36e891e9-9d92-11ef-b5c9-7c1e52182904","state_code":2,"start_time":1731043678378,"end_time":1731043726856,"progress":100,"name":"backup_4EQ0i9sH","collection_backups":[{"id":"36e891e9-9d92-11ef-b5c9-7c1e52182904","state_code":0,"start_time":1731043725,"end_time":1731043726,"progress":0,"collection_id":453782694967294312,"db_name":"default","collection_name":"restore_backup_H8CFG3XF","schema":{"name":"restore_backup_H8CFG3XF","fields":[{"fieldID":100,"name":"int64","is_primary_key":true,"data_type":5},{"fieldID":101,"name":"key","data_type":5},{"fieldID":102,"name":"json","data_type":23},{"fieldID":103,"name":"var_array","data_type":22,"type_params":[{"key":"max_length","value":"1500"},{"key":"max_capacity","value":"2000"}],"element_type":21},{"fieldID":104,"name":"int_array","data_type":22,"type_params":[{"key":"max_length","value":"1500"},{"key":"max_capacity","value":"2000"}],"element_type":5},{"fieldID":105,"name":"float_vector","data_type":101,"type_params":[{"key":"dim","value":"128"}]}]},"shards_num":2,"backup_timestamp":453782713978322951,"size":22999,"has_index":false,"load_state":"NotLoad","backup_physical_timestamp":1731043725,"channel_checkpoints":{"by-dev-rootcoord-dml_2_453782694967294312v0":"CitieS1kZXYtcm9vdGNvb3JkLWRtbF8yXzQ1Mzc4MjY5NDk2NzI5NDMxMnYwEgh4ABDT9yhMBho7ZGF0YW5vZGUtMS1ieS1kZXYtcm9vdGNvb3JkLWRtbF8yXzQ1Mzc4MjY5NDk2NzI5NDMxMnYwLXRydWUgh4CQ/5WfiqYG","by-dev-rootcoord-dml_3_453782694967294312v1":"CitieS1kZXYtcm9vdGNvb3JkLWRtbF8zXzQ1Mzc4MjY5NDk2NzI5NDMxMnYxEgh4ABDT9yhMBho7ZGF0YW5vZGUtMS1ieS1kZXYtcm9vdGNvb3JkLWRtbF8zXzQ1Mzc4MjY5NDk2NzI5NDMxMnYxLXRydWUgh4CQ/5WfiqYG"}}],"size":22999,"milvus_version":"f813fb4"}} (milvus_backup.py:20)
[2024-11-08 05:35:32 - DEBUG - ci_test]: 
method: post, 
url: http://localhost:8080/api/v1/restore, 
cost time: 405.51593685150146, 
header: {'Content-Type': 'application/json', 'RequestId': '53d0102a-9d92-11ef-bd89-81291c22abb4'}, 
payload: {"async": false, "backup_name": "backup_4EQ0i9sH", "collection_names": ["restore_backup_H8CFG3XF"], "collection_suffix": "_bak"}, 
response: {"requestId":"53d1d90c-9d92-11ef-b5c9-7c1e52182904","msg":"success","data":{"id":"restore_2024_11_08_05_28_46_882472450","state_code":0,"start_time":1731043726,"end_time":1731044[132](https://github.com/zilliztech/milvus-backup/actions/runs/11736563186/job/32696141533#step:10:133),"collection_restore_tasks":[{"id":"53d58957-9d92-11ef-b5c9-7c1e52182904","state_code":2,"start_time":1731043726,"target_collection_name":"restore_backup_H8CFG3XF_bak","restored_size":21475,"to_restore_size":22999,"progress":0,"target_db_name":"default"}],"restored_size":0,"to_restore_size":22999,"progress":0}} (milvus_backup.py:20)
[2024-11-08 05:35:32 - INFO - ci_test]: restore_backup: {'requestId': '53d1d90c-9d92-11ef-b5c9-7c1e52182904', 'msg': 'success', 'data': {'id': 'restore_2024_11_08_05_28_46_882472450', 'state_code': 0, 'start_time': 1731043726, 'end_time': 1731044132, 'collection_restore_tasks': [{'id': '53d58957-9d92-11ef-b5c9-7c1e52182904', 'state_code': 2, 'start_time': 1731043726, 'target_collection_name': 'restore_backup_H8CFG3XF_bak', 'restored_size': 2[147](https://github.com/zilliztech/milvus-backup/actions/runs/11736563186/job/32696141533#step:10:148)5, 'to_restore_size': 22999, 'progress': 0, 'target_db_name': 'default'}], 'restored_size': 0, 'to_restore_size': 22999, 'progress': 0}} (test_restore_backup.py:841)
[2024-11-08 05:35:32 - DEBUG - ci_test]: (api_request)  : [list_collections] args: [20, 'default'], kwargs: {} (api_request.py:56)
[2024-11-08 05:35:32 - DEBUG - ci_test]: (api_response) : ['restore_backup_H8CFG3XF', 'restore_backup_4o0JOBS5_bak', 'restore_backup_XfBqHAih_bak', 'restore_backup_H8CFG3XF_bak']  (api_request.py:31)
[2024-11-08 05:35:32 - DEBUG - ci_test]: (api_request)  : [Collection] args: ['restore_backup_H8CFG3XF', None, 'default'], kwargs: {'consistency_level': 'Strong', 'shards_num': 2} (api_request.py:56)
[2024-11-08 05:35:32 - DEBUG - ci_test]: (api_response) : <Collection>:
-------------
<name>: restore_backup_H8CFG3XF
<description>: 
<schema>: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: ......  (api_request.py:31)
[2024-11-08 05:35:32 - DEBUG - ci_test]: (api_request)  : [Collection] args: ['restore_backup_H8CFG3XF_bak', None, 'default'], kwargs: {'consistency_level': 'Strong', 'shards_num': 2} (api_request.py:56)
[2024-11-08 05:35:32 - DEBUG - ci_test]: (api_response) : <Collection>:
-------------
<name>: restore_backup_H8CFG3XF_bak
<description>: 
<schema>: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT......  (api_request.py:31)
[2024-11-08 05:35:32 - INFO - ci_test]: collection_src schema: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'json', 'description': '', 'type': <DataType.JSON: 23>}, {'name': 'var_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': [150](https://github.com/zilliztech/milvus-backup/actions/runs/11736563186/job/32696141533#step:10:151)0, 'max_capacity': 2000}, 'element_type': <DataType.VARCHAR: 21>}, {'name': 'int_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': 1500, 'max_capacity': 2000}, 'element_type': <DataType.INT64: 5>}, {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}], 'enable_dynamic_field': False} (client_base.py:347)
[2024-11-08 05:35:32 - INFO - ci_test]: collection_dist schema: {'auto_id': False, 'description': '', 'fields': [{'name': 'int64', 'description': '', 'type': <DataType.INT64: 5>, 'is_primary': True, 'auto_id': False}, {'name': 'key', 'description': '', 'type': <DataType.INT64: 5>}, {'name': 'json', 'description': '', 'type': <DataType.JSON: 23>}, {'name': 'var_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': 1500, 'max_capacity': 2000}, 'element_type': <DataType.VARCHAR: 21>}, {'name': 'int_array', 'description': '', 'type': <DataType.ARRAY: 22>, 'params': {'max_length': 1500, 'max_capacity': 2000}, 'element_type': <DataType.INT64: 5>}, {'name': 'float_vector', 'description': '', 'type': <DataType.FLOAT_VECTOR: 101>, 'params': {'dim': 128}}], 'enable_dynamic_field': False} (client_base.py:348)
[2024-11-08 05:35:32 - INFO - ci_test]: partitions_src: [{"name":"_default","collection_name":"restore_backup_H8CFG3XF","description":""}], partitions_dist: [{"name":"_default","collection_name":"restore_backup_H8CFG3XF_bak","description":""}] (client_base.py:353)
[2024-11-08 05:35:32 - INFO - ci_test]: src_num: 3100, dist_num: [154](https://github.com/zilliztech/milvus-backup/actions/runs/11736563186/job/32696141533#step:10:155)6 (client_base.py:358)
[2024-11-08 05:35:48 - INFO - ci_test]: src count: data: ["{'count(*)': 3000}"] , dist count: data: ["{'count(*)': 1503}"]  (client_base.py:383)
------------- generated html file: file:///tmp/ci_logs/report.html -------------
=========================== short test summary info ============================
FAILED testcases/test_restore_backup.py::TestRestoreBackup::test_milvus_restore_back_with_upsert - AssertionError

Expected Behavior

No response

Steps To Reproduce

No response

Environment

No response

Anything else?

No response

@zhuwenxing
Copy link
Collaborator Author

/assign @wayblink

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants