Is Milvus an alternative for Redis? #3923
-
|
Is Milvus an alternative for Redis? Please let me know if my understanding is correct. Can I create the indexed vectors using Milvus and push it to redis to store the same (in the offline batch processing). The same vectors is to be retrieved during online serving through the Milvus library. Or, Is Milvus a total replacement for Redis. If so, how to configure the Milvus data cache in a distributed cluster? Basically we have a production live system which uses Redis for the key storage. The RAM size requirement is too huge. We are planning to move to Vector based approach and trying to use Milvus as a solution. I am looking for an architecture to easily pluggin Milvus into the current architecure to reduce the time to market. This is the background. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 4 replies
-
|
Hi, Actually Milvus is a vector similarity search engine, unlike the traditional databases, Milvus currently only stores vectors and their corresponding ids, although we plan to store more information in future versions. So whether Milvus can totally replace Redis depends on your scenario, if the data only has vectors and ids then Milvus can. However, a lot of data contains more information than just ids, which requires access to a structured database such as Redis or MySQL. I think Milvus can really help you if you're moving vector search, it's a great option! In distributed we use shared storage, you can refer to Mishards, also Milvus-Helm. |
Beta Was this translation helpful? Give feedback.
-
|
Thank you.. |
Beta Was this translation helpful? Give feedback.
-
|
Are there thoughts/plans to either a) add redis as an alternative to mysql for the milvus storage layer, and/or b) specify a "store" interface that can use mysql, redis, etc. as a plugin? |
Beta Was this translation helpful? Give feedback.
-
We have no plan to do this. In fact, we will not provide major features on 1.0.x, but we will continue maintain it for critical bugs. As the announcement(#4800) say, we are developing a new milvus, distributed, cloud-native, golang. All the new features will be considered/designed in the new milvus. The new milvus use ETCD as meta backend. |
Beta Was this translation helpful? Give feedback.
-
|
Also, the new milvus provides stand-alone server. |
Beta Was this translation helpful? Give feedback.
Hi,
Thanks for your sharing.
Actually Milvus is a vector similarity search engine, unlike the traditional databases, Milvus currently only stores vectors and their corresponding ids, although we plan to store more information in future versions. So whether Milvus can totally replace Redis depends on your scenario, if the data only has vectors and ids then Milvus can. However, a lot of data contains more information than just ids, which requires access to a structured database such as Redis or MySQL.
I think Milvus can really help you if you're moving vector search, it's a great option! In distributed we use shared storage, you can refer to Mishards, also Milvus-Helm.