Question: Ability to handle Array or other data types?

[wflanagan]

I have an existing Postgres-based rails app that has a number of Array data types (in lieu of normalized data). We currently push this data into ElasticSearch to do faceting, but are running into some sync/stability issues in Kubernetes.

I'm investigating whether we can leverage this gem as a potential replacement for the facets we do in ES.

Like many others, we have datasets of substantial size (5+MM rows).

Does this gem work with Array data types instead of normalized data?

[forestofarden]

Hi William, Apologies for the delayed reply to your message. The gem does not support indexing data in arrays. If you chose to extend it to handle arrays, I would be happy to review the PR. I have used the Postgres -> ElasticSearch combination in Kubernetes for faceting, with good results. If you do not need transactional updates to facets, this is likely to be more scalable and performant than doing it inside the database. Best regards, Christopher York

…

On Sun, 24 Oct 2021 at 18:59, William Flanagan ***@***.***> wrote: I have an existing Postgres-based rails app that has a number of Array data types (in lieu of normalized data). We currently push this data into ElasticSearch to do faceting, but are running into some sync/stability issues in Kubernetes. I'm investigating whether we can leverage this gem as a potential replacement for the facets we do in ES. Like many others, we have datasets of substantial size (5+MM rows). Does this gem work with Array data types instead of normalized data? — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#14>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAS3LA2ILJYTAACDCE6BGNDUIRCRLANCNFSM5GTWGAJQ> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.