Are there any tutorials for serverless architecture with Haystack specifically?

[asharm0662]

Hi,

As the title suggests, are there any tutorials for setting up Haystack specifically, within serverless architecture? In this case within AWS Lambda.

Would serverless architecture even be a viable option for Haystack or is the architecture with readers and document stores that Haystack comes with not viable for the serverless architecture?

Thank you in advance.

[bogdankostic]

Hi @asharm0662! This topic already came up a few weeks ago (see #1543). AWS Lambda, unfortunately, does not support GPU, so it is not really suited for deploying QA pipelines.

[asharm0662]

@bogdankostic thanks for the link. Would you say that if cpu capabilities are all we need would lambda be fine?

In your opinion what is the best way to run Haystack NLP in way where I can setup method to only use resources when necessary.