You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am starting to learn function calling and want to use it in a concept RAG application. I want to run everything locally before I start using OpenAI. I only have 8GB of RAM so I usually use 3B models. Is there a list of function calling compatible models where it lists the required ram? What do you recommend for my use case? The quality of the model is not so important compared to it being compact.
If 8GB of ram is not possible, do you have recommendations for running these models either on some kind of free tier somewhere or with cheaper pricing than openAI?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I am starting to learn function calling and want to use it in a concept RAG application. I want to run everything locally before I start using OpenAI. I only have 8GB of RAM so I usually use 3B models. Is there a list of function calling compatible models where it lists the required ram? What do you recommend for my use case? The quality of the model is not so important compared to it being compact.
If 8GB of ram is not possible, do you have recommendations for running these models either on some kind of free tier somewhere or with cheaper pricing than openAI?
Beta Was this translation helpful? Give feedback.
All reactions