Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

role function in function response #2

Open
sidhujag opened this issue Jun 24, 2023 · 0 comments
Open

role function in function response #2

sidhujag opened this issue Jun 24, 2023 · 0 comments

Comments

@sidhujag
Copy link

sidhujag commented Jun 24, 2023

Bug:
shouldn't https://github.com/aurelio-labs/funkagent/blob/main/funkagent/agents.py#L82 be role 'function' not 'assistant'? This will help the model from not calling the function again with the same query. You expressed this worry on the video and probably this is why it happens.

To add usefulness to functions:
I think you can redact function responses in future questions as only the query/response is really important for context. If the AI needs to know the same thing again it can ask again. (this will limit context window and cut down costs).

It's useful to know if a query is "related" to another query (in the same user context) and if so add previous history otherwise start with 0 history. A semantic lookup on the query/response can be done here at a high threshold. At worsed case you may need to pass the previous response in a secondary check to ensure user is not inferring to the previous response in an ambiguous way.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant