Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hide VLM files and API #951

Merged
merged 14 commits into from
Oct 15, 2024

Conversation

Wovchena
Copy link
Collaborator

No description provided.

src/cpp/src/processor_config.cpp Show resolved Hide resolved
src/cpp/src/vision_encoder.hpp Outdated Show resolved Hide resolved

DecodedResults VLMPipeline::generate(
const std::string& prompt,
const std::vector<ov::Tensor>& rgbs,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BTW, why do we have overload with multiple images, but don't have with single one?
I think we either need to provide it or keep only overload with explicit prompt, while image(s) are supposed via properties.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's the implementation of the second option. Properties are cast to this general signature while the sample encourages to use Proprieties. There's just no reason to hide this general function. Someone pedantic may want to avoid minor cast overhead and use that one directly.

@ilya-lavrenov ilya-lavrenov added this to the 2024.5 milestone Oct 12, 2024
@ilya-lavrenov ilya-lavrenov self-assigned this Oct 12, 2024
@Wovchena Wovchena enabled auto-merge October 14, 2024 08:36
@Wovchena Wovchena added this pull request to the merge queue Oct 14, 2024
@ilya-lavrenov ilya-lavrenov removed this pull request from the merge queue due to a manual request Oct 14, 2024
@ilya-lavrenov
Copy link
Contributor

ilya-lavrenov commented Oct 14, 2024

It shows merge conflicts with VLM tests & align impl.. Latest wait for those PRs to me merged via queue first.

@Wovchena
Copy link
Collaborator Author

We could have let it try to merge and see who is faster or not randomly fails. The other one would resolve the conflicts.

@Wovchena Wovchena added this pull request to the merge queue Oct 14, 2024
@Wovchena Wovchena removed this pull request from the merge queue due to a manual request Oct 14, 2024
@Wovchena Wovchena force-pushed the hide-VLM-files-and-API branch from 21aa927 to 7f0ef7a Compare October 14, 2024 13:31
@Wovchena Wovchena force-pushed the hide-VLM-files-and-API branch from 7916b42 to a9d92f0 Compare October 14, 2024 13:55
@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Oct 15, 2024
Merged via the queue into openvinotoolkit:master with commit 3d0fcee Oct 15, 2024
47 of 48 checks passed
@ilya-lavrenov ilya-lavrenov added category: visual language Visual language pipeline category: samples GenAI samples labels Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
category: samples GenAI samples category: visual language Visual language pipeline
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants