-
Notifications
You must be signed in to change notification settings - Fork 487
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
add ipex to quicktour #2122
base: main
Are you sure you want to change the base?
add ipex to quicktour #2122
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @jiqing-feng but the quicktour looks a bit crowded already, I don't think we want to add more code snippet for now : would make more sense to have a description explaning when to use ipex vs openvino vs neural-compressor (+ a link towards a benchmark could be very nice also) as it's currently a bit confusing for users what should be used when + what are the integrations for each. I think it also makes sense to keep all code snippet related to optimum-intel in the dedicated section to not duplicate them multiple times (same applied for others sections) we can just add links in the quickstour instead
Signed-off-by: jiqing-feng <[email protected]>
Agree, do you think we should use optimum-intel pipeline instead? In this case, users can pass To apply optimum-intel optimization, you just need to import pipeline from optimum-intel instead of transformers, and choose - from transformers import pipeline
+ from optimum.intel.pipelines import pipeline
model_id = "distilbert-base-uncased-finetuned-sst-2-english"
# Run inference!
- classifier = pipeline("text-classification", model=model_id)
+ classifier = pipeline("text-classification", model=model_id, accelerator=accelerator)
results = classifier("He's a dreadful magician.") If we introduce optimum-intel in optimum quicktour in this way, it could be more clean and easy to understand for users. |
@echarlaix , we're fine w/ the "add link" idea. |
Hi @echarlaix @IlyasMoutawwakil . As ipex reactor is done in optimum-intel, it's time to update the readme and add ipex to quicktour.