Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

video translator #66

Open
wangpei7001 opened this issue Oct 4, 2024 · 4 comments
Open

video translator #66

wangpei7001 opened this issue Oct 4, 2024 · 4 comments

Comments

@wangpei7001
Copy link

wangpei7001 commented Oct 4, 2024

Thanks for the great project, I got the following error when running the video translator locally:

`

tts_models/multilingual/multi-dataset/xtts_v2 is already downloaded.
Using model: xtts
Text splitted to sentences.
['Eine meiner größten Schwächen ist, um Hilfe zu bitten, wenn ich sie brauche.', 'Ich würde das gerne besser machen.']
Processing time: 16.305320024490356
Real-time factor: 1.2662441766454846
11:41:08.189145 ERROR base_task.py:730 - Failed to convert inputs of task 'video_translation.lip_sync':
USER:AssertionError: error=Cannot convert from Flyte Serialized object (Literal):
scalar:
blob:
metadata:
uri: [...] to <class 'flytekit.types.file.file.FlyteFile'>. Expected a file, but
/var/folders/hw/b9wt5xr90gnd39nt99ckwg0c0000gn/T/flyte9qril_vy/user_space3t42q_2q/__cp is not a file. `

@kumare3
Copy link
Contributor

kumare3 commented Oct 4, 2024

cc @samhita-alla for the issue

@samhita-alla
Copy link
Collaborator

samhita-alla commented Oct 4, 2024

@wangpei7001 there are four files expected by the lip sync task:

audio_path: FlyteFile,
pic_path: FlyteFile,
ref_pose: FlyteFile,
ref_eyeblink: FlyteFile,
which one of these is causing the error?

@wangpei7001
Copy link
Author

wangpei7001 commented Oct 4, 2024

not sure which file, I am checking the code, here is the traceback of error:
Screenshot 2024-10-04 at 16 17 11

@samhita-alla
Copy link
Collaborator

samhita-alla commented Oct 7, 2024

could you share your workflow here?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants