Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SeamlessM4T Using audio files to implement translation !Can you support it? #282

Open
curui opened this issue Mar 9, 2024 · 3 comments

Comments

@curui
Copy link

curui commented Mar 9, 2024

QQ截图20240310024054
Translate other languages via audio files like this!

@rsxdalv
Copy link
Owner

rsxdalv commented Mar 10, 2024

Hi, please try the newest update, I added a basic implementation for testing. Not all of the languages in the list are supported, and I don't have the S2TT, T2TT and ASR yet, I just added the S2ST functionality.

#284
127 0 0 1_7860_ (1)

@curui
Copy link
Author

curui commented Mar 14, 2024

您好,请尝试最新的更新,我添加了一个基本的测试实现。并非列表中的所有语言都受支持,而且我还没有 S2TT、T2TT 和 ASR,我只是添加了 S2ST 功能。

第284章 127 0 0 1_7860_ (1)

thank u!You can refer to this https://replicate.com/adirik/seamless-expressive. They can recognize speech and translate the same timbre, just like heygen. They seem to use seamless. For example: Upload the audio of an American who can translate and speak Chinese with the same accent/tone

@rsxdalv
Copy link
Owner

rsxdalv commented Mar 14, 2024

Interesting, the results on replicate seem better than what I saw myself so far. Thank you! This gives more research to do.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants