[Feature request] Translating system audio

[mzltest]

Thank you for wanting to share an idea! But before starting, ensure to check if this feature request respects the following requirements:

• It is written in English (I can translate what you say, but issues written in English are easier to read for the other users).
• There is not already a similar feature request among the open or closed issues.

---

It would be good if it can be used to translate system audio, similar to Chrome's auto caption when playing videos. This would be useful when consuming media content and I really didn't see any application with this functionality.

I believe starting from Android version 10 casting the screen will also receive system audio stream ( I use https://github.com/rom1v/sndcpy to redirect my device audio to computers ) so technically this might be possible. and floaty window should be available in Android since long time ago.

(Note I don't know android development so I might be wrong)

[mzltest]

here is a photo showcasing my mentioned feature in a desktop environment to make sure you know what i mean

[niedev]

Hi, thank you for your suggestion, unfortunately I don't have much time to work on the app at the moment, so I prefer to prioritize fixing bugs and improving the features it already has instead of adding new ones. But this would be a really useful feature, so I added it to the list of things to do in the future, if it will be possible to implement it, sooner or later it will surely be included in RTranslator.

[voodoozlx]

I think a lot of people need this feature, but right now there's only one app <讯飞听见> that can do this job, but it's not open source.

[mzltest]

This feature is technically possible as I previously stated (sndcpy can get audio stream = any android app can too) , but since I don't know Android development I can't help with code.

Speaking of live captions,I actually built a desktop web alternative before ,using Chrome's screen sharing capability (before I knew chrome included live captions , around March 2024) and streaming audio to 3rd-party recognition apis. It's bad, but better than nothing.

^ the show is an episode of Wednesday Downtown, episode 24.01.31 . Japanese -> Chinese . No longer works due to deta sunset.

[g-l-i-t-c-h-o-r-s-e]

Any plans to add this still? There still doesnt exist any open source way to translate system audio in realtime. Pixel 6+ are the only Android phones thathve Live Translate built in