Add bidirectional audio support for HomeKit cameras#1981
Add bidirectional audio support for HomeKit cameras#1981andersbaekgaard wants to merge 1 commit intoAlexxIT:masterfrom
Conversation
Enable speaker/talkback functionality for HomeKit cameras: - Audio path: WebRTC/Browser mic → FFmpeg (OPUS→AAC-ELD) → HomeKit SRTP - Connection tracking to prevent duplicate consumer-track pairs - FFmpeg `accept-audio` parameter for external audio sources - Thread-safe SRTP writes with mutex protection Tested with Aqara G4 doorbell. Implemented by Anders Baekgaard in cooperation with Anthropic Claude Opus 4.5 https://claude.ai/
|
Thanks! The implementation is quite complex and introduces a lot of confusion into the core. And I really don't like the idea of using custom ffmpeg. This is one of the block factors for implementing two-way for HomeKit cameras. |
|
Thank you for the prompt feedback. I understand your concern about complexity, the PR got much more complex than I expected when first looking into it. I could not get streams matching to work for the aac-eld transcoder producer, due to archtiectural limitation. With your insight, you could maybe make it simpler. Note that there is also a simple bug fix. |
|
Would really love to see this integrated. Cannot get my Aqara G410 running with 2 way audio. Thankful for any advice. |
Summary
accept-audioparameter to FFmpeg for waiting on external audio sourcesRequirements
libfdk_aacfor AAC-ELD encoding (required for HomeKit speaker audio)Test plan
Implemented by Anders Baekgaard in cooperation with Anthropic Claude Opus 4.5
https://claude.ai/