Peer-to-peer audio streaming

This site is best viewed in a modern browser with JavaScript enabled.

Peer-to-peer audio streaming

gulesz

Hi, do you have any suggestion how would be possible to stream audio between many bela users? How to create multi-peer communication like this https://github.com/kolson25/WebRTC-Multi-Peer-Video-Audio ? Does exist any way, how to connect bela to the node server...? Thanks in advance for any comments.

giuliomoro

gulesz to stream audio between many bela users

are these users on the same network?

gulesz s https://github.com/kolson25/WebRTC-Multi-Peer-Video-Audio ?

this seems to be browser-based so it's a no-go.

What are you trying to achieve?

gulesz

hi, thanks for reply. I try to make a kind of sharing listening in a small group of people. People should be at the same place in distance up to 20metres. The aim is to build a system on bela which could stream the audio from each person of the group. Optimally, to create a kind of Sonobus app on bela (https://www.sonobus.net/sonobus_userguide.html). It is not neccesary to be online. I was thinking if it would be possible to use the node js server on bela and to create some app js and store it on bela. Then, to establish one bela as a main server to where the other belas (mini ones) can connect through their wifi dongles. If that would be possible?

giuliomoro

It looks like sonobus uses jack as an audio backend. That would be:

Sonobus Client -> Jack -> Bela audio environment -> DAC

and the latency is probably going to be high enough that all the benefits of using the Bela audio environment are going to be lost. I am wondering if it would be a better option to simply use the Bela cape as an ALSA device. That is probably going to make things easier. Another alternative, which is bad under an engineering point of view, but may just work if you have good enough wireless dongles would be to use Bela's UdpClient and UdpServer libraries and use them to send blocks of audio from one device to the others, perhaps sending to the broadcast address, i.e.: whatever.your.subnet.255, e.g.: 192.168.1.255. The receivers would have to buffer a reasonable amount of data before starting to play (again: latency!), but it may work well enough on a local network. You

gulesz

enough wireless dongles would be to use Bela's UdpClient and UdpServer libraries and use them to send blocks of audio from one device to the others, perhaps sending to the broadcast address, i.e.: whatever.your.subnet.255, e.g.: 192.168.1.255.
I think this would be a fine solution. Could you please more explain or elaborate on how to do it?

gulesz

I am wondering if it would be a better option to simply use the Bela cape as an ALSA device..... so, to create kind of ALSA mixer for the remote peers?

giuliomoro

gulesz ..... so, to create kind of ALSA mixer for the remote peers?

well you can load the /lib/firmware/BB-BONE-AUDI-02-00A0.dtbo instead of /lib/firmware/BB-BELA-00A1.dtbo and the Bela cape will show up as an ALSA device. From there on it should be easier to run it with Jack following the sonobus instructions.

gulesz

thanks, but could you outline the steps how can I run the jack and sonobus on bela, please? Consider me as a total beginner on Linux. thanks

giuliomoro

I think the only part where I can be of help here is by telling you how to have the Bela cape show up as an ALSA device, but for the rest of the setup, it is for you to follow the instructions made available by sonobus.

Now, the "Bela as ALSA" issue. I rarely do that, so it periodically breaks. After about one hour of work on this, I got got it to work for Bela, but it is still not doing it for BelaMini. Before going through this more in detail, which one do you have at the moment? If you have a two big Belas around, it may be easier for me to tell you how to do it there, then you try to get the sonobus to work on those two and evaluate if that works for your purposes, at which point I'd look into fixing this for BelaMini, too.

gulesz

I have Bela and Ctag...

giuliomoro

OK, so for Bela the most straightforward way is to flash a BeagleBoard image from here, then boot from it, ssh on it with ssh debian@beaglebone.local (password temppwd), then modify the file /boot/uEnv.txt to add this line:

uboot_overlay_addr5=/lib/firmware/BB-BONE-AUDI-02-00A0.dtbo

save and reboot. aplay -L should show the device!

gulesz

thanks, I am going to try that. But before it, I am curious if it would be an easier and lower latency solution with udpServer and udpClient as you mentioned (in the case it will run on the local server). Then, I imagine that each of the group has his/her own bela (mini) with its own wifi dongle and everybody is connected to a router (TL-WR802N).

giuliomoro

gulesz easier and lower latency solution with

easier to try it out probably, not necessarily to make it fully working/reliable. Lower latency possibly (but again, possibly unreliable), but expect > 20ms or more for passable reliability.

gulesz

the priority is to have latency <20 ms. Otherwise, I can connect like that: mics>recorder>phone>sonobus. I thought if it would be possible to use the node server on bela, upload the javascript code for multi-peer communication, and then the bela use as a local server. Simply, to get rid of sonobus and any remote servers.

giuliomoro

the priority is to have latency <20 ms.

Honestly I think you won't be able to achieve that reliably. There are dedicated wireless audio modules that struggle to achieve 10 ms or 15 ms, and these devices do literally just that!

In principle one cold connect the TI CC8530 to Bela via I2S and use that for communication across devices (though I am not sure whether it can broadcast to several devices), but that would require spinning a PCB design just for it...

If the latency requirement is relaxed (e.g.: > 50ms), then I think you can start thinking about using the Linux wifi stack for it.