RE: DSP on beaglebone black

[Priyank Patel]

Hello,
I am building a hearing aid and wish to include DRC (Dynamic range compression), NR (Noise reduction), and destroy Acoustic feedback. Since, I am a college student, I have basic knowledge of linux, but new to programming a MCU. I wish to gather knowledge about how to implement DSP on a BBB.
Since literature out there on internet is vast, there seems to be no actual starting point for me. Any help on how to input the sound waves (i.e. output of microphone) to the BBB and process it and output it back to standard 3.5 mm stereo jack, would be greatly appreciate.
Thanks. 

[Gerald Coley]

Just so you know, there is no DSP on the BeagleBoneBlack. So I am assuming you mean a DSP function.

Gerald

--
For more options, visit http://beagleboard.org/discuss
---
You received this message because you are subscribed to the Google Groups "BeagleBoard" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beagleboard...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Priyank Patel]

Yes, I do mean the DSP function. I need to know how I can input the analog audio signal - process it (i.e. How do I implement the DSP algorithms) and send it out to an audio jack.
Thanks.

[Maxim Podbereznyy]

Purchase the Audio cape first

2013/9/30 Priyank Patel <priyank...@gmail.com>

--

LinkedIn - http://www.linkedin.com/in/maximpodbereznyy

Company - http://www.linkedin.com/company/mentorel

Facebook - https://www.facebook.com/mentorel.company

[Priyank Patel]

Is audio cape compatible with BBLK. I think I need to disable the hdmi functionality in order to use the audio cape.

[Maxim Podbereznyy]

yes. It was discussed here already

2013/9/30 Priyank Patel <priyank...@gmail.com>

Is audio cape compatible with BBLK. I think I need to disable the hdmi functionality in order to use the audio cape.

--
For more options, visit http://beagleboard.org/discuss
---
You received this message because you are subscribed to the Google Groups "BeagleBoard" group.
To unsubscribe from this group and stop receiving emails from it, send an email to beagleboard...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

[Priyank Patel]

Thanks for the suggestion.
Now as I stated earlier I m a beginner, I don't know where to start with programming. I refer to the part where I need to sample the data coming from a microphone and implement dsp algorithms. Please point me in right direction or some references. Thanks again.

You received this message because you are subscribed to a topic in the Google Groups "BeagleBoard" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/beagleboard/spmJODUYSp0/unsubscribe.
To unsubscribe from this group and all its topics, send an email to beagleboard...@googlegroups.com.

[Maxim Podbereznyy]

probably you should have a look at arecord sources to figure out how to capture samples from a sound card

2013/9/30 Priyank Patel <priyank...@gmail.com>

[Priyank Patel]

Hello,
I was researching within the thread and found out that a USB audio dongle might be a cheap alternative to buying a Audio cape. I just wanted to know if it would work for my hearing aid application (i.e. to send an input to beaglebone black and receiving it back via the same USB audio dongle)
p.s. I am not looking to get a very high quality sound, just need to make it work.
Thanks in advance.
Priyank.

[meino....@gmx.de]

Hi Priyank,

two things to consider:
For me "hearing aid" implies to increase the volume of a audio
signal. But you cannot process signals, which do not arrive at the
A/D-converter.
The cheap USB-Audio-Dongles have a no stereo mic inout. It is only
mono (or in other words: All USB-dongles I looked for, have a mono
input...I didnt find any dongle with a stereo input). A hearing
aid which feeds the same signal to both ears (mono) will destroy
the human ability to locate sounds. While crossing over roads (for example)
without being able to locate a sound could be fatal... ;)
Furthermore it may be possible, that the input amplifier of such
dongles isn't powerful enough to amplify a mic's signal. May be the
advertising of such dongles confuses "Line In" with "Mic In" for
obvious reasons.


Best regards,
mcc



Priyank Patel <priyank...@gmail.com> [13-10-01 03:59]:

> Hello,
> I was researching within the thread and found out that a USB audio dongle
> might be a cheap alternative to buying a Audio cape. I just wanted to know
> if it would work for my hearing aid application (i.e. to send an input to
> beaglebone black and receiving it back via the same USB audio dongle)
> p.s. I am not looking to get a very high quality sound, just need to make
> it work.
> Thanks in advance.
> Priyank.
>
> On Monday, September 30, 2013 4:48:56 AM UTC-4, lisarden wrote:
> >
> > probably you should have a look at arecord sources to figure out how to
> > capture samples from a sound card
> >
> >

> > 2013/9/30 Priyank Patel <priyank...@gmail.com <javascript:>>

> >
> >> Thanks for the suggestion.
> >> Now as I stated earlier I m a beginner, I don't know where to start with
> >> programming. I refer to the part where I need to sample the data coming
> >> from a microphone and implement dsp algorithms. Please point me in right
> >> direction or some references. Thanks again.

> >> On Sep 30, 2013 3:43 AM, "Maxim Podbereznyy" <lisa...@gmail.com<javascript:>>

> >> wrote:
> >>
> >>> yes. It was discussed here already
> >>>
> >>>

> >>> 2013/9/30 Priyank Patel <priyank...@gmail.com <javascript:>>

> >>>
> >>>> Is audio cape compatible with BBLK. I think I need to disable the hdmi
> >>>> functionality in order to use the audio cape.
> >>>>
> >>>> --
> >>>> For more options, visit http://beagleboard.org/discuss
> >>>> ---
> >>>> You received this message because you are subscribed to the Google
> >>>> Groups "BeagleBoard" group.
> >>>> To unsubscribe from this group and stop receiving emails from it, send

> >>>> an email to beagleboard...@googlegroups.com <javascript:>.

> >>>> For more options, visit https://groups.google.com/groups/opt_out.
> >>>>
> >>>
> >>>
> >>>
> >>> --
> >>> LinkedIn - http://www.linkedin.com/in/maximpodbereznyy
> >>> Company - http://www.linkedin.com/company/mentorel
> >>> Facebook - https://www.facebook.com/mentorel.company
> >>>
> >>> --
> >>> For more options, visit http://beagleboard.org/discuss
> >>> ---
> >>> You received this message because you are subscribed to a topic in the
> >>> Google Groups "BeagleBoard" group.
> >>> To unsubscribe from this topic, visit
> >>> https://groups.google.com/d/topic/beagleboard/spmJODUYSp0/unsubscribe.
> >>> To unsubscribe from this group and all its topics, send an email to

> >>> beagleboard...@googlegroups.com <javascript:>.

> >>>
> >>> For more options, visit https://groups.google.com/groups/opt_out.
> >>>
> >> --
> >> For more options, visit http://beagleboard.org/discuss
> >> ---
> >> You received this message because you are subscribed to the Google Groups
> >> "BeagleBoard" group.
> >> To unsubscribe from this group and stop receiving emails from it, send an

> >> email to beagleboard...@googlegroups.com <javascript:>.

[Priyank Patel]

Thanks for the quick reply. I will be sure to get the audio cape. After getting the audio cape, I suppose, I need to capture the mic input and sample it (I think ALSA does that?). Further, I will need to implement DSP algorithms. I researched on that and found the OMAP built into the beagleboard (Here I refer to the original beagleboard) has the ability to do DSP functions via Gstreamer tweaking (gst-dsp project). I am wondering if there is similar OMAP processor built into beaglebone black (which I am using for my project). Please, let me know how-to deploy dsp function on BBLK. Thanks. :)
Priyank.

[meino....@gmx.de]

Hi Priyank,

the audio cape will do the sampling for you. This will release
a great processing burden from the shoulders of the CPU. The
A/D-converter (analog to digital converter) of the audio cape
will do this for you.
In the simpliest case, you only need to grab the samples and put
it on SD-card/disc (raw format). This means recording. In case
of an hearing aid, this is not that useful, since you will "hear it
later", hahahaha! :)
Take a deep look into the datasheet of the tlv320aic3106, which is
TIs audio processor they put on the audio cape. This little beast is
capable of much more than simple sampling. For example you will get
a maximum sampling rate of 96 kHz, which means -- capable microphones
provided -- you can sample sound up to 24 kHz.
One thing: I dont know, how much of the features of this chip are
build into the driver! Means: May be you will need to hack the kernel
driver a little or a little more... ;) But as there is a driver
already there this will not be THAT complicated.
To get the cape running with the BBB is a little tricky (driver
selection in the kernel (you use Robert Nelsons fantastic kernel?))
and you need to disable HDMI and eMMC as far as I know.
But it will definetly run with the BBB after some tweaking (or in
other words: I have a BBB and an AUDIO cape and a LCD7 cape (A2)
running together nicely after some hacking of the device tree).

HTH!
Best regards,
mcc



Priyank Patel <priyank...@gmail.com> [13-10-01 05:12]:

> > Priyank Patel <priyank...@gmail.com <javascript:>> [13-10-01 03:59]:

[Pedro A. Melendez]

I'm using SYBA usb audio dongle is 11 bucks and it works. It appears as a second audio device if you dont disable the hdmi cape.

-Pedro

[Pedro A. Melendez]

the audio cape IC is really powerful but note some functions are restricted by the hardware, example no microphone support(mic bias no connected). Check the audio cape files to make sure it works for your application.

-Pedro

[Priyank Patel]

Hi Pedro,
I reviewed the Audio Cape IC specification file. The IC does have powerful ADC and DAC along with support for features that I require for the project. Here, I posted a snapshot of what I found related to the topic being discussed. Full version is available at: www.ti.com/lit/ds/symlink/tlv320aic3106.pdf‎
I do not understand some of the highlighted portion. Please, see if its the same what you mentioned in your earlier reply.
Thanks.
Priyank.

[meino....@gmx.de]

Hi Priyank,

hope that this could be helpful?!:
http://www.adafruit.com/products/1063

???

Best regards,
mcc




Priyank Patel <priyank...@gmail.com> [13-10-01 06:00]:

> Hi Pedro,
> I reviewed the Audio Cape IC specification file. The IC does have powerful
> ADC and DAC along with support for features that I require for the project.
> Here, I posted a snapshot of what I found related to the topic being

> discussed. Full version is available at: www.ti.com/lit/ds/symlink/*
> tlv320aic3106*.pdf

> I do not understand some of the highlighted portion. Please, see if its the
> same what you mentioned in your earlier reply.
> Thanks.
> Priyank.
> On Monday, September 30, 2013 11:40:32 PM UTC-4, Peedro A. Melendez
> (lazychino) wrote:
> >
> > the audio cape IC is really powerful but note some functions are
> > restricted by the hardware, example no microphone support(mic bias no
> > connected). Check the audio cape files to make sure it works for your
> > application.
> > -Pedro
> >
> >

> > On Mon, Sep 30, 2013 at 11:36 PM, Pedro A. Melendez <lazy....@gmail.com<javascript:>

> >>> Priyank Patel <priyank...@gmail.com <javascript:>> [13-10-01 05:12]:

> >>> an email to beagleboard...@googlegroups.com <javascript:>.

> >>> > For more options, visit https://groups.google.com/groups/opt_out.
> >>>
> >>> --
> >>> For more options, visit http://beagleboard.org/discuss
> >>> ---
> >>> You received this message because you are subscribed to the Google
> >>> Groups "BeagleBoard" group.
> >>> To unsubscribe from this group and stop receiving emails from it, send
> >>> an email to beagleboard...@googlegroups.com <javascript:>.
> >>> For more options, visit https://groups.google.com/groups/opt_out.
> >>>
> >>
> >>
> >
>
> --

[Priyank Patel]

Hi Meino,
I have looked up both directional and unidirectional adafruit has to offer. The unidirectional microphone seems to be partially helping as the website says it is ideal for the distance of 6" from the sound source (this is hearing aid and the sound source can be far or near) .Besides that, other concern is how would I interface it with the Audio cape (If I purchased one). This query was produced as I do not see a mic-in audio jack. Please, suggest me what can be steps that can be taken further. Thanks for researching on my behalf. You guys are helping a lot. Much obliged.

Priyank.

To unsubscribe from this group and all its topics, send an email to beagleboard...@googlegroups.com.

[meino....@gmx.de]

Hi Priyank,

:)
Just some minutes ago I posted a question on the Adafruit support
forum (I bougth two of those mic+amps for interfacing with my audio
cape) asking what is the best way to inerface those mic+amps with the
audio cape.

As soon as I will get an answer from Adafruit, I will post it to you.

One thing I forgot(?) to mention:
To use the audio cape with the BBB you need to modify the kernel and
the devicetree and recompile it. If you want, I will send you the
needed patches based on Robert Nelsons BBB kernel (3.8.12), which are
only tested for my setup but are not specific for it (I think). I am
running Gentoo and NOT Angstrom!

I think (but let us wait for the answer on Adafruits support forum)
that the output level of the mic+amp is powerful enough to drive the
audio input of the Audio cape.

Best regards,
mcc



Priyank Patel <priyank...@gmail.com> [13-10-01 07:56]:

[Priyank Patel]

Hi Meimo,
I just finished flashing my BBB to production image 2013.09.04 of Angstrom. But, now I am more interested in installing lightweight distros like gentoo or puppy linux. Preferably Gentoo (It gives inner satisfaction knowing someone else is also having same setup as yours). And please do send me the Awesome "Robert Nelson" kernel BBB patches. I will start working on it right away. Also, we will wait till you get answer from adafruit.
Keep fingers crossed :)
Priyank.

[Maxim Podbereznyy]

Audio cape can be easily modified to enable MIC BIAS. You will need two resistors 1k and a soldering tool. I've sent to this list a picture how to modify it, can do it again

2013/10/1 Priyank Patel <priyank...@gmail.com>

[Priyank Patel]

Hi Maxim,
Where can I find the picture you sent? I am sorry, I did not completely understand your last sentence. Precisely, where do I look when you sent attachment to list.
Priyank. 

[meino....@gmx.de]

Hi Priyank,



DISCLAIMER:
These instructions are given in the hope that they will be useful.
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.



It's always good to have a backup linux on the eMMC in case of
anything does not boot as wanted. ;)

Before patching the kernel, you need the kernel itsself... :)

I would suggest the following:
Use a good and reliable SDcard and -- if possible -- an external
harddrive (I use a TOSHIBA STOR.E ALU 2S 500MB for this purpose) with
a *powered* USB hub, since the BBBs USB port cannot power the
harddisc. I setup the fstab of my BBB so it will mount some parts
of the hd over directories of the rootfs of my BBB optionally,
which get most of the write accesses off the SDcard while compiling.
This will lower the wear-out of the SDcard.
On the other hand...until now I have not lost any
SDcard due to wear-out effects. The hd card is not needed from the
pure technical point of view.

If you want to use Gentoo: Gentoo is source based, beside the very
very basic rootfs, anything else is compiled natively on the BBB. This
will take time. Compiling the kernel on the BBB will take about eight
hours (you will compile the kernel on your desktop LINUX, though...).
Especially in the beginning until you will only need to add single
applications the BBB will compile things most of the time. On the other hand:
This little great computer only consumes 5W on full load. Start the
compiling task before going to bed and the next morning will start with
a bunch of fresh and new applications :)))
And this will give you the freedom to only include things you really
need or want. Especially on space limited embedded systems this an
advantage.

Using Gentoo needs to dig a little deeper into a little more of
manuals and documentations. It is definetly not the distribution for
the fire-and-forget kind of user. If you interested in a little deeper
look into the inside of Linux und UNIX systems you definetly will like
Gentoo.

Instructions how to setup Gentoo for the Beaglebone black you will
find here:
http://dev.gentoo.org/~armin76/arm/beagleboneblack/install.xml


The instruction how to setup the fantastic one-and-only
Robert-Nelson-kernel-building-suit :)))) you will find here:
http://eewiki.net/display/linuxonarm/BeagleBone+Black


DO THE FOLLOWING WITHOUT ATTACHING THE AUDIO CAPE TO THE BBB FIRST!

I would suggest the following:
1.) Setup Robert Nelsons kernel build suit first according to its
documentation.
2.) Build "Das U-Boot" (the bootloader stuff)
3.) Setup a SDcard according to Robert Nelsons instructions (mine is
16GB of size, 7.8GB still free. Use a good and reliable SDcard).
4.) Recompile Robert Nelsons Linux kernel with the default
configuration/setup.

If the compilation works fine and produces a kernel with the according
archives under .../deploy/. its time for Gentoo! :) :
1.) Install the rootfs image for Gentoo on you SDcard and get it running.
A kernel will come with the rootfs
image. It may be necessary to modify some of the config files below
/etc with the SDcard mounted on you desktop PC Linux instead of the
BBB to setup networking and ssh...instructions see above.

The common and platform independant part of the documentation of
Gentoo is also a very good source of information (see links in above
linked install guide of Gentoo for the BBB).

After Gentoo is running from your SDcard you will need to do the
follwing:
1.) Disable eMMC and HDMI by modifying uEnv.txt config file for Das
U-Boot. This is NOT permament! :) As soon you will boot your BBB
without a SDcard inserted, eMMC and HDMI are there again...
2.) Remap the storage place of the kernel image from first partition
to one of the others to get more space for different kernels and
to lower the wear out of the SDcard by moving write cycles off the
small first partition. This is also done in uEnv.txt.
3.) Patch the kernel to support the Audio cape. This patch is a
workaround, which I found in the internet (source of the
information here:
https://groups.google.com/forum/#!topic/beagleboard/ZJGwxA7BG4E)
It is NOT developed by me!
This workaround is NOT compatible with HDMI!
4.) May be you need to patch the device tree also to disable the
LEDs of the audio cape since they do interfer with the LCD7 (A2)
cape (and may be other capes I dont know) if you use one.

Send me a ping :) if your BBB without the AUDIO cape will boot into
Gentoo and you have access via ssh to it.

Good luck! 8)

Best regards,
mcc





Priyank Patel <priyank...@gmail.com> [13-10-01 08:24]:

> > Priyank Patel <priyank...@gmail.com <javascript:>> [13-10-01 07:56]:

> > > Hi Meino,
> > > I have looked up both directional and unidirectional adafruit has to
> > offer.
> > > The unidirectional microphone seems to be partially helping as the
> > website
> > > says it is ideal for the distance of 6" from the sound source (this is
> > > hearing aid and the sound source can be far or near) .Besides that,
> > other
> > > concern is how would I interface it with the Audio cape (If I purchased
> > > one). This query was produced as I do not see a mic-in audio jack.
> > Please,
> > > suggest me what can be steps that can be taken further. Thanks for
> > > researching on my behalf. You guys are helping a lot. Much obliged.
> > > Priyank.
> > >
> > >

> > > On Tue, Oct 1, 2013 at 12:15 AM, <meino....@gmx.de <javascript:>>

> > wrote:
> > >
> > > > Hi Priyank,
> > > >
> > > > hope that this could be helpful?!:
> > > > http://www.adafruit.com/products/1063
> > > >
> > > > ???
> > > >
> > > > Best regards,
> > > > mcc
> > > >
> > > >
> > > >
> > > >

> > > > Priyank Patel <priyank...@gmail.com <javascript:>> [13-10-01 06:00]:

[Priyank Patel]

Thanks. I will get back to you when I am done the procedure. Its gonna take a while (may be 48 hrs). Thanks again.

To unsubscribe from this group and all its topics, send an email to beagleboard...@googlegroups.com.

[Pedro A. Melendez]

Priyank: what do you mean by "highlighted portion"? you can check check of the audio cape in here http://beagleboardtoys.info/index.php?title=BeagleBone_Audio
Maxim: cool, wanna see that mod :)

[Priyank Patel]

Hello Pedro,

I just bought the SYBA usb audio adapter. My instructor suggested it will work just fine for my project. Now, only thing I need to learn is how to code to get the mono mic input and pass it through DSP algorithms. I hear OMAP on beaglebone black has speech recognition, noise reduction and many more features. I just want to know how to exploit them. Please point me to some programming tutorials (preferably python or C++) for DSP in audio. I have some basic knowledge on ALSA. I just configured eclipse so I can cross compile from my computer to BB.

Thanks in advance ;) 

[Mark A. Yoder]

Here's an exercise I made for my students that shows how to use ALSA on a Beagle xM to read audio from an input, process it, and send it out again.   It is an exercise, so you'll have to put some pieces together to make it work. It should work on a Bone if you have some audio I/O. 

I plan to test it on some audio USB dongles once they arrive.

--Mark

[Priyank Patel]

Hi Mark,

Your exercise was the first thing that I found out even before starting this thread. I started the course from the beginning and I have approached the half way. Great work, really appreciate it. Thanks.

-Priyank

[Priyank Patel]

Hi Pedro,
I have bought syba usb audio adapter similar to yours. I plugged it in but I am not able to see it on command aplay - L. Please let me know how did you figure out. Also,  I would like to know how to set it as default mic in And output. Thanks.

To unsubscribe from this group and all its topics, send an email to beagleboard...@googlegroups.com.

[Pedro A. Melendez]

I'm using this angstrom image and is auto detected by the os, I have seen some time after updating it does not appear, but it happen because not all alsa component updated. this is the image I'm currently using 'Angstrom-Cloud9-IDE-GNOME-eglibc-ipk-v2012.12-beaglebone-2013.09.05'

-Pedro

[Priyank Patel]

Hey Pedro,  I got it working. I assume the board was not getting enough juice from usb connection from computer. So I used a dedicated 5v 1A charger. And I was able to manipulate the conf file to set syba usb dongle as default audio mic facility.  Thanks.

[Pedro A. Melendez]

good :)

[Priyank Patel]

Hello Mark,
You were to test your exercise on USB audio dongles. Now, I have SYBA usb audio dongle. I understand your excercise but I am not able to configure the usb audio dongle to work with 'bone (running Angstron). Please let me know if your audio i/o arrived and if you've tested them. Reply will be much appreciated. Thanks.
Priyank.

[Pedro A. Melendez]

Priyank, it does not appears at all or it appears as a secondary device??

[Priyank Patel]

Hi Pedro,
It does appear as a secondary device. I just dont know how to set it as default for audio in out
Thanks

[Mark Lazarewicz]

You buy a book called DSP Algorithms or study the source code of available algorithms some you mentioned may not be easily found. Did you expect a breakdown of  how to process audio in the group just because you choose this board? the questions being asked on here have reached the level of basic common sense I may unsubscribe

[Pedro A. Melendez]

To make it the default the hdmi audio must be disable, you can disable the hdmi interface from the uEnv.txt file adding this capemgr.disable_partno=BB-BONELT-HDMI,BB-BONELT-HDMIN. Also, you can use it without making it the default, by specifying the device you wanna use. I'm not sure exactly the way you are using the sound card but for example in my case, I use SoX for recording audio and on the sox call specify the card name (alsa 1:0 or pulse audio /dev/dsp1) and it works.

hope that helps,

Pedro 

[Anubhav Goel]

Hi lisarden,

I am trying to get the mic in to work, can you please send me the picture with your suggested changes ?

Best Regards,
Anubhav