Ai Audio To Midi Converter

0 views

Skip to first unread message

Mack Mosely

unread,

Aug 3, 2024, 5:36:50 PM8/3/24

to cleavadonid

are there any apps that can take audio, and convert it to midi to be used in another instrument.?
example. beatbox, and have it convert to midi to be used with a drum app
or him a melody and have it convert to midi for a synth app

Fac Envolver can be used as an audio effect converted to midi output, there's limitations in how it works though. It's more like it's triggering midi commands but not converting audio to midi directly.

@eross said:
are there any apps that can take audio, and convert it to midi to be used in another instrument.?
example. beatbox, and have it convert to midi to be used with a drum app
or him a melody and have it convert to midi for a synth app

For melodies, MIDI Guitar and Thumbjam work quite well but converting your beatboxing mike recordings, that's quite a challenge to be honest.
I would create a Drambo patch that does the detection and separation (which will obviously have to be adapted to your own beatboxing sounds) but maybe there's a magic app for that which I don't know yet...

Can it accurately translate a sung melody into a monophonic midi line preserving pitchbend, vibrato etc? Anything I've tried so far for this has failed abysmally, would be holy grail territory for me if this does that perfectly!

I am having the exact same problem. 1) create audio track 2) crate midi track from flex pitch data. 3) the new midi region is added to the arrange page and I can see that the idi data in the region matches the pitches of my audio track BUT 4)nothing plays back 5) when I double click there are no notes to be found in the midi window and 6) there are no notes on the staves of the score window.

There is a known issue with the velocity of the notes created by this feature, so open the region in the Event List and double-check that the velocity of the notes is in a reasonable range (not zero for example).

multi is an open hardware circuit board hosting a Seeeduino XIAO, 6 pots, 2 pushbuttons, 2 Midi DIN connectors and an audio output.
The Seeeduino XIAO board carries a powerful ATSAMD21G18A-MU which is a low-power microcontroller and has 14 GPIO PINs, a DAC output and one UART interface. To avoid grounding loops the MIDI input is properly opto-isolated, as required by official specifications.

You can program multi as you need, using the Arduino IDE.
On the MIDI side, possible use includes advanced midi controlling, filtering and remapping as well as algorhitmic arpeggiators and aleatoric patch generators.
Since the Xiao board has a DAC, multi can also be used to produce sounds using the Mozzi sonification library written by Tim Barrass or accessing directly to the DAC output.

EDIT: basically like how MIDIbox lets you daisychain a few 4x4 I/O boards to add more ports to your project. A barebones DIY MIDI router/filter that could be built with an arbitrary number of ports up to at least 16x16 (or more) is something that I would absolutely jump on.

I have a keyboard with MIDI support (1 MIDI-IN, 1 MIDI-OUT) and some Arduino boards. I need a device that detects by system as MIDI device. The device should send MIDI signal from keyboard to system and from system to keyboard.

Yes, exactly. I faced with similar devices a few years ago. But I ordered it on Ali Express. Unfortunately these devices does not support Windows Vista or higher and GNU/Linux. One of devices does not work at all...
And Ebay is not good variant for my country. I live in Belarus and a lot of traders does not send goods in my country or makes very expensive shipping (more that 35 USD).

Arduino USB MIDI Interface: A few weeks ago I started working on a MIDI controller using Arduino and ATmega32. I did not completed projected yet. It is under development.You can read the whole story here...

A bit late to reply...but for the community....
Cheap MIDI USB converter mentioned above are pure sh....
They don't support midi exclusive msg, and generate random midi message due to the bad midi parser inside...
Avoid it unless you need midi cable !

I picked the WidiSoft web site to check out because it was at the top of the list, and came up high in a Google search. English is not their first language. However, you can download and try the software before you buy it.

If you know certain things about the waves you wish to convert it might be possible. If, for example, you know that the wave contains only a paino, it might be possible to convert that into notes and from that to midi.

It seems to me that you should first break the audio into small clips (maybe .25 sec each). Then you could use FFT to get as many of the frequencies and associated amplitudes you require for each clip (maybe 8?). Then you could round the frequencies to the nearest note. Then I think the conversion of that to MIDI is pretty easy, at least at this basic level. So, you need to write C# software that samples the audio clip (done: see NAudio), and then obtain (I don't know where) software that does the FFT on the clip. Conversion of frequency to a note is a table lookup. You can find commercial software that does conversion too: -in-melodyne-5

So in the case of the trumpet, the use of a microphone connected to a hardware midi converter would be more suitable: for this purpose, there are nowadays midi converters that work properly for monophonic instruments.
I personally own a midi microphone (Midimic from Digigram) bought in 1989 and which already worked perfectly at that time and with zero latency with a saxophone, a flute and therefore any other monophonic instrument. Its advantage is that it is both a traditional microphone and a midi converter: it has an additional line input, an audio output and a midi out socket.

Bitwig producers must rely on plugins or other DAWs to extrac MIDI from audio clips easily and reliably. Bitwig offers a Replacer device and a Zero Crossings module in The Grid, but their current usefulness for most producers is rather small.

Bitwig aims to Streamline your creative process and quickly evolve your ideas into complete songs, tracks, and compositions. Often ideas emerge in the brain and take shape as audio while humming, whistling, clapping, tapping on a table, or casually playing a basic instrument. They also emerge while listening to recorded audio. Getting the inspiring sounds in MIDI form is a frequent need in the creative process.

For example, this is how the audio midi converter works in Studio One:

The Melodyne effect is open on the audio track, notes are already recognized. And simply dragging and dropping the audio clip onto the midi track converts the Audio to Midi. But these will just be approximately recognized midi notes, without any nuances such as vibrato, legato, etc. Therefore, we need an MPE.

These are my notes from my exploration of the available software options as of the date this page was last updated. As always, if a reader makes a suggestion for procedures and other technology that would yield better results, please let me know and I will update this page.

The audio file I am using as a test, Sanchez_05.flac, is a recording of a classical guitar in which I play some fast single notes (trills), intervals and chords. I used a click track to play along with when making the recording. The click track is not part of the recording.

This article discusses both steps and compares alternative software packages for each. The best output MIDI file from the winner of step 1 was provided to each of the competing annotation programs in step 2.

I was surprised when Ableton Live 12 ranked dead last. I had expected the big dog to be the winner of step 1, or at least one of the top performers. Live was the only software product that I tested that did not use a neural network for converting audio to MIDI. As of 2024, an algorithmic or heuristic approach is unlikely to be able to compete with neural networks for this type of task.