Music Notation Parsing
-
I may be totally wrong, but it seems that there should be a fairly good piece of software that can "listen" to a WAV or MP3 of a song, and transcribe (polyphonically) the various parts into staves of notes for that instrument. Anyone know of such an application? Anyone aware of one being developed using machine learning? Thanks in advance.
It would be very interesting to see how it would handle the time signature for Metallica's Master Of Puppets Metallica and the Missing 32nd Note- Master of Puppets Analyzed - YouTube[^]
“That which can be asserted without evidence, can be dismissed without evidence.”
― Christopher Hitchens
-
I may be totally wrong, but it seems that there should be a fairly good piece of software that can "listen" to a WAV or MP3 of a song, and transcribe (polyphonically) the various parts into staves of notes for that instrument. Anyone know of such an application? Anyone aware of one being developed using machine learning? Thanks in advance.
You want software, that can hear a song, and transcribe each instrument, being able to recognise two different guitars, a guitar from a bass etc, in its right key, a key which is determined by the average of the notes played, and is not even always evident, into notes that depend on that key? Dream on, it is impossible.
-
You want software, that can hear a song, and transcribe each instrument, being able to recognise two different guitars, a guitar from a bass etc, in its right key, a key which is determined by the average of the notes played, and is not even always evident, into notes that depend on that key? Dream on, it is impossible.
Munchies_Matt wrote:
Dream on, it is impossible.
MIT is already working on it - isolating individual instruments - in videos, anyway. From there you just need to do some FFT to get the notes, map them to whatever, then transcribe that. I wouldn't want to do it, but people already are.
We won't sit down. We won't shut up. We won't go quietly away. YouTube, VidMe and My Mu[sic], Films and Windows Programs, etc. and FB
-
Munchies_Matt wrote:
Dream on, it is impossible.
MIT is already working on it - isolating individual instruments - in videos, anyway. From there you just need to do some FFT to get the notes, map them to whatever, then transcribe that. I wouldn't want to do it, but people already are.
We won't sit down. We won't shut up. We won't go quietly away. YouTube, VidMe and My Mu[sic], Films and Windows Programs, etc. and FB
GenJerDan wrote:
isolating individual instruments
Easy in a three piece band perhaps, in an orchestra?
GenJerDan wrote:
map them to whatever
And how do you determine the key? There are only 12 notes. Working out the key is very difficult.
-
I may be totally wrong, but it seems that there should be a fairly good piece of software that can "listen" to a WAV or MP3 of a song, and transcribe (polyphonically) the various parts into staves of notes for that instrument. Anyone know of such an application? Anyone aware of one being developed using machine learning? Thanks in advance.
Quite a difficult task, but it seems like there is software that can come close. Just Goolgle for 'create score from audio' - there are free trials available for some of them. [AnthemScore | Music Transcription Software](https://www.lunaverus.com) [Software that automatically transcribes music to make your job easier](https://windowsreport.com/automatically-transcribe-music/)
-
Munchies_Matt wrote:
Dream on, it is impossible.
MIT is already working on it - isolating individual instruments - in videos, anyway. From there you just need to do some FFT to get the notes, map them to whatever, then transcribe that. I wouldn't want to do it, but people already are.
We won't sit down. We won't shut up. We won't go quietly away. YouTube, VidMe and My Mu[sic], Films and Windows Programs, etc. and FB
Yes - would never say its impossible, in fact its getting more likely all the time. Seasoned musicians can easily pick up on the key, and from that and their musical knowledge will have a good idea of how to play along with a band even if they don't know the individual piece. For a device it will depend on how complicated the piece being played is and the instruments. For solo instruments especially those that aren't playing chords its relativity easy. Add chords - a bit more difficult but still fundamentally an FFT, a bit of timing and logic. Where it starts to get complicated is multiple instruments and techniques for example bends etc., but add some AI and possible directional information of the sound sources not impossible. Would it be useful, probably not, although have to admit wouldn't mind something that could write out music scores as I played it from a guitar or scored the quality and correctness of a chord! Although already have a device which judges musical quality - its called a partner!
-
I may be totally wrong, but it seems that there should be a fairly good piece of software that can "listen" to a WAV or MP3 of a song, and transcribe (polyphonically) the various parts into staves of notes for that instrument. Anyone know of such an application? Anyone aware of one being developed using machine learning? Thanks in advance.
Would never say its impossible, in fact its getting more likely all the time. Seasoned musicians can easily pick up on the key, and from that and their musical knowledge will have a good idea of how to play along with a band even if they don't know the individual piece. For a device it will depend on how complicated the piece being played is and the instruments. For solo instruments especially those that aren't playing chords its relativity easy. Add chords - a bit more difficult but still fundamentally an FFT, a bit of timing and logic. Where it starts to get complicated is multiple instruments and techniques for example bends etc., but add some AI and possible directional information of the sound sources not impossible. Would it be useful, probably not, although have to admit wouldn't mind something that could write out music scores as I played it from a guitar or scored the quality and correctness of a chord! Although already have a device which judges musical quality - its called a partner!
-
GenJerDan wrote:
isolating individual instruments
Easy in a three piece band perhaps, in an orchestra?
GenJerDan wrote:
map them to whatever
And how do you determine the key? There are only 12 notes. Working out the key is very difficult.
Munchies_Matt wrote:
Easy in a three piece band perhaps, in an orchestra?
I think it's probably only working with videos so they can match the music to the motion of the instrument to some extent. There are also different tonal qualities, of course. But I wouldn't want to try differentiating between the first violin and the second. :laugh:
Munchies_Matt wrote:
And how do you determine the key? There are only 12 notes. Working out the key is very difficult.
Not really, as long as it's a "standard" key without accidentals. And, score notation-wise, there isn't difference between C Maj and A Min, etc.
We won't sit down. We won't shut up. We won't go quietly away. YouTube, VidMe and My Mu[sic], Films and Windows Programs, etc. and FB
-
Would never say its impossible, in fact its getting more likely all the time. Seasoned musicians can easily pick up on the key, and from that and their musical knowledge will have a good idea of how to play along with a band even if they don't know the individual piece. For a device it will depend on how complicated the piece being played is and the instruments. For solo instruments especially those that aren't playing chords its relativity easy. Add chords - a bit more difficult but still fundamentally an FFT, a bit of timing and logic. Where it starts to get complicated is multiple instruments and techniques for example bends etc., but add some AI and possible directional information of the sound sources not impossible. Would it be useful, probably not, although have to admit wouldn't mind something that could write out music scores as I played it from a guitar or scored the quality and correctness of a chord! Although already have a device which judges musical quality - its called a partner!
I was a beta tester for some software that did it a long long time ago. It "listened" to a .wav file and turned it into a MIDI file. It didn't make any attempt to separate out the tracks, so it produced a really ugly file, all the notes squished onto one track...but he mananged to get the notes all there. :)
We won't sit down. We won't shut up. We won't go quietly away. YouTube, VidMe and My Mu[sic], Films and Windows Programs, etc. and FB
-
Munchies_Matt wrote:
Easy in a three piece band perhaps, in an orchestra?
I think it's probably only working with videos so they can match the music to the motion of the instrument to some extent. There are also different tonal qualities, of course. But I wouldn't want to try differentiating between the first violin and the second. :laugh:
Munchies_Matt wrote:
And how do you determine the key? There are only 12 notes. Working out the key is very difficult.
Not really, as long as it's a "standard" key without accidentals. And, score notation-wise, there isn't difference between C Maj and A Min, etc.
We won't sit down. We won't shut up. We won't go quietly away. YouTube, VidMe and My Mu[sic], Films and Windows Programs, etc. and FB
Pulling instruments out is impossible IMO, but the issue of key is crucial. Regardless of the same notation being used for various keys, if you cant tell the key, you cant score it in a standard way.
-
You want software, that can hear a song, and transcribe each instrument, being able to recognise two different guitars, a guitar from a bass etc, in its right key, a key which is determined by the average of the notes played, and is not even always evident, into notes that depend on that key? Dream on, it is impossible.
Some humans can do it, so it must be possible.
Freedom is the freedom to say that two plus two make four. If that is granted, all else follows. -- 6079 Smith W.
-
Pulling instruments out is impossible IMO, but the issue of key is crucial. Regardless of the same notation being used for various keys, if you cant tell the key, you cant score it in a standard way.
An AI system for editing music in videos | MIT News[^] Not perfect. And I don't see why they didn't gate the unwanted instruments, just kill anything below a certain threshold. But it's a start.
We won't sit down. We won't shut up. We won't go quietly away. YouTube, VidMe and My Mu[sic], Films and Windows Programs, etc. and FB
-
Some humans can do it, so it must be possible.
Freedom is the freedom to say that two plus two make four. If that is granted, all else follows. -- 6079 Smith W.
:) Such an assumption! You really do believe computers can do everything a human can dont you? Extraordinary belief!
-
An AI system for editing music in videos | MIT News[^] Not perfect. And I don't see why they didn't gate the unwanted instruments, just kill anything below a certain threshold. But it's a start.
We won't sit down. We won't shut up. We won't go quietly away. YouTube, VidMe and My Mu[sic], Films and Windows Programs, etc. and FB
Have you seen the African made military jets? Apparently they have made a start: BBC - Future - Africa’s homemade aircraft builders[^]
-
:) Such an assumption! You really do believe computers can do everything a human can dont you? Extraordinary belief!
Munchies_Matt wrote:
You really do believe computers can do everything a human can dont you?
Except make more humans. That we'll still have to do for ourselves. :)
Freedom is the freedom to say that two plus two make four. If that is granted, all else follows. -- 6079 Smith W.
-
Munchies_Matt wrote:
You really do believe computers can do everything a human can dont you?
Except make more humans. That we'll still have to do for ourselves. :)
Freedom is the freedom to say that two plus two make four. If that is granted, all else follows. -- 6079 Smith W.
Computers are SO bad at thinking for themselves! They are slaves to a program written by a man. And that program has to think of everything! We dont even understand how our brains work, until we do we havent a hope in hell of replicating its ability/. (We dont even understand how a baby can be formed in just 9 months, heck, we dont even understand how anaesthetics work!)
-
I may be totally wrong, but it seems that there should be a fairly good piece of software that can "listen" to a WAV or MP3 of a song, and transcribe (polyphonically) the various parts into staves of notes for that instrument. Anyone know of such an application? Anyone aware of one being developed using machine learning? Thanks in advance.
AudioScore from Neuratron (Transcribe MP3s & CD Tracks with AudioScore) has been around for a while and offers a free demo (not sure if this is a trial period or a "can't save" version). I've no experience of it but their music OCR (PhotoScore) is pretty good.
Cheers, Pete Sykes
-
You want software, that can hear a song, and transcribe each instrument, being able to recognise two different guitars, a guitar from a bass etc, in its right key, a key which is determined by the average of the notes played, and is not even always evident, into notes that depend on that key? Dream on, it is impossible.
I already found several that do. They may not be able to differentiate an A440 by a guitar from a French Horn (though at least two do by analyzing timbre differences), but they all can analyze polyphonic musical sounds and differentiate. Welcome to the 21st century!
-
I already found several that do. They may not be able to differentiate an A440 by a guitar from a French Horn (though at least two do by analyzing timbre differences), but they all can analyze polyphonic musical sounds and differentiate. Welcome to the 21st century!
MSBassSinger wrote:
an A440 by a guitar from a French Horn
So they dont work. Now, do they recognise the key the music is in?
-
I may be totally wrong, but it seems that there should be a fairly good piece of software that can "listen" to a WAV or MP3 of a song, and transcribe (polyphonically) the various parts into staves of notes for that instrument. Anyone know of such an application? Anyone aware of one being developed using machine learning? Thanks in advance.
I have used both Finale and Sibelius do to this with varying degrees of success depending upon the actual music. Both offer trials so that you can see if it works for you.