Stories
Slash Boxes
Comments

News for nerds, stuff that matters

Slashdot Log In

Log In

Create Account  |  Retrieve Password

Researchers Create an Automatic Backup Band for Singers

Posted by ScuttleMonkey on Mon Apr 07, 2008 11:47 AM
from the william-hungs-of-the-world-unite dept.
Researchers at Microsoft Labs are hoping to allow untrained singers to have their own automatic backup band in the near future. A new piece of software, "MySong", promises to take a sung melody and using a probability computation algorithm, generate an appropriate chord accompaniment. There is also a video of the process on the Microsoft Labs website. "'The idea is to let a creative but musically untrained individual get a taste of song writing and music creation,' Morris told New Scientist. 'There was nothing out there that could take a sung vocal melody as an input and then generate appropriate chords to accompany it. [...] Since people rarely sing at precise frequencies, MySong compares a sung melody to the 12 standard musical notes. It then feeds an approximate sequence of notes to the system's chord probability computation algorithm. This algorithm has been trained, through analysis of 300 rock, pop, country and jazz songs, to recognize fragments of melody and chords that work well together, as well as chords that complement each another.'"
+ -
story
This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • by suso (153703) * on Monday April 07 2008, @11:47AM (#22990328) Homepage Journal
    This is nothing new. The first piece of music hardware/software I saw that did this was called Vivace or something like that and it came out back in 1994. There are also other programs in the past and present that do this.
    • Re: (Score:3, Insightful)

      Fuck this. This is just going to make pop music even MORE dreadful to those of us who actually appreciate the artistic quality of music. Oh, look, some blond whore can screech into the mic and it'll make the whole damn song for her! Yay! Yes, let's take one of the most important part of music creation and base IT off of a formula now, too.
      • by D'Sphitz (699604) on Monday April 07 2008, @11:56AM (#22990460) Journal
        Uh, so don't listen to it... I don't understand why people like you get so angry over pop music, welcome to the free world where you can listen to whatever music you like, and hopefully let others do the same.
        • Re: (Score:2, Informative)

          Because it's fucking impossible to find decent music around here, where we don't have any specialty music shops. All it is is pop shit. I'm sick of it.
          • by mpathetiq (726625) on Monday April 07 2008, @12:13PM (#22990748) Homepage
            I'm not sure if you realized it, but the machine you are using to post on Slashdot can also be used to research, discover AND purchase all kinds of music! It's amazing!
          • Welcome to the tubes young grasshopper.

            If you want music that matches your tastes, look for it. Don't bitch that the local sheepmart doesn't carry it. Sheepmarts cater to sheep. If you aren't willing to be a sheep then don't bitch about the fact that the selection isn't tailored for you.

            If you honestly CAN'T figure out how to look for it, then you need to turn in your nick.
      • The thing is, music has ALWAYS been based off mathematical formulas at its core. The "art" really lies in the musician picking and choosing options that work well together to create something pleasing to the ear. (Well, that plus the skill of being proficient in playing an instrument of choice, and/or talent in singing the vocals well.)

        I've played with software in the past that promised to build backing tracks "automatically". There's a pretty neat one called "The Jammer Pro", for example, or the more rudimentary "Band in a Box" software.

        The thing is, you still have to make musical decisions as to which portions of what they generate you'd like to keep, which you'd like to delete, and which give you some good ideas, but need "tweaking" to make the best use of them.

        The Jammer Pro, for example, would let you drag and drop in a "session rock guitarist" for example, and would write electric guitar solos to go along with the chord changes and tempo you specified as the "core" of your song. Some of these were really good! But you had to audition everything it made, and hit "redo" a lot to discard ones that weren't so good, before it came up with something that was a "keeper".

        I really don't envision a computer creating perfect "backing tracks" in real-time to any vocals sung into it. It's more like, it'll sometimes/often make "passable" ones, fun for karaoke or practicing -- but not worthy of recording.
        • I really don't envision a computer creating perfect "backing tracks" in real-time to any vocals sung into it. It's more like, it'll sometimes/often make "passable" ones, fun for karaoke or practicing -- but not worthy of recording.

          Given that pop music is already arguably not worthy of recording, I'm not exactly sure that there's any impediment to this being used for pop music.
          • As a musician, I actually think it's kind of neat. I could actually have some fun with something like this.

            Machines cannot replace musicians. Music is emotional. It is improv. It is creative. Machines do as they are told, and even if they have some complex AI going on, they can still only function according to the parameters they are given. And since a human has to program the machine, the machine cannot be a better musician than the person or persons who programmed it. There is a difference between playing chords to a song and making it your own. Think of all the jazz standards, for example. How many different versions are there of, for example, Misty? Countless. Or how many songs use Gershiwn's "Rhythm" changes? Check this out: http://songtrellis.com/changesPage [songtrellis.com]. Lots of chord changes there. But each version of each song is unique. Music is art. It's not about who is technically "better" or who plays the changes perfectly; oftentimes it the deviations from perfection that can make a song so compelling. Until someone makes a machine with the ability to improvise in response to the lead singer or soloist, convey emotion, *enjoy* music, and discover new things through taking risks and making mistakes, musicians won't become obsolete whatever that means, as if people won't still enjoy making music even if machines *could* do it better.

            It's a neat toy, and nothing more. And if crappy pop music uses machines for a backing band, who would even notice? With that form of music, the background music is like the tires on your bike, you don't care about them until they blow. The teenies who buy that crap don't care about music, they are buying into a fantasy that they can be cool and popular and all the crap the pop icon represents. I'd bet that the musicians who back the likes of the Backstreet Boys and Britney and so forth hate it anyhow, they are probably being paid well to be musically bored to death. I feel sorry for those guys. It'd be such a drag to back up a bunch of no talent rich kids. Now, that's a perfect job for machines. Automate the mundane, do the interesting stuff.
              • Re: (Score:3, Interesting)

                As a programmer, I can tell you that oftentimes the results a good program generates surprise even the author.

                And as a GOOD programmer I can tell you that the results of a GOOD program come as no surprise to me because that's how I intended it to work!

                As for music generation, someone said that music is emotional and yadda yadda. What the? Have you listened to any modern "music" lately? It's all the same shit with the same whiny lyrics about either drugs or sex and it's generally terrible.

                Good music is coming harder and harder to find. The Internet was supposed to open up new roads to finding music but instead

      • That's about what I was thinking. Actually the first thoughts out of my head were:

        "Oh, for fuck's sake! Is creating and playing music really that fucking hard?" I mean, people have been doing this shit for CENTURIES, folks! Millennia even!

        I can just see it now:

        Seacrest: Welcome to Microsoft Idol! And welcome to tonight's first contestant, Sanjaya! In our last round, Sanjaya blue-screened our backup computer band....can he make a comeback tonight? Let's find out!
      • Oh, look, some blond whore can screech into the mic


        Some Blond Whore is one of the best new bands out there. You should give them a listen.

    • Ditto. Back in the mid-1980s IRCAM released software that could accompany a live pianist or flautist, even adapting to his own personal style.
    • by J.F. Gallay (1214374) on Monday April 07 2008, @12:06PM (#22990630)
      Vivace (now Smartmusic) uses preprogrammed MIDI files to accompany. It does not make it up. I teach harmony, and let me tell you that the vast majority of pop music out there is incredibly limited in its harmonic vocabulary. Out of all typical harmonic devices used to support a melody, your standard radio material probably uses about 5% of them. So, while this does seem to be a pretty simple and effective implementation of the same processes I teach to students, it is not that hard to do. As long as you set your sights on typical pop music, you can churn out the songs very quickly with sophomore-level training. As a professional musician myself, I for one welcome our new harmonic....oh, never mind.
  • by arkham6 (24514) on Monday April 07 2008, @11:51AM (#22990374)
    Now they just need to have artificial voices sing music, and random word generators to make lyrics, and the music companies can stop paying those pesky artists!
  • by EaglemanBSA (950534) on Monday April 07 2008, @11:53AM (#22990394)
    ...considering how unimaginitive most bands are today - the 1-4-5-1 progression is so prevalent in pop music, you can hum most songs on the radio within the first two minutes of listening to it.

    Experiment: pick three Linkin Park songs (from their frist couple of albums), play the first, and sing the melody from the second or third over it. You'll be amazed at how different they aren't.
    • Don't forget the tired but reliable 1-5-6m-4 for emo songs that need at least one minor chord to project all that angst... oh my.. how angsty...

    • Well I think thats the point. Pop muzac has gotten so predictable, you can guess what genre of crap the singer has chosen (probably just a simple bayesian filter, maybe a neural network) and throw in an appropriately awful background.
      • Re: (Score:3, Insightful)

        All music is fomulaic. How do you think Beethoven was able to compose music even after he went deaf? Bach's music has been used as an example of how the mathmatics of music is similar to Godel's theory. Ever seen two musicians "jam" together? Ever wonder how they can sound so great even though it's the first time they've ever played together? It's becuase it's formulaic, once you know the formula for jazz you can play with any jazz musician (assuming you can play an instrument). Get off your ignorant high h
    • I can't disagree with what you actually posted, but as far as this software goes, it all comes down to the training data. If it's mostly trained on top-40 pop, which is simple, formulaic, and doesn't really deviate much from the same few chord progressions, then it will be quite good at auto-generating top-40 pop-style music. It will of course be rubbish at everything else.

      Training it on diverse music would be ideal if they had a lot more training data to work with. Otherwise you'll end up with very incoher
      • Yes, but... (Score:5, Insightful)

        by Nerdposeur (910128) on Monday April 07 2008, @12:19PM (#22990848) Journal

        ...even if you can get it to create long, coherent chord progressions, it still will have to stick to chords that match whatever was sung. Even if the system knows how to do jazzy chord changes and secondary function chords and such, an amateur singer won't sing a melody that will flow well with that.

        The melody and the chord structure fit together very intimately. If someone doesn't "hear" the chords they want in their head, they probably won't sing a melody that will need an interesting chord progression behind it to make it work.

        And of course, for any given melody, there are multiple possible progressions (do you want a IV or a I chord here? Or maybe a V7/V?). The singer will need to have the musical sense to choose which one they want.

        • Re:Yes, but... (Score:4, Interesting)

          by Sciros (986030) on Monday April 07 2008, @12:37PM (#22991104) Journal
          You're absolutely correct on all points. The system will create "best guess" chord progressions, in any case. I assume it's able to create several guesses based on a probability threshold the user sets initially (probably something like "show me the top 5 most 'fitting' progressions").

          Based on what it's trained on, the system will show certain tendencies. If after training it's boxed up and given to a user to work with (no further training possibly by user), then the user will have to learn what these tendencies are and adjust accordingly.

          And yes, to not create total rubbish the singer will have to have some musical sense. Just like how a "language model" is used to pick out the most-likely-to-be-correct translation from a lattice that the translation model generates in statistical natural language translation systems, the singer might need to pick out what he/she desires out of a set of possibilities the music generation system presents.

          So, if your point was that this system will not be able to instantly fulfill an amateur singer's desires, then you're definitely right. Ideally the system would be able to be further trained on music the amateur singer personally enjoys (or wants to emulate), and would also learn from the choices the singer makes when selecting progressions generated by the system. Over time, then, it would do a better job of mapping the singer's vocals to what he/she wants to hear as an accompaniment.
        • Re:Yes, but... (Score:5, Interesting)

          by dkleinsc (563838) on Monday April 07 2008, @01:24PM (#22991726)
          That is and it isn't true. As someone who's often responsible for improvising harmonies to match a melody, it's quite possible to provide an interesting harmony to a boring melody and vice versa.

          My personal favorite example here is the popular song "Turkey in the Straw". The traditional harmony goes something like this (assuming the key of C):
          verse: C-C-C-C-C-C-G-G-C-C-C-C-C-C-G-C
          chorus: C-C-C-C-F-F-F-F-C-C-C-C-C-C-G-C
          However, this is a very nice more complex harmony:
          verse: C-C-C-C-C-Am-Dm-G-C-G/D-C/E-C/E-F-D/F#-G-C
          chorus: C-C-C-C-F-F/E-Dm-G-C-D-D#dim-C/E-F-D/F#-G-C

          The melody works either way, but the harmonies are quite different.
    • by qengho (54305) on Monday April 07 2008, @12:19PM (#22990846)

      Linkin Park songs...You'll be amazed at how different they aren't.

      Somebody took two songs, pitch-shifted one (and probably tweaked the timing a bit) and built an MP3 with one song in each speaker. [caltech.edu]

    • Experiment: pick three Linkin Park songs (from their frist couple of albums), play the first, and sing the melody from the second or third over it. You'll be amazed at how different they aren't.
      I'll take your word for it.
    • Re: (Score:3, Insightful)

      Oh, don't be so quick to dismiss the humble I-IV-V.

      Sure, it's easy to pick up and make a song with it. Sure, pop, rock, and just about everything else is built around the I-IV-V. That doesn't dilute the power of the I-IV-V. There's a lot to be said for taking a simple canvas and working with it. It comes from the blues and evolved to jazz (in the form of ii-V-I). It's a formula, and one that you can squeeze a lot out of. I could point you to some songs that use a I-IV-V that would blow you away. You
  • I'm sure there is a hidden back door to the RIAA to get your IP address so they can come knock on your door because you stole someones music in singing your own songs
  • This will further devalue the pop music product that made record labels so much money.

    The walls are falling in on an industry that cashed in on people's inability to tell good music for bad.

    This is good news for all musicians who make music worth listening to, as opposed to music worth blaring out of a radio in the background while you IM, buy corporate media on Amazon.com, watch TV and send pictures of your weener to "girls" you met on myspace.
  • "Thank-you, NASA!"
  • Now we can focus even more closely on repeating, copying and imitating already tired simulacra and finally do away completely with pesky things like creativity and insight! The technology of tomorrow, today!
  • I'm surprised this wasn't invented by Stock Atiken Waterman [wikipedia.org]!

    Bonus video! [youtube.com] :)

  • "Talk about pi**ing your money away. I hope you kids see what a silly waste of resources this was." -- Frances Smith, "Christmas Vacation"
  • I'm working on this program called MyEar.

    It's a probability computation algorithm that has been trained, through analysis of 300 rock, pop, country and jazz songs, to recognize fragments of melody and chords that work well together, as well as chords that compliment each another.

    I'm going to feed the output of MySong directly into the input of MyEar, and get all those annoying humans completely out of the loop.

    And then...and then...I'll plug the humans into little VR pods, one per human (they'll never notic
  • DMC-whA? (Score:2, Interesting)

    So who is to blame if a song input from a user results in a generation of notes that is already has a copyright?
      • Re: (Score:3, Interesting)

        In Sweden anything that has been made by a machine can't be copyrighted so I'd guess you can't get sued for it and the RIAA might even risk losing their copyright.
  • I think the brain power would be more well spent if they created a robot that does research.
    The humans seem to only ever think of bad ideas.
  • Gah.

    I strongly suspect this will end up like the "watercolour" and "oils" filters on photoshop - as in "interesting, but no substitute for talent".

    Expect to see this IP in karaoke and sing along machines to convince gullible people they have talent (and less money).

    I have this weird mental image of George Gerswhin arguing with his new electronic piano (yes, I know he's dead) before throwing it out of his window.

  • by Minwee (522556) <dcr@neverwhen.org> on Monday April 07 2008, @12:19PM (#22990840) Homepage
    Sure, first you reduce every song to a sequence of twelve standard notes. Then you start applying regular expressions to match the patterns, and before long it's meloncholy elephants [spiderrobinson.com] everywhere.
  • by Simonetta (207550) on Monday April 07 2008, @12:33PM (#22991044)
    I 'discovered' that the best way to sing in tune (with recordings, or a group) is to cup one hand about one foot (@30cm) in front of your mouth and cup the other hand behind one of your ears.

      While singing, your voice bounces off the hand in front of your mouth and then gets redirected into your ear. Then you can adjust the pitch of your voice to harmonize with that of the recording. This really makes a difference in your ability to sing in tune.

      I thought that this was my secret trick until I saw the BeeGees on television long ago and Robin Gibb was using the same 'hand behind ear' technique to get his complex falsetto parts just right. The studio monitor fed his voice towards his ears.

        I know, I know, the BeeGees, don't laugh, during the years 1975 to 1979 they were best male ensemble vocalist group in the popular music world. Dorks maybe by current standards, but who are Slashdaughters to judge in that regard?

        Anyway, I realize that the last thing a Slashdot reader will ever do is sing. But most Slashdot readers have an obsession with doing things right, should the need ever arise, then in regards to singing, this is how it can be done right.

        I suspect that this Microsoft program, like all Microsoft pop culture products, will go nowhere and die a slow, embarrassing death should it ever get released. It sounds to me (bad pun) like the auto-play features found on those plastic WalMart keyboards that are too cheap and dumb to have MIDI ports included on the back. Microsoft should put this code into open-source and take a tax write-off on the development costs.

        And speaking of which, just exactly WHY is Microsoft researching automatic computer music product generation? If I recall correctly, don't they make personal computer operating systems and business software. I guess that it must be that since they found and eliminated all the bugs in their primary products that they were looking for a new challenge. And they want to get some of the glory that is coming from the Rock Star plastic button guitar weirdness that is currently popular among the less-musically-inclined sector of the population.
  • Headline Correction (Score:3, Interesting)

    by eno2001 (527078) on Monday April 07 2008, @12:56PM (#22991400) Homepage Journal
    Was: "Researchers Create an Automatic Backup Band for Singers"
    Correct Version: "Researchers Create a BAD Automatic Backup Band for BAD Singers"

    OK. That was silly of me. But, I do have to say that if all music in the future was created like this, I'd probably stab myself in the ears. It's early in this game though... I suspect that once the concepts of the software are ironed out, the addition of more interesting chord progressions will happen. I'm still wondering how real musicians would wind up finding any use for this?

    I've been using computer based music sequencers since the mid 80s and I think the last thing any real musician wants to see is "Microsoft Composer". I can see it now, instead of Clippy, they'll have "Wolfy" which will be a horrid caricature of Mozart appear every time you start to create a song:

    1. You make something using minor 7ths and 9ths and Wolfy shows up, "I see you're writing an 'unhappy' song, would you like to make your song happy"?
    2. You start sequencing something very abstract and atonal and this is the way you've worked on music for nearly three decades, up pops Wolfy, "It looks like you're having trouble getting started, would you like me to show you how to do a basic major C chord progression"?
    3. You start inputing some heavy polyrhythms, and Wolfy butts in again, "Your song appears to be too rhythmically different, do you need help with a standard 4/4 beat"?

    Ugh... more and more reduction to the lowest common denominator. Back in high school a friend and I came to the conclusion that all highly popular music would eventually be one note surrounded by 4/4 beats and grunts for lyrics. This software certainly seems to be taking things in that direction.

    I keed I keed.
  • by treeves (963993) on Monday April 07 2008, @01:15PM (#22991610) Homepage Journal
    "Compliment each another"?
    chords and melodies cannot compliment one another, however, they can complement one another, like complementaty colors.
    and "each another" is just sloppy.
    I've got mod points, so I'm not worried too much about burning karma...thus the latent grammar Nazi comes out.
  • by MonkeyBoyo (630427) on Monday April 07 2008, @01:36PM (#22991856)
    If somebody asks to be accompanied on an unknown song, most musicians will initially try the 4 chord progression known as Rhythm changes [wikipedia.org] (named for Gershwin's "I've got Rhythm"). Often it works, and in listening to MS kludge it seems they likes their Rhythm changes.
  • by awtbfb (586638) on Monday April 07 2008, @01:38PM (#22991870)
    Has anyone set this to "Developers! Developers! Developers!" yet?