Industry


Ads by TechWords

See your link here


Subscribe to our e-mail newsletters
For more info on a specific newsletter, click the title. Details will be displayed in a new window.
Computerworld Daily News (First Look and Wrap-Up)
Computerworld Blogs Newsletter
The Weekly Top 10
More E-Mail Newsletters 
Ryan Faas's picture
Ryan Faas

Biting the Apple

How does iTunes 8 Genius know what sounds good together?

The rumors about iTunes 8 and it's Genius feature that automatically creates playlists from your iTunes library and suggests music to you from the iTunes store turned out to be completely true. When I first heard the rumors about this feature, I thought immediately of BeaTunes, a cross-platform third-party add-on for previous iTunes releases. Among features aimed at helping correct errors in tags for tracks imported into iTunes (such as mismatched genres or misspelled artist names), BeaTunes offers the ability to rank songs that will sound similar and likely go well together based in part on their beats per minute (an obscure tag available in iTunes that BeaTunes could populate for you if it were missing for any tracks).

Turns out that Genius has much more magic going on behind the scenes. The service actually gathers a set of information about all songs in your iTunes library, uploads it to Apple’s servers, and then returns an analysis of your library that identifies music that sounds good together. Along the way, it suggests other tracks, albums, and iTunes collections for songs (think of it as the old iTunes mini-store on steroids).

Genius is designed to update its analyzing capabilities not just by the anonymous data it collects from your iTunes library but by the data collected from all users. Theoretically, this should mean matches for everyone get better as time goes on. Privacy advocates will probably question just how anonymous this information actually is, particularly when the feature also requires an iTunes Store account/Apple ID to function. Even without that stipulation, the question of privacy could easily be raised based on a computer’s network identifying information.

What isn’t completely clear yet is just what information Apple is using to generate Genius results and how that information is being analyzed. Though the results in my initial testing are more or less spot-on, I have noticed a couple of interesting tidbits.

Genius can’t create playlists for a handful songs because it "Genius is unavailable" for them. Ironically enough, some of these songs will show results in the Genius sidebar. In a handful of other cases, the Genius Sidebar reports I'm missing songs related to an artist even though those songs exist (albeit not fully tagged) in my library. To further deepen the mystery some of the songs that show up in Genius playlists sound great next to the song used to generate the playlist (showing Genius is working pretty well) despite having misspelled artist and track names and no additional tags.

Genius definitely seems to be pulling information from more than just the expected artist, album, and genre tags as well as the more obscure beat per minute tag (which isn’t populated for anything in my library except for iTunes Store purchases). Given that each iTunes library stores a wealth of additional information about music (play counts, skip counts, ratings, playlist inclusion, and the dates a track was added and last played to name a few), Apple certainly has a great deal of information available for Genius to use – most of which seems to be encapsulated in a new file "Genius.itdb" in the folder containing an iTunes library. No doubt this file will be synced to new crop of iPods allowing them to generate Genius playlists on the fly without a computer

Whatever the magic is, it definitely seems to work pretty well (though it might prove helpful to be able to tweak some of the settings, or even know what they are) and it will be interesting to watch in the coming weeks to see the changes that occur in Genius results as Apple begins to analyze more data.

What People Are Saying

Genius Algorithm Uses Playlist Data?

I suspect the algorithm behind itunes genius relies heavily on user-created playlists: if two songs appear together in the same playlists of many different itunes users, then those songs become linked in the "mind" of genius. The frequency of two (or more) songs to appear together in various playlists creates a viable data set for an algorithm to use in predicting what songs "go" with one another. Other factors (e.g. songs with high play counts, songs with similar "last played" date/timestamps, etc.) probably play an important role in establishing links as well. But it just seems logical that an alogrithm designed to create playlists should do so by analyzing existing playlists.

Playlist saving is availble

"Genius can’t create playlists for a handful songs because it "Genius is unavailable" for them" - Wrong? Genius Playlist saving IS available

Well it is on my machine, maybe this review is a bit older then the version i have now. I expect itunes made is possible to save Genius Playlists now then.

Genius is brilliant, i listen to music i was unaware i had. :D

what he meant was..for a few

what he meant was..for a few songs Genius cant generate a playlist..like..genius is unavailable for some songs.. Genius is amazing tho!

Needs Improvement

I picked a Mr. Bungle song and genius added a bunch of Iron Maiden to the playlist. when i added a Lovage song genius throws a bunch of Harry Belafonte in the mix... hmmmm strange. i sure hope genius gets smarter as time goes by.

My first thought...

The first thing that came to my mind once I tried the Genius playlist feature was... Are lazy boyfriends/girlfriends everywhere going to use this program to make mix cds for their partner? haha. Not sure why this worried me so much. This feature both excites and saddens me. It works pretty well for me and I've discovered some great songs I'd never listened to before! But it kind of takes some of the magic out of personal mix making... I hope no one ever gives me a mix cd made by genius that they pretended to make themselves..

Who cares...

...if I-tunes comes up with a good mix and someone passes it off as something they did. It's all about discovering and sharing good music :)

Genius = Amazing!

I'm so utterly astounded by this amazing new feature... Never in my life have I felt inclined to write to a company to congratulate them on a product, but this has got me looking for Steve Job's email address!
My 60Gb iPod has been jam-packed with all sorts of music, and looking down iTunes, I see that 75% of the tracks have never been played in the three or four years I've had the iPod.
Genius is slowly changing all of that, by re-introducing me to tracks I never even knew I had!
It's simple, incredibly effective, and I love it.
Hope you do too.
Chris

Genius=amazing

I agree with Christopher- it's amazing, and I even wrote apple to tell them so!

just a fancy shuffle feature

While I haven't experienced this Genius feature in action on my own library... right off the bat the idea of relating music with other music and suggesting new music reminded me of http://www.last.fm

I don't want to make this an advertisement for last.fm (which apparently is related to Pandora, mentioned in this thread), but from what I can tell they gather play count information from music player programs on your computer and your mp3 device; compare that info to the info of others and from there they can easily decide that since 94% of all 'Metallica' listeners also listened to a comparible amount of 'Pantera' ... chances are thats an easy recommedation for you, for instance. So when Genius sets up a playlist for you, it'd probably be easy to tell that since you're listening to a Metallica song.. HEY maybe throw in a Pantera one as well! Sure factor in bpm, your own personal play counts.. or perhaps general info on the tracks in question and HEY since that Metallica is a slower song, lets throw a slower Pantera song in there too. The genius.itdb may just be a long list of artists and songs in your library that equates to:

Metallica: Pantera, Dio, Iron Maiden, Megadeth.
--- (metallica song): (similar song), (similar song).

For people new to this technology - if you want to call it that - on LastFm the data they've gathered through recorded plays, recommendations and comments from users as well as general info about the bands/artists and quite accuratley groups music together into 'radio station' streams. While I've only really used it for older jazz, indy/rock, heavy metal and some hip-hop; LastFm was able to piece together many similar bands (be they in the same genre, have toured together, share record labels/equipment sponsors, or just all relate to a single topic or era) while keeping it interesting and opening you up to artists you may have never heard of.

I'm sure there are plenty more radio sites and applications like this that I haven't used.. but my main point is that even though Apple is a bigger and 'sue-ier' company... I wouldn't hesitate setting up the genius and not worrying about whatever pirated music I may or may not have in my collection, or if any other questionable info is being sucked into Genius' database.

The main downside of using iTunes Genius compared to a site like LastFM and it's partner sites that I could point out right off the bat is the fact that iTunes isn't going to have the unsigned, independent, newer music that LastFM does. Say you like whatever, Phil Collins for instance ... that new wave edgey retro band just out of San Diego that all Phil Collins listeners love but hasn't set up a record deal or signed a deal to sell on the iTunes store more than likely won't be featured in your Genius recommendations.

And for those of you wondering.. JUST HOW DO THEY DO IT!?! ... it doesn't seem like a mystery to me, I mean they've been asking me if I want to submit info about my iTunes library everytime I updated the client or installed a new one since before I can remember - maybe they've actually been doing something with all that data! My best bet says that much of Genius' inner-workings are housed on Apple servers, then spit back into your genius.itdb for safe keeping when not connected to the internet and have much less to do with the actual info tags from your own personal library or the info tags of other 'anonymous' users.

If my hunches are anywhere near correct.. Genius won't truely live up to it's name for a little while and continue to be somewhat innacurate at times until we see another iTunes update OR as info is gathered and truely time-tested on Apple's end.

It's not a bad augment to other music recommending applications, a great way for casual music listeners to find music or just a fancy shuffle for people that can't do it themselves with any skill (LIKE ME !).

Okay, Genius (he he, don't

Okay, Genius (he he, don't mind the pun)

It's cool that you made a gigantic comment post concerning a technology you have not yet used, but answer me this....

Why is it, that Genius was able to include a song I REMIXED/MASHED-UP on a Genius playlist?
I took the vocals from 'Kryptonite' by Purple Ribbon All Stars and put them over the dubstep/electro/techstep song H.A.L. by Ed Banger artist SebAstian. The track is simply named 'Kryptonite Remix' and the artist is listed as me - LoveTongueAttack.

Genius threw that song on as a response to T.I.'s Whatever You Like.
The songs go great together.

Explain THAT shit with your theory!