• user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '1:e4d7145b755027e2486d9c772384aa0b' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • : preg_replace(): The /e modifier is deprecated, use preg_replace_callback instead in /home/adifferentname/the-ensemble.com/includes/unicode.inc on line 345.
  • : preg_replace(): The /e modifier is deprecated, use preg_replace_callback instead in /home/adifferentname/the-ensemble.com/includes/unicode.inc on line 345.
  • : preg_replace(): The /e modifier is deprecated, use preg_replace_callback instead in /home/adifferentname/the-ensemble.com/includes/unicode.inc on line 345.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<p>Yesterday, Sept 21st, Netflix announced that the winner of the $1 million Netflix Prize is \"BellKor\'s Pragmatic Chaos(BPC),\" and we congratulate them on their victory. The contest was remarkably close, and now we know precisely just how close it was.</p>\n<p>In accordance with Netflix\'s rules, the RMSE score for the judged half of the submission (the test subset) is rounded to 4 decimal places. The two teams actually tied on this measurement. In this situation, the tie breaker becomes the order of the submissions. Bellkor\'s Pragmatic Chaos defeated us by submitting just 20 minutes earlier! Talk about close.</p>\n<p>Netflix has graciously donated the entire data set for public consumption to: <a href=\"http://archive.ics.uci.edu/ml/datasets/Netflix+Prize\" title=\"http://archive.ics.uci.edu/ml/datasets/Netflix+Prize\">http://archive.ics.uci.edu/ml/datasets/Netflix+Prize</a>. Included in this dataset is the quiz and test set answers, as well as the winning submission from BPC. This allowed us to determine both the precise test RMSE values and to get a little insight into the question: What would have been the result of The Ensemble and BPC working together?</p>\n<p>Here are those values:</p>\n<p>Test RMSE for The Ensemble: 0.856714 (10.06%)<br />\nTest RMSE for Bellkor\'s Pragmatic Chaos: 0.856704 (10.06%)<br />\nTest RMSE for a 50/50 blend: 0.855476 (10.19%)</p>\n<p>The percentages are the improvement over the Test RMSE of Cinematch (.9525).</p>\n<p>We would once again like to thank Netflix for it\'s pioneering contest and deft skill in managing it. It is easy to predict that Netflix Prize 2 will be just as well administered. We would also like to thank all of the numerous participants in the contest. The vast interest kept it healthy and marching forward. This little corner of science we all studied was lit up quite brightly for a while.</p>\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '1:e4d7145b755027e2486d9c772384aa0b' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '2:7ab89116941d185f10c56dd99b2ad23a' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<p><img src=\"/images/final_netflix.png\" width=\"600px\" /></p>\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '2:7ab89116941d185f10c56dd99b2ad23a' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '2:124ab776d69a5dc49d1ecc826bbea607' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<style type=\"text/css\">\n.im_text {\n font-family: monospace;\n font-size: 14px;\n}\n.time {\n color: #999;\n}\n</style><p>Contributed by Lester Mackey</p>\n<p>Only sixteen minutes remained in the $1 million Netflix Prize competition when I handed over the final set of predictions to the Ensemble team captain. The members of our newly minted team had been working furiously through the night, hoping to improve upon our previous day’s score of .8554. It was hard to believe that just twenty-four hours ago we had passed the four-team coalition that had occupied the first place spot for the last 29 days. There was little time to celebrate; the previous leaders would not go down without a fight, so we had to be ready with something better. A call had been issued for any remaining valid predictors, anything that could tip the scale in this final day, and our members around the globe had answered the call: nearly 200 new predictor sets, some previously passed over for their poor performance and others newly conceived only moments prior, had flooded in from all corners of the team. It was now up to our blenders to work some last-minute magic.</p>\n<p><span class=\"time\">11:26 AM </span></p>\n<pre class=\"im_text\">\n<strong>me</strong>: gabor -- here\'s my new best\n i don\'t know how well it will do\n but it\'s possible it will give .8553\n\n</pre><p><span class=\"time\">11:27 AM</span></p>\n<pre class=\"im_text\">\n<strong>Gabor</strong>: what does the blender say?\n\n</pre><pre class=\"im_text\">\n<strong>me</strong>: 0.855345926622\n   so, cutting it close\n\n</pre><p>Our submission window opened just 9 minutes before the contest closed.   Gabor, our captain, had asked me to give him a countdown to our submission time via <span id=\"lw_1248837701_1\">Google</span> Chat.</p>\n<p><span class=\"time\">11:28 AM</span></p>\n<pre class=\"im_text\">\n<strong>me</strong>: 5 minutes\n\n</pre><p>There was nothing left to do but wait.</p>\n<p><span class=\"time\">11:29 AM</span></p>\n<pre class=\"im_text\">\n<strong>me</strong>: 4 minutes \n  bpc tied us\n   booo\n\n</pre><p><img src=\"/images/3_626pm_18_minutes_to_go_Bellkor_improves_a_point.jpg\" /></p>\n<p>Indeed, the previous leaders had issued their final submission and risen to tie our score.  I decided to check the Ensemble mailing list to gauge our members’ reactions.  Some expressed delight, others, alarm.  David W. repeatedly expressed confusion about why we hadn’t submitted, as only less than 1 minute remained in the contest.  (His clock was 13 minutes fast.)  </p>\n<p><span class=\"time\">11:30 AM</span></p>\n<pre class=\"im_text\">\n<strong>me</strong>: 3 minutes\n\n</pre><p><span class=\"time\">11:31 AM</span> </p>\n<pre class=\"im_text\">\n<strong>me</strong>: 2 minutes\n\n</pre><p><span class=\"time\">11:32 AM</span></p>\n<pre class=\"im_text\">\n<strong>me</strong>: wait\n   peng says he has .8552\n   !!\n\n</pre><p>That’s right: one minute before our scheduled submission time, I spied a post by Peng revealing his latest blending effort.  With an estimated score of 0.85525, it soundly trumped our intended submission. I logged onto the Vandelay Industries server to retrieve the predictions file but didn’t know which of the several hundred files was the right one to download.</p>\n<p><span class=\"time\">11:33 AM</span> </p>\n<pre class=\"im_text\">\n<strong>me:</strong> Peng -- what file is it quick!\n\n</pre><p>No response.  Peng, you see, unbeknownst to me or anyone else had lost his internet connection and had texted the first post by Blackberry.</p>\n<p><span class=\"time\">11:34 AM</span></p>\n<pre class=\"im_text\">\n<strong>me:</strong> WHAT FILE IS IT???\n\n</pre><pre class=\"im_text\">\n<strong>Jacob: </strong>This is the best RMSE we’ve seen so far, right? \n I vote we swing for the fences and submit this one!\n\n</pre><pre class=\"im_text\">\n<strong>Gabor</strong>: 1 minute and i have to submit!!!!!\n\n</pre><p><span class=\"time\">11:35 AM</span></p>\n<pre class=\"im_text\">\n<strong>me:</strong> WE DON\'[T KNOW WHICH FILE--HURRRRRRRRY<strong></strong>\n\n</pre><pre class=\"im_text\">\n<strong>Ces:</strong> SHouldn\'t we submit NOW?\n\n</pre><pre class=\"im_text\">\n<strong>Gabor:</strong> Lester!!!!!!!\n\n</pre><p>You can imagine my frustration.  </p>\n<p>It was now two minutes <i>after</i> our intended submit time and seven minutes until the contest closed.  I searched frantically through the folder for files with .85525 in the name but couldn’t seem to find any.</p>\n<p><span class=\"time\">11:36 AM</span> </p>\n<pre class=\"im_text\">\n<strong>Gabor:</strong> !!!\n\n</pre><pre class=\"im_text\">\n<strong>me</strong>: i don;\'t know!!\n   i can\'t find it!\n\n</pre><pre class=\"im_text\">\n<strong>Gabor</strong>: ok\n   i submit yours\n\n</pre><p>And then, I saw it. </p>\n<p><span class=\"time\">11:37 AM</span> </p>\n<pre class=\"im_text\">\n<strong>me</strong>: wait\n i found it\n opera_est_0.855259.txt.gz\n\n</pre><p><span class=\"time\">11:38 AM</span></p>\n<pre class=\"im_text\">\n<strong>Gabor</strong>: i\'m uploading\n\n</pre><pre class=\"im_text\">\n<strong>me</strong>: ok, awesome\n\n</pre><pre class=\"im_text\">\n<strong>Gabor</strong>: i\'m afraid it was late\n\n</pre><pre class=\"im_text\">\n<strong>me</strong>: uh oh\n   it\'s not 11:42 yet\n\n</pre><p>\n<span class=\"time\">11:39 AM</span></p>\n<pre class=\"im_text\">\n<strong>Gabor</strong>: but uploading is slow\n\n</pre><pre class=\"im_text\">\n<strong>me</strong>: 4 minutes to spare\n it registered\n\n</pre><pre class=\"im_text\">\n<strong>Gabor</strong>: ok submission successful :)\n\n</pre><p><img src=\"/images/7_649pm_yayay_ensemble_improves_a_point.jpg\" /><br />\nYes, submission successul.</p>\n<pre class=\"im_text\">\n<strong>me</strong>: That\'s what this team\'s all about -- living on the edge :)\n</pre>', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '2:124ab776d69a5dc49d1ecc826bbea607' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '1:a2e8f3197ff0e65329c0dcffbd5c1879' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<p>The contest is now officially over. Bellkor\'s Pragmatic Chaos and The Ensemble finished within .01% of each other. What great work on both sides! It was a very dramatic march for The Ensemble these last 30 days, and there was an even more nail-biting conclusion as we raced to get the best submission in place.We salute Netflix, BellKor\'s Pragmatic Chaos, and everyone who participated in the competition!</p>\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '1:a2e8f3197ff0e65329c0dcffbd5c1879' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '2:6b9a8c03772754840671ea41713927fe' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<p>We are happy today to have made a submission which surpasses <a href=\"http://www.netflixprize.com//leaderboard?limit=10\">Netflix\'s 10% Grand Prize</a> target. <b>The Ensemble</b> is the second team to do this in less than a month. We are very proud of our achievements, and those of our top competitor, <a href =\"http://www.research.att.com/~volinsky/netflix/bpc.html\">Bellkor\'s Pragmatic Chaos</a>.</p>\n<p><b>The Ensemble</b> was created by a merger between the two teams that appear on the leaderboard as \"Grand Prize Team\" and \"Opera Solutions and Vandelay United\".</p>\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '2:6b9a8c03772754840671ea41713927fe' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '2:6d8642b7e922dad826f5664d55a40efa' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<p>The <b><i>crowd</i></b> is indeed wiser than the <i>individual</i>.</p>\n<p>The 10% barrier once seemed distant and insurmountable. But when the contest\'s \"last call\" heralded the heroic achievements of Bellkor\'s Pragmatic Theory, the rest of the crowd pondered, and asked why the barrier couldn\'t be broken twice.</p>\n<p>And lo, as if powered by gravity, <a href =\"http://www.grandprizeteam.com/GPT/\">Grand Prize Team</a> and <a href=\"http://www.indopedia.org/Vandelay_Industries.html\">Vandelay Industries !</a> began to draw in more and more members. And Vandelay went on to join forces with <a href=\"http://www.operasolutions.com/index.html\">Opera Solutions</a>, and then Vandelay and Opera united with Grand Prize Team, and then ... and then ... well, things got so complex we decided just to call ourselves <b>The Ensemble</b>.</p>\n<hr />\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '2:6d8642b7e922dad826f5664d55a40efa' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '2:aa10d8b102eee350bf981cbd8175db4d' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<p>Chris Hefele\'s dramatic visualizations of the relationships between movies in the Netflix database are featured in <a href=\"http://portal.acm.org/citation.cfm?id=1536622&amp;jmp=cit&amp;coll=portal&amp;dl=ACM#CIT\" target=\"new\">this article</a> from the August issue of Communications of the ACM.</p>\n<p>These images have also been displayed on <a href=\"http://www.visualcomplexity.com/vc/project.cfm?id=496\" target=\"new\">visualcomplexity.com</a> and on <a href=\"http://www.flickr.com/photos/chef_ele/sets/72157621825510293/detail/\" target=\"new\">Flickr</a>.</p>\n<p><img src=\"/images/471360379_0afb5067ab_m.jpg\" /></p>\n<p>For much more, check out our <a href=\"http://www.the-ensemble.com/content/netflix-prize-movie-similarity-visualization\">visualization page</a>, where there\'s a large \"map\" of movie similarities that you can explore interactively, as well as many newer, larger high-resolution images you can download.</p>\n<p>For the most up-to-date images for publication, please <a href=\"/contact\">contact us</a>.</p>\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '2:aa10d8b102eee350bf981cbd8175db4d' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '2:0b14ff0ac935c312d61c5bc1b7553e27' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<p>The members of The Ensemble want to thank Riley Cordova ( <a href=\"http://rileycordova.com\" target=\"new\">http://rileycordova.com</a> ) for the great job that he did designing this website.</p>\n<p>We also want to recognize the contributions of Clive Gifford ( <a href=\"http://clive-gifford.blogspot.com\" target=\"new\">http://clive-gifford.blogspot.com </a> ). Clive did everything that he could to help the team.</p>\n<p>Very special thanks to Susie Murphy for writing, working on the website, coordinating interviews, and everything else that she has done.</p>\n<p>And of course, thanks to <a href=\"http://www.netflix.com\" target=\"new\">Netflix</a> for running such a great contest!</p>\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '2:0b14ff0ac935c312d61c5bc1b7553e27' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '2:c71cd4bef5a25eb9ca90862749226f41' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • : Function split() is deprecated in /home/adifferentname/the-ensemble.com/modules/filter/filter.module on line 895.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<style type=\"text/css\">\n li { list-style-type: none; font-size: 8pt;}\n</style><ul>\n<li>\n<a href=\"http://www.nytimes.com/2009/07/28/technology/internet/28netflix.html?_r=1\" target=\"new\">The New York Times</a>\n</li>\n<li>\n<a href=\"http://www.wired.com/epicenter/2009/08/netflix-prize-continues/\" target=\"new\">Wired</a>\n</li>\n<li><a href=\"http://www.twit.tv/natn114\" target=\"new\">net@night</a></li>\n<li>Audio Interview: <a href=\"http://kempton.wordpress.com/2009/08/01/netflix-prize-the-ensemble-interview/\" target=\"new\">page</a>, <a href=\"http://www.archive.org/download/TheEnsembleNetflixPrizeChatOn20090729/TheEnsembleChatOn20090729.mp3\" target=\"new\">mp3</a></li>\n<li>\nTechCrunch: <a href=\"http://www.techcrunch.com/2009/07/25/netflix-prize-leaders-one-upped-with-one-day-remaining/\" target=\"new\">1st</a>,<a href=\"http://www.techcrunch.com/2009/07/26/the-netflix-prize-comes-to-a-buzzer-beater-nailbiting-finish/\" target=\"new\"> 2nd</a></li>\n<li><a href=\"http://www.pcworld.com/article/169098/netflix_service_may_get_smarter.html\">PC World</a></li>\n<li><a href=\"http://tech.yahoo.com/blogs/patterson/55016/1m-netflix-prize-draws-to-a-thrilling-close-winner-still-up-in-the-air/\" target=\"new\">Yahoo Tech</a></li>\n<li><a href=\"http://newteevee.com/2009/07/27/why-the-netflix-prize-is-a-kind-of-a-big-deal/\" target=\"new\">NewTeeVee</a></li>\n<li><a href=\"http://www.techdirt.com/articles/20090728/0309315680.shtml\" target=\"new\">Techdirt</a></li>\n<li><a href=\"http://developers.slashdot.org/story/09/07/26/1137223/New-Leader-In-Netflix-Prize-Race-With-One-Day-To-Go\">Slashdot</a></li>\n<li><a href=\"http://en.wikipedia.org/wiki/Netflix_Prize#July_25_2009\" target=\"new\">Wikipedia</a></li>\n<li><a href=\"http://gizmodo.com/5323261/netflix-prize-competition-comes-to-a-thrilling-confusion\">Gizmodo</a></li>\n<li><a href=\"http://www.bizjournals.com/sanjose/stories/2009/07/27/daily1.html?jst=b_ln_hl\">Business Journal</a></li>\n<li><a href=\"http://www.reddit.com/r/programming/comments/94mak/netflix_prize_has_a_new_leader/\" target=\"new\">Reddit</a></li>\n<li><a href=\"http://mashable.com/2009/07/26/netflix-prize-winner-is/\">Mashable</a></li>\n<li>\nHacking Netflix: <a href=\"http://www.hackingnetflix.com/2009/07/the-lastminute-fight-for-the-1-million-netflix-prize.html\">1st</a>,<a href=\"http://www.hackingnetflix.com/2009/08/netflix-prize-finalist-ensemble-team-on-twit-netnight.html\">2nd</a>\n</li>\n<li>Others:<br />\n<a href=\"http://opencoffee.gr/2009/07/26/breaking-netflix-prize/\">Open Coffee</a>, <a href=\"http://smart-machines.blogspot.com/2009/07/new-leader-for-netflix-prize.html\" target=\"new\">Artificial Intelligence and Robotics</a>, <a href=\"http://www.midasoracle.org/2009/07/26/netflix-prize-collective-intelligence/\" target=\"new\">Midas Oracle .ORG</a>, <a href=\"http://www.daniel-lemire.com/blog/\" target=\"new\">Daniel Lemire\'s Blog</a>, UMBC ebiquity (<a href=\"http://ebiquity.umbc.edu/blogger/2009/07/26/ensemble-leads-netflix-prize-contest-besting-bellkors-pragmatic-chaos/\" target=\"new\">1st</a>, <a href=\"http://ebiquity.umbc.edu/blogger/2009/07/26/netflix-prize-contest-closes-ensemble-wins/\" target=\"new\">2nd</a>),<a href=\"http://spokutta.wordpress.com/2009/07/26/the-netflix-prize/\">Sebastian Pokutta\'s Blog</a>, <a href=http://www.jasonball.com/techbytes/2009/08/feeds-20-and-the-netflix-prize.html>Jason Ball\'s TechBytes</a></li>\n</ul>\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '2:c71cd4bef5a25eb9ca90862749226f41' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '1:101c88eae8b613fba316b17d03f00c60' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • : preg_replace(): The /e modifier is deprecated, use preg_replace_callback instead in /home/adifferentname/the-ensemble.com/includes/unicode.inc on line 345.
  • : preg_replace(): The /e modifier is deprecated, use preg_replace_callback instead in /home/adifferentname/the-ensemble.com/includes/unicode.inc on line 345.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<p>For details on the Netflix Prize contest please visit Netflix\'s official <a href=\"http://www.netflixprize.com//index\">website</a>.<br />\nAlso visit the <a href=\"http://www.netflixprize.com//leaderboard?limit=10\">Netflix Prize Leaderboard</a> to see the final ranking of the top teams.</p>\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '1:101c88eae8b613fba316b17d03f00c60' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: SELECT data, created, headers, expire, serialized FROM cache_filter WHERE cid = '2:ea90e5109b1adf27d9987498593c82a9' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 26.
  • user warning: Table './vandelay_industries/cache_filter' is marked as crashed and last (automatic?) repair failed query: UPDATE cache_filter SET data = '<p>Site design by <a href=\"http://rileycordova.com\">Riley Cordova</a>. </p>\n', created = 1467112798, expire = 1467199198, headers = '', serialized = 0 WHERE cid = '2:ea90e5109b1adf27d9987498593c82a9' in /home/adifferentname/the-ensemble.com/includes/cache.inc on line 109.
  • : preg_replace(): The /e modifier is deprecated, use preg_replace_callback instead in /home/adifferentname/the-ensemble.com/includes/unicode.inc on line 345.
  • : preg_replace(): The /e modifier is deprecated, use preg_replace_callback instead in /home/adifferentname/the-ensemble.com/includes/unicode.inc on line 345.

Netflix Prize Conclusion

Yesterday, Sept 21st, Netflix announced that the winner of the $1 million Netflix Prize is "BellKor's Pragmatic Chaos(BPC)," and we congratulate them on their victory. The contest was remarkably close, and now we know precisely just how close it was.

In accordance with Netflix's rules, the RMSE score for the judged half of the submission (the test subset) is rounded to 4 decimal places. The two teams actually tied on this measurement. In this situation, the tie breaker becomes the order of the submissions. Bellkor's Pragmatic Chaos defeated us by submitting just 20 minutes earlier! Talk about close.

Netflix has graciously donated the entire data set for public consumption to: http://archive.ics.uci.edu/ml/datasets/Netflix+Prize. Included in this dataset is the quiz and test set answers, as well as the winning submission from BPC. This allowed us to determine both the precise test RMSE values and to get a little insight into the question: What would have been the result of The Ensemble and BPC working together?

Here are those values:

Test RMSE for The Ensemble: 0.856714 (10.06%)
Test RMSE for Bellkor's Pragmatic Chaos: 0.856704 (10.06%)
Test RMSE for a 50/50 blend: 0.855476 (10.19%)

The percentages are the improvement over the Test RMSE of Cinematch (.9525).

We would once again like to thank Netflix for it's pioneering contest and deft skill in managing it. It is easy to predict that Netflix Prize 2 will be just as well administered. We would also like to thank all of the numerous participants in the contest. The vast interest kept it healthy and marching forward. This little corner of science we all studied was lit up quite brightly for a while.

Final Submission Countdown

Contributed by Lester Mackey

Only sixteen minutes remained in the $1 million Netflix Prize competition when I handed over the final set of predictions to the Ensemble team captain. The members of our newly minted team had been working furiously through the night, hoping to improve upon our previous day’s score of .8554. It was hard to believe that just twenty-four hours ago we had passed the four-team coalition that had occupied the first place spot for the last 29 days. There was little time to celebrate; the previous leaders would not go down without a fight, so we had to be ready with something better. A call had been issued for any remaining valid predictors, anything that could tip the scale in this final day, and our members around the globe had answered the call: nearly 200 new predictor sets, some previously passed over for their poor performance and others newly conceived only moments prior, had flooded in from all corners of the team. It was now up to our blenders to work some last-minute magic.

11:26 AM 

me: gabor -- here's my new best
    i don't know how well it will do
    but it's possible it will give .8553

11:27 AM

Gabor: what does the blender say?

me: 0.855345926622
    so, cutting it close

Our submission window opened just 9 minutes before the contest closed.   Gabor, our captain, had asked me to give him a countdown to our submission time via Google Chat.

11:28 AM

me: 5 minutes

There was nothing left to do but wait.

11:29 AM

me: 4 minutes 
    bpc tied us
    booo

Indeed, the previous leaders had issued their final submission and risen to tie our score.  I decided to check the Ensemble mailing list to gauge our members’ reactions.  Some expressed delight, others, alarm.  David W. repeatedly expressed confusion about why we hadn’t submitted, as only less than 1 minute remained in the contest.  (His clock was 13 minutes fast.) 

11:30 AM

me: 3 minutes

11:31 AM 

me: 2 minutes

11:32 AM

me: wait
    peng says he has .8552
    !!

That’s right: one minute before our scheduled submission time, I spied a post by Peng revealing his latest blending effort.  With an estimated score of 0.85525, it soundly trumped our intended submission. I logged onto the Vandelay Industries server to retrieve the predictions file but didn’t know which of the several hundred files was the right one to download.

11:33 AM 

me: Peng -- what file is it quick!

No response.  Peng, you see, unbeknownst to me or anyone else had lost his internet connection and had texted the first post by Blackberry.

11:34 AM

me: WHAT FILE IS IT???

Jacob: This is the best RMSE we’ve seen so far, right? 
       I vote we swing for the fences and submit this   one!

Gabor: 1 minute and i have to submit!!!!!

11:35 AM

me: WE   DON'[T KNOW WHICH FILE--HURRRRRRRRY

Ces: SHouldn't we submit NOW?

Gabor: Lester!!!!!!!

You can imagine my frustration. 

It was now two minutes after our intended submit time and seven minutes until the contest closed.  I searched frantically through the folder for files with .85525 in the name but couldn’t seem to find any.

11:36 AM 

Gabor: !!!

me: i don;'t   know!!
    i can't find it!

Gabor: ok
       i submit yours

And then, I saw it.

11:37 AM 

me: wait
    i found it
    opera_est_0.855259.txt.gz

11:38 AM

Gabor: i'm uploading

me: ok, awesome

Gabor: i'm afraid it was late

me: uh oh
    it's not 11:42 yet

11:39 AM

Gabor: but uploading is slow

me: 4 minutes to spare
    it registered

Gabor: ok submission successful :)


Yes, submission successul.

me: That's what this team's all about -- living on the edge :)

Welcome to the website of The Ensemble

The contest is now officially over. Bellkor's Pragmatic Chaos and The Ensemble finished within .01% of each other. What great work on both sides! It was a very dramatic march for The Ensemble these last 30 days, and there was an even more nail-biting conclusion as we raced to get the best submission in place.We salute Netflix, BellKor's Pragmatic Chaos, and everyone who participated in the competition!

The Ensemble Surpasses 10%

We are happy today to have made a submission which surpasses Netflix's 10% Grand Prize target. The Ensemble is the second team to do this in less than a month. We are very proud of our achievements, and those of our top competitor, Bellkor's Pragmatic Chaos.

The Ensemble was created by a merger between the two teams that appear on the leaderboard as "Grand Prize Team" and "Opera Solutions and Vandelay United".

The Ensemble

The crowd is indeed wiser than the individual.

The 10% barrier once seemed distant and insurmountable. But when the contest's "last call" heralded the heroic achievements of Bellkor's Pragmatic Theory, the rest of the crowd pondered, and asked why the barrier couldn't be broken twice.

And lo, as if powered by gravity, Grand Prize Team and Vandelay Industries ! began to draw in more and more members. And Vandelay went on to join forces with Opera Solutions, and then Vandelay and Opera united with Grand Prize Team, and then ... and then ... well, things got so complex we decided just to call ourselves The Ensemble.


Member of The Ensemble in Communications of the ACM

Chris Hefele's dramatic visualizations of the relationships between movies in the Netflix database are featured in this article from the August issue of Communications of the ACM.

These images have also been displayed on visualcomplexity.com and on Flickr.

For much more, check out our visualization page, where there's a large "map" of movie similarities that you can explore interactively, as well as many newer, larger high-resolution images you can download.

For the most up-to-date images for publication, please contact us.

Special thanks

The members of The Ensemble want to thank Riley Cordova ( http://rileycordova.com ) for the great job that he did designing this website.

We also want to recognize the contributions of Clive Gifford ( http://clive-gifford.blogspot.com ). Clive did everything that he could to help the team.

Very special thanks to Susie Murphy for writing, working on the website, coordinating interviews, and everything else that she has done.

And of course, thanks to Netflix for running such a great contest!

The Netflix Prize

For details on the Netflix Prize contest please visit Netflix's official website.
Also visit the Netflix Prize Leaderboard to see the final ranking of the top teams.