You are hereHistory of Grand Prize Team and Vandelay Industries !

History of Grand Prize Team and Vandelay Industries !



Grand Prize Team

Grand Prize Team, captained by Gabor Takacs of Gravity R&D, has been one of the leading teams in the Netflix Prize competition throughout 2009. At one point this spring, the slimmest of possible margins (0.01%) separated Grand Prize Team in third place from the two teams tied for the lead. Leading shareholders in Grand Prize Team (a.k.a. GPT) include Joe Sill, Ces Bertino and the members of the two teams who founded GPT, Gravity and Dinosaur Planet.

GPT was founded on the notion that collaboration was the key to victory in the Netflix Prize competition. Gravity and Dinosaur Planet had already shown what collaboration could accomplish. They had previously joined forces to form the team When Gravity and Dinosaurs Unite, rising to first place on the leaderboard on the day before the deadline for submissions for the first Progress Prize of the competition in October 2007. They were edged out by the AT&T team KorBell in the final hours, but the power of partnerships had been demonstrated in dramatic fashion.

Gravity is a team of four researchers from Hungary: Gabor Takacs (Szechenyi Istvan University, Gyor) and Istvan Pilaszy, Bottyan Nemeth, and Domonkos Tikk (Budapest University of Technology and Economics). They form not only a Netflix Prize team but also the core of a company, Gravity R & D. Gravity held the top spot on the leaderboard for several months during the first year of the competition. Dinosaur Planet, another leading Netflix Prize team during the first year, was formed by three students from the Princeton class of 2007: Lester Mackey, David Weiss, and David Lin. Mackey and Weiss have since moved on to computer science PhD programs at UC Berkeley and University of Pennsylvania, respectively, while Lin works in finance in New York.

Gravity and Dinosaur Planet decided in January 2009 to take the concept of collaboration to a new level by creating a team which issued a standing invitation to any other Netflix Prize competitor to submit techniques and results to be assessed for the potential to boost the score of the combined team. The deal offered to the rest of the competitors seemed eminently fair. At the time of formation, the union of the two founding teams had already achieved 9% of the 10% improvement required to win the Netflix Prize, but that final 1% was such a daunting challenge that the founders were willing to offer a two-thirds share of the prize ($666,666 USD) to additional collaborators. Shares would be granted in proportion to the size of the contribution each collaborator made towards that elusive 1%. Thus, an improvement in the leaderboard score of 0.0001, or just one basis point (0.01%), was likely to be worth nearly seven thousand dollars. Gabor Takacs was chosen to captain the new team, which was named Grand Prize Team out of a spirit of optimism.

Bottyan Nemeth of Gravity designed a server which could quickly yet rigorously analyze files produced by models from GPT applicants, searching for indications that the applicant's submission could improve the team's score by providing something complementary to the models the team had already developed. Anyone could upload submissions at any time of day or night and get a quick response from the server indicating whether the submission was promising. Applicants were also invited to send modeling software to GPT for evaluation for possible synergies. Submitting a result which could help GPT was a difficult task, given the high position on the leaderboard which the team already held. Many applicants were unable to demonstrate any ability to improve upon the set of models GPT had already developed.

Nonetheless, the "open invitation" strategy quickly paid off when Ces Bertino, a software engineer working in San Diego, submitted results to GPT. Bertino already had one of the best single-person teams in the entire competition and had held a top 10 position on the leaderboard for many months. Bertino's submissions provided an improvement of 21 basis points (0.21%) - an enormous jump in a competition where leading teams would rejoice when making improvements of just a few basis points.

Grand Prize Team then collected additional important contributions from Netflix Prize competitors from around the world, such as Wojtek Kulik, Bill Roberts and Willem Mestrom. Kulik is a predictive modeling researcher and entrepreneur in Warsaw, Poland. Roberts is a researcher in statistical signal processing and a part-time faculty member at George Washington University in Washington DC. Mestrom is a computational scientist and software engineer in the Netherlands.

Joe Sill, a machine learning PhD from Caltech with dotcom and finance experience, submitted technology in February which proved highly promising when evaluated by Takacs. After refining the software Sill submitted, Takacs found that it could boost GPT's score by 14 basis points, another major jump. Then Dan Nabutovsky, an algorithm designer from Israel, contributed a substantial improvement of 6 basis points, and the possibility that GPT might challenge for the top spot on the leaderboard began to look more likely. Sill continued to submit enhancements and accrued 8 more basis points of improvement, eked out a few basis points at a time. As a result, GPT rose to within just one basis point of the top position on the leaderboard in May, achieving a score of 0.8597 while Pragmatic Theory and BellKor in Big Chaos (two teams who would later merge to form BellKor's Pragmatic Chaos) were tied in first, each with a score of 0.8596. When BellKor's Pragmatic Chaos broke the million dollar barrier in late June, Grand Prize Team had a score of 0.8594, the best score of any team not participating in the BellKor's Pragmatic Chaos coalition.

After the breaking of the million dollar barrier, only 30 days remained for other teams to attempt to catch BellKor's Pragmatic Chaos. For the final push, GPT brought on board David Purdy, who is finishing a statistics PhD at UC Berkeley. Purdy contributed a number of analyses which had not yet been pursued by other GPT members and a wide-ranging perspective on the statistics literature.

In the closing days of the competition, GPT decided that it wasn't finished pursuing a cooperative approach to the Netflix Prize. Talks with another leading team, Opera Solutions and Vandelay United, led to the formation of The Ensemble.

Writing credits:

Joe Sill


Vandelay Industries !

On January 1st, 2009, dreamhost.com had a 95% off sale. You could purchase a two year web hosting plan that included shell access to a Linux server, unlimited users, and unlimited storage space for $20.00. Greg McAlpin (OfADifferentKind), a software developer in Houston, TX area, bought a two-year subscription with vague notions of setting up a website some day.

On February 25, 2009, Greg's Probe File Exchange website went online. It was an invitation-only website where members could upload their probe prediction files and see how their score in the Netflix Prize contest might improve if they were to combine their results. Probe prediction files are files that competitors could use to measure the effectiveness of their algorithms. Netflix supplied a suggested set of probe data. Since we were all using the data Netflix suggested, it was easy to compare our results.

Greg invited six people to join the Probe File Exchange. They were not chosen because they had the lowest scores. They were chosen because they were all active on the Netflix forum and their posts were consistently helpful, friendly, and funny. They were chosen because they are the sort of people that you want to work with. The Netflix forum ( http://www.netflixprize.com//community/) is the place where competitors could ask questions and help each other. There has been amazing openness in the forum. People have shared everything from ideas to source code. Five of the six people who were invited on February 25th are now members of The Ensemble.

On the first day that the Probe File Exchange was online, Bo Yang (Newman !) proposed to Greg that they create a new joint team. Bo and Greg went on to form the team "Newman and George !". They hoped that a submission of their combined files would have an RMSE lower than 0.8712 (the 2007 progress prize RMSE). RMSE, or Root Mean Squared Error, is a way of measuring the average error for a set of predictions. On February 27th, Newman and George ! made their first submission with an RMSE of 0.8689.

In order to share files, members created directories on the same Linux server that was hosting the website (on dreamhost.com). That original setup grew into the infrastructure that allowed Vandelay Industries ! to easily support many members.

Bill Bame (clueless) began uploading files the first day that the Probe File Exchange was online. He has always had extremely creative ideas and unique approaches. The files that he uploaded to the Probe File Exchange combined extremely well with those of Newman and George !. On February 26th, Bill was invited to a new team named "Newman, George, and Peterman !".

The Probe File Exchange had its own private forum where members could share ideas. Chris Hefele (chef-ele) posted some information about the non-linear ways that he used to combine files. The most common way for competitiors to combine files is linear regression. That's a mathematical way of taking many points and finding the line that passes nearest to all of the points. Nonlinear regression is much more complex. It attempts to find a curve that passes closest to all of the points. The results that Chris achieved were extremely impressive. On March 12, 2009, Chris was invited to join the team. He was going to be "Bania", but the team name was growing too long and the "Newman and ... !" teams were all on the front page of the leaderboard.

So a new team "Vandelay Industries !" was formed. The name "Vandelay Industries !" is of course a whimsical reference to "Seinfeld", as is our goal to become a coalition "for the rest of us" who are not at the top of the leaderboard. Chris continued to develop his blending techniques and he continued to produce amazing results. He is one of the main blenders on The Ensemble.

In March, George Tsagas of Feeds2 was invited to join Vandelay Industries !. He answered "not yet". He was already part of one of the leading teams and he said that there would be time to make collaborations when the leaders' improvement neared the 10% mark. Feeds2 is now a member of The Ensemble.

During March and the beginning of April, Vandelay Industries ! continued to make almost daily progress. In May, Bo made huge improvements in his personal score. With his improvements Vandelay Industries !, made up of four people working in their spare time, reached 15th place on the leaderboard among 5000+ teams.

Vandelay Industries ! was started by sending out emails to strangers asking if they wanted to work together. The team made contacts with other top teams and started dialogs with them. The person who gave the most help and encouragement was Larry Ya Luo (Dace). Larry/Dace is also the highest ranked single-member team on the Netflix Prize leaderboard. There was some disagreement about how Vandelay Industries ! should recruit new members. Some thought that we should contact teams lower than us on the leaderboard. They would be more likely to work with us. And we had already seen that a few people with no previous experience could achieve quite a bit by working together. There was hesitation about contacting the top teams on the leaderboard because Vandelay Industries ! really had nothing to offer them.

But the possibility that someone might turn us away has never deterred the team. We asked Larry if he would mind downloading our probe files and seeing how they mixed with his. He accepted, downloaded our files, and did significant analysis of them. Even though our files could barely improve his own, he offered suggestions for how we could make improvements and what he thought we needed to do to reach the top 10 on the leaderboard. Each time that Vandelay Industries made a significant improvement, Larry would look at our files and try to help us.

In June, Jeff Howbert (team Howbert) contacted Bo about combining efforts, and Jeff joined Vandelay Industries !. The team was preparing a new submission and was quietly confident that Vandelay Industries ! would get into the top 10 on the leaderboard for the first time. Then BellKor's Pragmatic Chaos made their submission that made a 10.05% improvement.

Immediately Vandelay Industries ! began sending emails to all of the top teams, inviting them to join or cooperate with Vandelay Industries !. Larry was one of the first to agree to join our team. Others followed. The infrastructure that we had in place made it simple for us to add more teams. People were able to quickly integrate into the team and become productive.

As the final moments of the competition approached on July 24th 2009, Greg McAlpin (OfADifferentKind) and Christopher Hefele (chef-ele) reflected on what the contest meant to them, the unique qualities Vandelay Industries ! offered The Ensemble, and what's next for the group.

"Joining with Grand Prize Team to create The Ensemble put us in the incredible position of making a 10% improvement over the Cinematch program that Netflix uses" said Greg Mcalpin. Larry has said it well: our goal was to make a 10% improvement. When we do that, we'll have finished successfully with a job well done. "A million dollars isn't why we've worked so hard", Greg says, "at the beginning of the contest, a lot of people said that it would be impossible for anyone to reach the 10% improvement. From February until now, in six months, this group has done the impossible." Greg continued: "if we come in second place or last place, it has been fun and it's been an awesome experience working with the great and brilliant people on this team."

"The merged team's name 'The Ensemble' not only refers to the large group of team members that's been merged together, but it's also a reference to "ensemble methods,'" says Chris/chef-ele, "which is the term researchers use for the techniques we're using to combine our individual predictions into a group prediction that is better than any of the individuals. "

"Next, although some of our teammates have formal backgrounds in machine learning, they're working side-by-side with many others who were drawn to this problem as an interesting hobby or puzzle", Chris/chef-ele says "it's like a data-miner's Rubik's Cube...very addictive."

"It's my opinion that the successes of this team is not only being driven by the technologies we're using to combine or data, but also by our ability to combine many people together & create a cohesive, functioning team in less than 30 days", Chris continued, "So our successes will be not only technological, but also organizational. It will be interesting to see if a large group of underdogs can defeat a small group of the leaders."

Writing credits:

Chris Hefele
Greg McAlpin
Susie Murphy (susie@loganmurphy.com)
Joe Sill

I found your this post while searching for information about blog-related research ... It's a good post .. keep posting and updating information.
teds woodworking ted mcgrath program

Thanks very much for this great article;this is the stuff that keeps me going through out these day. corsi online viterbo

Interesting topic for a blog. I have been searching the Internet for fun and came upon your website. Fabulous post. Thanks a ton for sharing your knowledge! It is great to see that some people still put in an effort into managing their websites. I'll be sure to check back again real soon.
i want a girlfriend but im ugly

I just thought it may be an idea to post incase anyone else was having problems researching but I am a little unsure if I am allowed to put names and addresses on here.
hand embroidery

I really like the dear information you offer in your articles. I'm able to bookmark your site and show the kids check out up here generally. Im fairly positive theyre likely to be informed a great deal of new stuff here than anyone else!
asp.net tutorial

Once I thought about things like: why such information is for free here? Because when you write a book then at least on selling a book you get a percentage. Thank you and good luck on informing people more about it!
traffic school

I can’t imagine focusing long enough to research; much less write this kind of article. You’ve outdone yourself with this material. This is great content.
Settlement Loan

Really great post, Thank you for sharing This knowledge.Excellently written article, if only all bloggers offered the same level of content as you, the internet would be a much better place. Please keep it up!
hotel tunisia

Really great post, Thank you for sharing This knowledge.Excellently written article, if only all bloggers offered the same level of content as you, the internet would be a much better place. Please keep it up!
certificazioni Grosseto

I believe there will be more and more people are concerned about your article! الصحيفة

I have got inspired from your post.Thanks for post informatics blog.May i have more idea about “Van delay Industries”? Do you have any other post of this?KK Metals also post these type of information

I really like the information you provided and will back to you soon. Also i think i should work somewhat more for my website Kelvin Holidays

You’ve got some interesting points in this article. I would have never considered any of these if I didn’t come across this. Thanks!.
gold IRA investing

We have several varieties of tasty pizza, pasta wedges, salads, dressings, but the house specialties and delicious desserts. pizza craiova

I agree with your blog and i will be back to check it more in the future so please keep up your work.

I simply want to tell you that I am new to weblog and definitely liked this blog site. Very likely I’m going to bookmark your blog . You absolutely have wonderful stories. Cheers for sharing with us your blog.
hackforum

Our commitment is to provide our customers the best shopping experience possible with our personalized customer service at a safe and secure environment. We proudly stand behind the quality of products that we sell because we believe in providing our customers the best quality and affordable fine watches together with excellent customer service
http://7star.pk/
http://7star.pk/36_crysma-watches
http://7star.pk/69_seiko-watches

i am giving you roblox robux generator codes game and are you agree me? than go to the website roblox robux generator download

get it free roblox robux generator codes than go to the website roblox robux generator no download

Produk Mobil chevrolet yang beredar di Indonesia terdiri dari :Mobil Chevrolet Spin, Aveo, Captiva,

Orlando, Colorado, Trailblazer. chevrolet Bandung

memberi informasi lengkap tentang Harga, spesifikasi, dan fitur, semua kendaraan Honda. info

lengkap kunjungi kami di : Mobil Murah Chevrolet

Produk Mobil Honda yang beredar di Indonesia terdiri dari : Jazz, Civic, City, Accord, Mobilio,

Brio Satya, CR-V, CR-Z, dan Odyssey. Honda Bandung

memberi informasi lengkap tentang Harga, spesifikasi, dan fitur, semua kendaraan Honda. info

lengkap kunjungi kami di : Mobil baru Honda

Produk Mobil Suzuki yang beredar di Indonesia terdiri dari : Ertiga, Karimun Wagon R, Swift,

Splash, APV, SX4, Grand Vitara, dan Carry. suzuki

Bandung memberi informasi lengkap tentang Harga, spesifikasi, dan fitur, semua kendaraan Honda.

info lengkap kunjungi kami di : Harga Mobil

Suzuki

Produk Mobil Mitsubishi yang beredar di Indonesia terdiri dari : Pajero Sport, Delica, mirage,

Strada Triton, outlander, Colt L300, colt disel, colt T120ss, dan Fuso. Mitsubishi Bandung memberi informasi lengkap tentang

Harga, spesifikasi, dan fitur, semua kendaraan Mitsubishi. info lengkap kunjungi kami di : Mobil baru Mitsubishi

Produk Mobil Daihatsu yang beredar di Indonesia terdiri dari : Ayla, Xenia, Sirion, Terios, Luxio,

dan Gran Max. Daihatsu Bandung memberi informasi lengkap tentang Harga, spesifikasi, dan fitur,

semua kendaraan Daihatsu. info lengkap kunjungi kami di : Harga Mobil Daihatsu

Best XYZ These guys rule at XYZ Awesome XYZ Get XYZ here Good place to buy XYZ I really like the XYZ at ABC.

Penguin algorithm that got rolled out in April, 2012
almost shook SEO industry. The number of followers, delivery time and rates are three components which vary from
one plan to another.

This is just the information I am finding everywhere. Thanks for your blog, I just subscribe your blog. This is a nice blog..
how to fix nasal polyps

inilah salah satu yang dapat dijumpai, info detail resminya Selain bisa dinikmati secara langsung buah durian juga dapat diolah menjadi berbagai panganan lezat, Maidaniipancakedurian.com Distributor Resmi Pancake Durian, Oleh Oleh Khas Medan, seperti kuliner makanan medan lainnya yang tersedia di Distributor jajanan daerah, Oleh Oleh Khas Medan yang juga merupakan penyuplai daging durian yang berlokasi di kota medan, kota medan yang indah daging durian siap kirim ke berbagai kota-kota besar di Indonesia dari Maidaniipancakedurian.com dijamiin tanpa bahan pengawet dan bahan campuran, daging durian yang diproduksipun berasal dari buah durian yang fresh demi menjaga kemurnian rasanya, dikemas secara higienis,, cara jitu dan ampuh bersih serta rasa yang tak lagi diragukan dengan tekstur dagingnya yang lembut. video tutorialnya ini mungkin bisa jadi salah satu keinginan yang akan anda dapatkan.

Namun jika anda lebih suka browsing dan melihat berita secara online, dan ingin mendapatkan kesetabilan dalam menjelajah ], bisa juga mengunduh download Mozilla firefox disini, selain stabil juga cepat dalam memuat halaman. Lain lagi jika lebih suka mengunduh film-film yang besar, maka software download IDM full tanpa registrasi ini bisa jadi pilihan terbaik dan cepat.

You have done a great job. I will definitely dig it and personally recommend to my friends. I am confident they will be benefited from this site. Γυναικείες Γόβες

Planet Young is the site to visit for affordable school uniforms and trendy kids wear. Your child will always be in style with the lovely selection of items available on this site. It offers free shipping on all orders. kids clothes

I would love to stop by. But, I think it might have to wait until this summer. I did not know that Serlkay had ever expanded its size. I must say that a succesful family owned business in this day and age is a very refreshing sight! As well as this is a very refreshing site! nba 2k14 locker codes ps3

kartes melousI am always searching online for articles that can help me. There is obviously a lot to know about this. I think you made some good points in Features also. Keep working, great job!

Gabor Takacs was chosen to captain the new team, which was named Grand Prize Team out of a spirit of optimism.loft conversions herfordshire

You have done a great job. I will definitely dig it and personally recommend to my friends. I am confident they will be benefited from this site. clue

wow, great, I was wondering how to cure acne naturally. and found your site by google, learned a lot, now i’m a bit clear. I’ve bookmark your site and also add rss. keep us updated. LED road light

seorang istri terkadang ingin lebih merasakan saat berhubungan dengan pasangannya lebih memuaskan maka dari itu kami memperkenalkan produk obat kuat tahan lama yang khusus untuk pria yang tidak ada gangguan ereksi.

Lester Mackey, David Weiss, and David Lin. Mackey and Weiss have since moved on to computer science PhD programs at UC Berkeley and University of Pennsylvania, respectively, while Lin works in finance in New York. fridge repairs battersea

Hey, great blog, but I don’t understand how to add your site in my rss reader. Can you Help me please? Ayurvedic treatment for arthritis

Once I thought about things like: why such information is for free here? Because when you write a book then at least on selling a book you get a percentage. Thank you and good luck on informing people more about it!
free website valuation

Thanks for taking the time to discuss this, I feel strongly about it and love learning more on this topic.
http://updatekeren.com/

I feel strongly about it and love learning more on this topic.contact maurice connaughton

Nice information, valuable and excellent design, as share good stuff with good ideas and concepts, lots of great information and inspiration, both of which I need, thanks to offer such a helpful information here.מרחיק עטלפים

I just thought it may be an idea to post incase anyone else was having problems researching but I am a little unsure if I am allowed to put names and addresses on here. Samsun Firmaları

its super important that neither the patient nor the doctor sees the "Health Hacker" model as trumping the guidance of an educated health care provider. The right model is a partnership between data collection and data analysis. reconditioned gearboxes

Excellent post, went ahead and bookmarked your site. I can’t wait to read more from you. agenzia comunicazione roma

Mmm.. good to be here in your article or post, whatever, I think I should also work hard for my own website like I see some good and updated working in your site. seo institutes in delhi

Should there be another persuasive post you can share next time, I’ll be surely waiting for it. MBBS Entrance Exam

I definitely enjoying every little bit of it. It is a great website and nice share. I want to thank you. Good job! You guys do a great blog, and have some great contents. Keep up the good work. free website valuation

thanks you

I have read this post and if I could I wish to suggest you few interesting things or advice.
limoserviceneworleans

I simply want to tell you that I am new to weblog and definitely liked this blog site. Very likely I’m going to bookmark your blog . You absolutely have wonderful stories. Cheers for sharing with us your blog.
boulevard

Thanks you very much for sharing these links. Will definitely check this out..
get rowing machine reviews

Actually I read it yesterday but I had some thoughts about it and today I wanted to read it again because it is very well written.
www.thaikung.net

I simply want to tell you that I am new to weblog and definitely liked this blog site. Very likely I’m going to bookmark your blog . You absolutely have wonderful stories. Cheers for sharing with us your blog.
Search Jobs in UAE

I simply want to tell you that I am new to weblog and definitely liked this blog site. Very likely I’m going to bookmark your blog . You absolutely have wonderful stories. Cheers for sharing with us your blog.
russian girls