Morning session (8:30 am to 12:30 pm) - Evelyne Viegas chair
8:30 - Welcome and introduction. Isabelle Guyon, ChaLearn, USA (30 min)
— Section 1: Challenges in bioinformatics —
9:00 - Keynote. DREAM challenges. Gustavo Stolovitzky, IBM, USA (40 min)
9:40 - Protein Structure Prediction as a source of challenges for Machine Learning, Jaume Bacardit, Newcastle University, UK (20 min)
10:00 - Break
— Section 2: Platforms and challenge programs —
10:20 - Keynote. Pascal challenges. Michele Sebag, CNRS and University Paris XI, Orsay, France (40 min)
11:00 - Bend or Feed Back. Bridging the Interests of Squirrels on Wheels. Gabor Melis, Consultant Franz Inc, Hungary. (20 min)
11:20 - Ten Lessons Learned From Ten Machine Learning Challenges. Tim Salimans. Algoritmica, The Nethelands. (20 min)
11:40 - Special guest: How to run challenges effectively on the Kaggle platform. Ben Hamner, Kaggle, USA (30 min)
12:10 - Discussion. Do's and don't in challenge design, sharing your experience. Isabelle Guyon, moderator.
Lunch break (12:30 pm to 3 pm)
Lunch served in the room, discussions in small groups.
Afternoon session (3 pm to 6:30 pm) - Isabelle Guyon chair
— Section 3: Computer vision and other applications —
3:00 - Keynote. Using Algorithmic Contests to crack Algorithmic Problems. Rinat Sergeev, Harvard NASA Tournament Lab (40 min)
3:40 - ImageNet Large Scale Visual Recognition Challenge. Olga Russakovsky, Stanford University, USA (30 min)
4:10 - Real Time Decision Making on the Kaggle Platform. Michael S. Kim Virginia Tech, USA (20 min)
4:30 - Break
— Section 4: New trends in collaborative challenge design —
4:50 - Special guest: CodaLab: A Platform for Efficient Collaborative Research. Percy Liang, Stanford, USA (30 min)
5:20 – From competitions to coopetitions with Codalab. Evelyne Viegas, Microsoft Research, USA (20 min)
5:40 - Discussion. New opportunities for challenges, looking to the future. Evelyne Viegas, moderator.
6:10 - Adjourn
20:00 -- Dinner invitation for invited speakers and organizers:
Restaurant ChinaTown Kim Fung, 1111 Rue Saint-Urbain, Montréal, QC H2Z 1Y6, Canada [MAP]