From “micro-world challenges” (e.g., blocks world) to “real-world challenge”s at scale – from AI to IA.
Hutter: http://en.wikipedia.org/wiki/Hutter_Prize
http://en.wikipedia.org/wiki/Loebner_Prize
RoboCup: http://en.wikipedia.org/wiki/RoboCup
TradingAgents: http://ai.eecs.umich.edu/people/wellman/?cat=6
I have lunch today with Fei-Fei Li at Stanford
http://www.image-net.org/challenges/LSVRC/2013/iccv2013
Dharmendra Moda and Team are working on these DARPA Challenges - including 10x less energy than best previous
http://www.eetimes.com/document.asp?doc_id=1319270
http://en.wikipedia.org/wiki/DARPA_Grand_Challenge
IBM has already succeeded at two big challenges:
http://en.wikipedia.org/wiki/Deep_Blue_%28chess_computer%29
http://en.wikipedia.org/wiki/Watson_Jeopardy!
My very, very limited thinking to date is summarized here: http://service-science.info/archives/3444
How can cognitive systems be used to improve the productivity and creativity of:
(1) Individual researchers and their teams?
(2) Research universities and their regions?
Productivity and creativity measures include generating top-cited papers, top-revenue-generating patents, top-fast-growth startups (business plans).
Cognitive systems can help improve access to collaborators, data sets, tools and services, challenges (cognitive sport events and prizes), etc.