AfterDawn: Tech news

Man versus machine 'Jeopardy' is highest-rated episode in years, Watson fumbles important question in day 2

Written by Andre Yoskowitz @ 15 Feb 2011 9:52 User comments (4)

Man versus machine 'Jeopardy' is highest-rated episode in years, Watson fumbles important question in day 2

Last night's showing of "Jeopardy!," which featured former champions Ken Jennings and Brad Rutter taking on IBM's supercomputer Watson, was the highest rated episode of the show since 2007, drawing an 8.7 household rating.
The taping's draw was 24 percent higher than the show's 2010 average, and a similar (or higher) rating is expected for tonight's continuation episode.

After the first day of the three-day event, Watson was tied with Rutter at $5000 each, with Jennings lagging behind at $2000. The winner will receive $1 million. Second place gets $300,000 and third gets $200,000. IBM will donate all their winnings to charity and Jennings and Rutter will donate half.

At the end of day 2 (which just aired) Watson had taken a commanding lead, with $35,734 to Rutter's $10,400 and Jennings' $4,800. However, the machine did make a huge blunder in the 'Final Jeopardy' question which was in the category "U.S. Cities."



The clue was: "Its largest airport was named for a World War II hero; its second for a World War II battle." Watson answered 'Toronto' while both human competitors answered correctly, with 'Chicago.'

IBM made sure to post an explanation for the Toronto answer:

David Ferrucci, the manager of the Watson project at IBM Research, explained during a viewing of the show on Monday morning that several of things probably confused Watson. First, the category names on Jeopardy! are tricky. The answers often do not exactly fit the category. Watson, in his training phase, learned that categories only weakly suggest the kind of answer that is expected, and, therefore, the machine downgrades their significance. The way the language was parsed provided an advantage for the humans and a disadvantage for Watson, as well. "What US city" wasn't in the question. If it had been, Watson would have given US cities much more weight as it searched for the answer. Adding to the confusion for Watson, there are cities named Toronto in the United States and the Toronto in Canada has an American League baseball team. It probably picked up those facts from the written material it has digested. Also, the machine didn't find much evidence to connect either city's airport to World War II. (Chicago was a very close second on Watson's list of possible answers.) So this is just one of those situations that's a snap for a reasonably knowledgeable human but a true brain teaser for the machine.

Previous Next  

4 user comments

118.2.2011 10:39

Sure, it starts with Watson...next thing you know it develops a sense of humor / sarcasm and it changes it's name to Skynet!! A.I. FTW!!!

218.2.2011 12:02

It makes me want to watch the Sarah O'connor Chronicle again...

318.2.2011 19:58

That's a lot of whining from David Ferrucci. After all, wasn't that the point of the exercise? A virtual "not-fair" argument is stupid.

424.2.2011 22:31

I'd love to hear what John Searle has to say about this.

Comments have been disabled for this article.

Latest news

VLC hits milestone: over 5 billion downloads VLC hits milestone: over 5 billion downloads (16 Mar 2024 4:31)
VLC Media Player, the versatile video-software powerhouse, has achieved a remarkable feat: it has been downloaded over 5 billion times.
1 user comment
Sideloading apps to Android gets easier, as Google settles its lawsuit Sideloading apps to Android gets easier, as Google settles its lawsuit (19 Dec 2023 11:09)
Google settled its lawsuit in September 2023, and one of the settlement terms was that the way applications are installed on Android from outside the Google Play Store must become simpler. In the future, installing APK files will be easier.
8 user comments
Roomba Combo j7+ review - Clever trick allows robot vacuum finally to tackle home with rugs and carpets Roomba Combo j7+ review - Clever trick allows robot vacuum finally to tackle home with rugs and carpets (06 Jun 2023 9:19)
Roomba Combo j7+ is the very first Roomba model to combine robot vacuum with mopping features. And Roomba Combo j7+ does all that with a very clever trick, which tackles the problem with mopping and carpets. But is it any good? We found out.
Neato, the robot vacuum company, ends its operations Neato, the robot vacuum company, ends its operations (02 May 2023 3:38)
Neato Robotics has ceased its operations. American robot vacuum pioneer founded in 2005 has finally called it quits and company will cease its operations and sales. Only a skeleton crew will remain who will keep the servers running until 2028.
5 user comments
How to Send Messages to Yourself on WhatsApp How to Send Messages to Yourself on WhatsApp (20 Mar 2023 1:25)
The world's most popular messaging platform, Meta-owned WhatsApp has enabled sending messages to yourself. While at first, this might seem like an odd feature, it can be very useful in a lot of situations. ....
18 user comments

News archive