WHO IS STEPHEN BAKER? This man spent a year with the IBM engineers who built Watson, the Jeopardy!-playing computer.
Image: Courtesy of Stephen Baker
-
The Wisdom of Psychopaths
In this engrossing journey into the lives of psychopaths and their infamously crafty behaviors, the renowned psychologist Kevin Dutton reveals that there is a...
Read More »
Earlier this month, the nation watched as Watson, a computer system designed by IBM, drubbed the two all time champions of Jeopardy. It was a much more difficult challenge than, say, beating a grandmaster at chess. To win, Watson had to navigate the vagaries of human speech, the idioms, the puns, the cultural references -- all the things, in short, that make language delightful and deeply machine unfriendly. Journalist Stephen Baker spent a year behind the scenes, as the team of IBM engineers struggled to design and build Watson in time for the show. He tells the story of project Watson, and what it means for the future, in his new book, "Final Jeopardy: Man vs. Machine and the Quest to Know Everything." He and Gareth Cook, the editor of Mind Matters, discussed Watson and artificial intelligence.
COOK: For a long time, artificial intelligence was considered a failure. Does Watson represent a new way of thinking about AI?
BAKER: It’s true, the early visions of AI never delivered. It turned out to be a lot harder than many imagined to build systems to handle the complexity and nuance of human communication and thought. You could argue that Watson does not come particularly close, even as it defeats humans in Jeopardy. As long as AI continues to fall short in that area--and it will be a long while--many will view AI as an unfulfilled promise.
However, in the last 15 years or so, there has been tremendous progress in functional aspects of AI. They use statistical approaches to simulate certain aspects of human analysis. This would include everything from Deep Blue, IBM’s chess computer, to the computers at Netflix, Amazon and Google, which study people’s behavioral patterns and automatically calibrate their offerings to them.
What’s new about Watson is the extreme pragmatism of the approach. It combines dozens of different approaches to question answering, from statistical to rules-based, and unleashes them on hunts to solve Jeopardy clues. There is no right or wrong approach. The machine grades them by their results, and in the process “learns” which algorithms to trust, and when. Amid the quasi-theological battles that rage in AI, Watson is a product of agnostics. That’s one new aspect. The other is its comprehension of tricky English. But that, I would say, is the result of steady progress that comes from training machines on massive data sets. The improvement, while impressive, is incremental, not a breakthrough.
Is any of what Watson does based on how the brain works, or is it really just computer scientists trying to solve a problem?
The IBM team paid little attention to the human brain while programming Watson. Any parallels to the brain are superficial, and only the result of chance. I would say that Watson is a true product of engineering: People using available technology to create a machine that meets defined specs by a hard deadline. If certain aspects of the brain had helped them design their circuitry or code their software, I’m sure they would have jumped at them. But the feeling was that decoding human thought was a challenge likely to last decades, and they were in a big hurry.
Does Watson reveal anything about our own thinking?
I find lots of parallels in Watson to our own thinking. Again, this is not because we share the same design, but instead because we’re tackling similar problems. Unlike many computers, for example, Watson is programmed for uncertainty. It’s never sure it understands the question, and never has 100 percent confidence in its response. It always doubts. As a machine operating in human language, that’s a smart approach.
What sort of tasks is Watson good at?
Watson is good at making sense of complex English questions and then digging through millions of electronic documents in search of answers. There's no doubt that we humans understand what we say and write far better than Watson. But it can "read" at great speed. Watson is also very good at a lot of Jeopardy-specific tasks, such as “Before and After” clues. If you ask it, for example, about a moonwalking singer who is also a southern city, it will come up in a second or two with: "What is Michael Jackson Mississippi." That skill is not likely to prove too useful outside of the Jeopardy studio.
What does IBM hope to use the technology for?
IBM has high hopes to sell Watson-based technology, or services built upon on it, in a wide range of industries. Any company that needs to draw evidence or conclusions from voluminous documents, they believe, could benefit from question-answering technology. An early deal has been signed with Nuance Technology and Columbia University Medical Center to adapt the system for question-answering in medicine. Doctors conceivably could ask the machine for diagnoses, or if certain medicines when combined have proven to cause dangerous side-effects. IBM also sees Watson as a paralegal, perhaps hunting down precedents in court cases. I think the most likely first job for Watson will be on technology help desks.
Are there other projects outside of IBM that are similar to Watson?
There is a lot of research into question-answering technology. Several years ago, Vulcan Technologies, the incubator run by Microsoft co-founder Paul Allen, launched an AI project, HALO, to teach a computer to pass high school advanced placement tests in chemistry. This project, unlike Watson, was based on knowledge taught to the computer. Since the computer "knew" the relationships between various chemicals, it could reason in a way that would be impossible for Watson. For example, it would assume that water would freeze at 0 degrees centigrade. Watson, by contrast, could easily find this fact, but could draw no conclusions from it. The downside of HALO, as I describe in the book, is that it cost lots of money to teach the machine, and it was anchored to that small base of knowledge and, consequently, inflexible.
Google is also introducing more question-answering into its technology. But the search giant is starting with simple questions calling for factoids, such as, "What is the capital of Mexico?" Google is also doing lots of work on machine language translation, where they use a statistical approach.
Rights & Permissions
See what we're tweeting about
12 Comments
Add CommentPerhaps IBM and other technological manufacturers should employ Watson within their own technical support network to play 20 questions with customers suffering problems with their equipment! At least that might be more entertaining than current voice response systems. I wonder how soon IBM can implement - cost won't be an issue, will it?
Reply | Report Abuse | Link to thisAll this stuff make me think the revelation Will Smith has in the movie "I, Robot", where he gets , after a robot rescued him instead of a child in a car accident, why statistically correct decision does not make sense in human terms.
Reply | Report Abuse | Link to thisI can see the headlines now: No Holmes Shall Be Without A Watson.....
Reply | Report Abuse | Link to thisLaurie Siegel
New York City
I think IBM Watson needs a permanent home in Congress, for them to use it of course. With speech recognition ever the worst case tech luddite can have success and this time connect to the internet if possible for some SQL queries needed for creating laws. If we don't do this and Wall Street buys the technology, we will never have a shot at any auditing and keeping pace. The SEC might as die and go away if Wall Street gets this first.
Reply | Report Abuse | Link to thisI actually blogged it a couple weeks ago before I read today about Watson's cameo at Congress:)
http://ducknetweb.blogspot.com/2011/03/ibm-watson-did-get-chance-to-go-to.html
I am not sure how I feel about this. Every advance in technology seems to lead to a dumber and dumber general population.
Reply | Report Abuse | Link to thisI am not sure how I feel about this. Every advance in technology seems to lead to a dumber and dumber general population.
Reply | Report Abuse | Link to thisAs Watson is version-ed ever upward, I sense profound changes in the way humans solve problems. Watson may quickly categorize the human questioner so as to statistically select the best presentation of the answer for that specific questioner. A different answer presentation for every questioner so to speak. So a kid could learn math from Watson while her chemist Dad could design a new fuel with ultra-efficiency because Watson would give them both the most statistically efficient answers they each need to pursue their goal. Hey, a guy can dream.
Reply | Report Abuse | Link to this"To win, Watson had to navigate [...] all the things, in short, that make language delightful and deeply machine unfriendly"
Reply | Report Abuse | Link to thisNope, "Watson" did not have to do that.
AI need be designed to emulate 'The chip in the brain' - go to that title in the FQXi essay contest for a full account.
Reply | Report Abuse | Link to thisSo far, Watson is nothing more than a "white elephant."At a price tag of 1.5 billion each (no added profits from IBM); it would take at least 10,000 Watson units to merely serve 10,000 user per minute. That means, some needs to invest 15 trillion dollars to make Watson a minimal Internet search engine. Then, there is the issue that Watson handles only English and can only handle questions that imply a minimum number of answers (one, maybe two?). Finally, not all shiny things are gold, therefore, algorithmic manipulation of data to resemble the output of an intelligent entity is not intelligence.
Reply | Report Abuse | Link to thisLaurie, nice pun!
Reply | Report Abuse | Link to thisAfter watching a rerun of the match I came up with questions and opinions that don't match the outcome I was supposed to believe. To wit:
Reply | Report Abuse | Link to thisWhat scientific method was used to declare "Watson" the winner?
Why was "Watson" able to buzz in when the human contestants tried but couldn't?
Where did the questions come from?
Was there an intentional slant as to what information the computer should contain?
Personally I see a "fix" like the $64,000 Question of yesteryear. IBM spent billions to try and portray a computer able to compete with a human. An attempt to make the public believe by fraud.
I tried to e-mail IBM to no avail.