AfterDawn: Tech news

Report: Apple's Siri works poorly

Written by Andre Yoskowitz (Google+) @ 30 Jun 2012 19:25 User comments (9)

Report: Apple's Siri works poorly According to a new report by analyst firm Piper Jaffray, Apple's Siri virtual assistant works poorly, if at all.
This has been the general consensus amongst iPhone 4S users for some time, but the report is the first to say so much in a note to potential investors.

After performing 1600 common searches, the virtual assistant only accurately resolved the request 62 percent of the time when in a noisy environment and 68 percent in a quieter setting, like being at home.

The report gave the tech a "D" (on an A-F scale) for accuracy.

Says analyst Gene Munster: "You're playing the lottery when you're using Siri. They have a plan to be more competitive, but it's going to take a couple of years."

In terms of "comprehension," Siri accurately deciphered what the user was saying 83 percent of the time in loud environments and then 89 percent of the time in quieter settings. Jaffray gave the comprehension a rating of 'B.'

Tags: Siri iPhone Apple
Previous Next  

9 user comments

130.6.2012 20:09

Voice recognition (such as Siri) has a loooooooooooooong way to go.
My brother couldn't get Siri to respond to a simple question like "Where is the nearest pizza place...".

230.6.2012 20:21

Originally posted by ivymike:
Voice recognition (such as Siri) has a loooooooooooooong way to go.
My brother couldn't get Siri to respond to a simple question like "Where is the nearest pizza place...".
Yes, it's true. Unfortunately, I had the same issues with Samsung's new S-Voice, as well.

330.6.2012 20:26

Also, Dragon Naturally Speaking has similar issues.

41.7.2012 11:54

AI simply doesn't 'get' slang, innuendo or gestures. Where picking your nose is today's taboo may be tomorrow's "I love you". Programming a machine to keep up with this intangible shit is a human impossibility, much less a mechanical one.

I suppose if we use ivymike's example of 'pizza place' & said 'pizza restaurant' instead, maybe both recognition softwares would have fared better.

But then people would have to fall back into speaking more formal versions of their given dialect in order to use their high tech 'speak & spells'. Upon observing that - with some of the gutter speak rolling out of some people's mouths it's amazing anyone can understand them at all. Which leads me to believe they're the ones bitching the hardest that the phone can't understand.

I'd say, "I weep for the future", but after a brief look at it... I realized, I'm not really going to be in much of it.


51.7.2012 12:59

I guess the Eschaton isn't so immanent, after all o.O' ...

62.7.2012 17:01

My Dragon Voice recog on my MyTouch 4G is 98% on point. Perhaps it doesn't understand ebonics, heavy accents or incomprehensible gibberish like so many utter all too often. Seeing the way most type on here.......if you all speak like that then it's no wonder.

HA HA HA

However, Siri is garbage. Always has been and always will be. Perhaps getting to your destination 62% of the time is ok.

73.7.2012 7:28

According to Woz himself, Siri has gotten worse since Apple bought it. It really should be able to figure out that if you said pizza you are looking for food...what else would you be asking?



88.7.2012 13:09

Really brilliant people work for years developing this technology so somebody's brother can order a pizza and soda.

Our priorities might be a bit off.

98.7.2012 14:35

Strange, Google's Voice Search (which can be used for all speech to text input in any Android app) comprehends slang just fine for the last +/- 2 years that I've been using it, mostly for "voice" texting, trip navigation, and internet searches. Slang is simply a matter of a properly populated dictionary file.

Pity that Apple is apparently more focused on hiring Hollywood actors for Siri commercials (which do nothing but make the actors look bored and lonely) instead of putting money into better development of this alpha (judging by the Grade of D) service.

Comments have been disabled for this article.

News archive