At various times, Alan Turing was hailed as a brilliant cryptologist, leading a team of code breakers at Bletchley Park which cracked the German Enigma machine cypher during World War II, and then later as a gay martyr. Now, due to popular media accounts of computers seeming 'human' over and over, he is known for The Turing Test and is getting a biopic, "The Imitation Game", starring Benedict Cumberbatch in the lead role.
In a 1950, Turing propose The Turing Test, where he outlined a standard for a computer being considered human and proposed that the solution to artificial intelligence would be a program with the mind of a child and teach it to think. So the goal of the test is not to determine if a machine is correct, but whether or not it is considered real.
In June of 2014 in a Turing test competition organized to mark the 60th anniversary of Turing's death, it was declared that the chatter bot Eugene Goostman has passed the test, convincing 33% of the contest's judges that it was human - but 30% to 'pass' was an arbitrary threshold and it didn't even get a mention on Science 2.0 because it didn't seem impressive. Mainstream media naturally repeated the claims that artificial intelligence was solved.
But the test itself may be just as meaningless. In 2012,
the Journal of Experimental&Theoretical Artificial Intelligence
published a series of ‘Turing tests’ which entailed a series of five minute conversations between human and machine or human and human. Judges were tasked with identifying whether who they were talking to was human or a computer. In 12 out of 13 tests the judge wrongly identified the interlocutor as machine when in fact they were human.
Turing tests were designed as an imitation game, to study machine ‘thinking’ through language and ultimately establish if a machine could foil an interrogator into believing it were genuinely human, so why in did so many believe the reverse?
The cursory conversations were quite one-dimensional, for example:
Judge: Do you like cooking?
Entity: no you?
Judge: Yes. Do you like eating?
Judge: What is you fav meal of all time?
Entity: i dont know there are so many?
Judge: Give me one then
Entity: pizza you?
Did such mundane talk give the impression of being machine generated? Other transcripts revealed humor, geographical and historical knowledge, a lack of general knowledge, evasion, misunderstanding, dominance and use of slang. All of these are traits associated with humanity, but in these instances seemed to offset the decision making process, leading the judge to the wrong choice.
If humans can't recognize what is very typically human intelligence, how will we recognize artificial intelligence?
In 1950 Turing asked “Can machines think?” In a new article on the Turing Test, Kevin Warwick and Huma Shah note that to ‘think’ commonly means means ‘to be of the opinion’ or to ‘judge’, "which indeed the judges were... As a result we can conclude that thinking does not require understanding or specific knowledge, although in the human case both facilities are likely to help.”
How to fool a Turing Test
Since humans are considered computers more often than computers are considered human, here are ideas for how to create an AI that will pass the Touring Test:
1) Come across as likely male
2) Don't know too many things
3) Answer questions directly
4) The first and last sentences need to be precise. First and last impressions count.
5) Don't be funny. Humor gets flagged as machines a lot, meaning no one is as funny as they think they are.
Citation: Kevin Warwick, Huma Shaha, Human misidentification in Turing tests, Journal of Experimental & Theoretical Artificial Intelligence June 2014 DOI:10.1080/0952813X.2014.921734
- PHYSICAL SCIENCES
- EARTH SCIENCES
- LIFE SCIENCES
- SOCIAL SCIENCES
Subscribe to the newsletter
Stay in touch with the scientific world!
Know Science And Want To Write?
- Greenpeace Says Its GMOs Are Better Than Science's GMOs, Still Hates Golden Rice
- Reduce Prostate Cancer Risk By Sleeping With Lots Of Women - But Not Men
- Homo Floresiensis: Hobbit Species Continues To Provoke Questions About Human Evolution
- Okay With Disgusting Images? You Vote This Way 95 Percent Of The Time
- Supersonic Laser-Propelled Aircraft Get A Step Closer
- Everyone Hates Daylight Savings Time - But It Might Improve Public Health
- This Mid-Term Election Can Have Evolutionary Consequences
- "You, and Greenpeace, are doing just that. GMO is a legal definition, not a science one, and that..."
- "We lack new medicines because the patents expire too quickly and the regulatory burden is too high..."
- "The problem is, American agricultural science cannot be adopted world-wide for the simple reason..."
- "You're quote mining. When it comes to environmental risk, energy emissions from CO2 are back at..."
- "Of course they aren't. These are scientific terms Hank Campbell and you can't just interpret them..."
- Battle of Britain: NGOs and scientists clash over proposal to loosen EU GMO restrictions
- Genetically modified clean energy from bacteria
- Designer babies: You can screen for cystic fibrosis but intelligence is a ways off
- Science as profane: What superstition of 1752 and 2014 share in common
- What’s so “natural” about “natural crop breeding”?
- Worried you have cancer? Take a Google pill!
- Young adults ages 18 to 26 should be viewed as separate subpopulation in policy and research
- University of Tennessee study finds saving lonely species is important for the environment
- Post-operative radiation therapy improves overall survival for patients with resected NSCLC
- Active, biodegradable packaging for oily products
- Medicare costs analysis indicates need to decrease use of biopsies as diagnosis tool for lung cancer