Path: utzoo!attcan!utgpu!jarvis.csri.toronto.edu!rutgers!cs.utexas.edu!uunet!mcvax!ukc!strath-cs!glasgow!gilbert
From: gilbert@cs.glasgow.ac.uk (Gilbert Cockton)
Newsgroups: comp.ai
Subject: Turing Test and Subject Bias
Message-ID: <3018@crete.cs.glasgow.ac.uk>
Date: 30 May 89 11:34:25 GMT
Reply-To: gilbert@cs.glasgow.ac.uk (Gilbert Cockton)
Organization: Comp Sci, Glasgow Univ, Scotland
Lines: 22
X-host: crete

If a system passes the Turing Test with one subject, but not with
another, should it be considered intelligent?

If 55% of a sample of hundreds say the system is intelligent, is it?

What if the subjects are:

	a) drunk or on drugs (or  a') the experimenters are :-))?
	b) mentally subnormal?
	c) polite and don't want to upset the experimenters
	   (especially if a' applies too :-])?

Then how valid is the Turing Test?

Just what sort of Science did young Mr. Turing have in mind when he
decided that subjective opinion could ever be a measure of system
performance?

How do AI types *REALLY* test their systems?
-- 
Gilbert Cockton, Department of Computing Science,  The University, Glasgow
	gilbert@uk.ac.glasgow.cs <europe>!ukc!glasgow!gilbert