Path: utzoo!utgpu!jarvis.csri.toronto.edu!rutgers!rochester!pt.cs.cmu.edu!cadre!geb
From: geb@cadre.dsl.PITTSBURGH.EDU (Gordon E. Banks)
Newsgroups: comp.ai
Subject: Re: Turing Test and Subject Bias
Message-ID: <2911@cadre.dsl.PITTSBURGH.EDU>
Date: 9 Jun 89 23:46:44 GMT
References: <3018@crete.cs.glasgow.ac.uk> <1108@hydra.cs.Helsinki.FI> <3039@crete.cs.glasgow.ac.uk> <408@edai.ed.ac.uk> <3079@crete.cs.glasgow.ac.uk>
Reply-To: geb@cadre.dsl.pittsburgh.edu (Gordon E. Banks)
Organization: Decision Systems Lab., Univ. of Pittsburgh, PA.
Lines: 10

In article <3079@crete.cs.glasgow.ac.uk> gilbert@cs.glasgow.ac.uk (Gilbert Cockton) writes:
>Again, how *DO* AI types test their systems?

I suppose it depends on the system.  I never heard of anyone using the
Turing test, except perhaps with ELIZA in a modified way.

INTERNIST was tested by giving it published tough cases that were also
given to human experts.  The program's results were compared to the those
of the humans.  Also, it was tested one-on-one against chairmen of departments
of medicine when Dr. Myers was visiting their institutions for grand rounds.