Path: utzoo!attcan!utgpu!jarvis.csri.toronto.edu!rutgers!sun-barr!cs.utexas.edu!uunet!peregrine!ccicpg!zardoz!tgate!irsx01!ka3ovk!drilex!axiom!linus!mbunix!bwk
From: bwk@mbunix.mitre.org (Barry W. Kort)
Newsgroups: comp.ai
Subject: Re: Turing Test and Subject Bias
Summary: The Search for Excellence
Keywords: Examinations
Message-ID: <54823@linus.UUCP>
Date: 1 Jun 89 01:58:13 GMT
References: <3018@crete.cs.glasgow.ac.uk>
Sender: news@linus.UUCP
Reply-To: bwk@mbunix (Barry Kort)
Organization: IdeaSync, Inc., Chronos, VT
Lines: 20

In article <3018@crete.cs.glasgow.ac.uk> gilbert@cs.glasgow.ac.uk
(Gilbert Cockton) wonders:

 > How do AI types *REALLY* test their systems?

I suppose AI types test their systems much the same way teachers
test their students.  By giving them examinations consisting of
puzzles or problems appropriate to the class of intelligence which
the learning system has presumably acquired.

Neural network classifiers are given samples to classify.
Diagnostic expert systems are given the symptoms of ailments
or fault conditions.  Theorem provers are given candidate
theorems to decide.  The successful intelligent system (be
it made of silicon or made of meat) gets a passing grade and
goes ahead.  The unsuccessful ones go back for remedial
education or flunk out.  (Or maybe they just end up as USENET
junkies.)

--Barry Kort