Xref: utzoo comp.protocols.iso:496 comp.protocols.tcp-ip:8097
Path: utzoo!attcan!utgpu!jarvis.csri.toronto.edu!mailrus!cwjcc!gatech!udel!burdvax!dvnspc1!gary
From: gary@dvnspc1.Dev.Unisys.COM (Gary Barrett)
Newsgroups: comp.protocols.iso,comp.protocols.tcp-ip
Subject: Comparing Performance of TCP/IP or OSI on Multivendor Equipment
Keywords: TCP/IP OSI Performance
Message-ID: <758@dvnspc1.Dev.Unisys.COM>
Date: 21 Aug 89 15:58:52 GMT
Followup-To: comp.protocols.iso
Organization: Unisys Corporation, Devon, PA
Lines: 31


I would be interested in hearing from anyone on the net who is
wrestling with the problem of benchmarking TCP/IP and OSI software
across equipment from various vendors.

I have posted a similar inquiry on this subject about a month ago,
questioning whether there are any standard benchmarking programs to do
such an evaluation.  I had very few responses.  The only benchmark
tool seemingly available (for TCP/IP) is ttcp.  

Certainly, others "out there" must be wrestling with the problem of
of "standard" networking software. How can it be analyzed across
systems such that users can fairly decide whether one product is clearly
superior to another?  Standard benchmarks are evolving for Transaction
Processing.  So why not for standard network services like FTAM or
TELNET sessions?  I know that vendor Marketeers often quote numbers,
but unless those numbers are backed by agreed-upon benchmarks, those
numbers amount to snake-oil (at worst) and apples-to-oranges analyses
(at best).

I welcome any comments anyone may have on this subject.  I would be
especially interested in hearing from "users",  how you expect to
evaluate Open-Network offerings as part of your formal purchasing process.

Thanks.


Gary L. Barrett
Unisys
Devon Engineering Facility
Wayne,  PA