Path: utzoo!utgpu!news-server.csri.toronto.edu!rpi!zaphod.mps.ohio-state.edu!cis.ohio-state.edu!sei.cmu.edu!fs7.ece.cmu.edu!o.gp.cs.cmu.edu!andrew.cmu.edu!dw3w+
From: dw3w+@andrew.cmu.edu (Database Work)
Newsgroups: comp.binaries.ibm.pc.d
Subject: Re: Need a program to delete duplicate lines of text
Message-ID: <8cKFwvK00VpOE2xa1h@andrew.cmu.edu>
Date: 14 Jun 91 19:55:39 GMT
References: <1991Jun14.012035.6708@disk.uucp>
Distribution: usa
Organization: Chemical Engineering, Carnegie Mellon, Pittsburgh, PA
Lines: 15
In-Reply-To: <1991Jun14.012035.6708@disk.uucp>

tony@disk.uucp was asking how to remove duplicate words from a word list.
In unix, this is trivial. Just do

sort < word.list | uniq > new.word.list

I know that the sort filter is included with MS-DOS, so all you really
need is the uniq program, for which I'm certain source must be
available somewhere, if someone hasn't ported it to DOS already.
Anyone know of a uniq for DOS?

Failing this, see if you can't get access to a unix system.  Good
luck.

Tod McQuillin
dw3w+devin@andrew.cmu.edu