Path: utzoo!utgpu!news-server.csri.toronto.edu!cs.utexas.edu!uunet!mcsun!ukc!strath-cs!cs.glasgow.ac.uk!kcl-cs!cf
From: cf@kcl-cs.UUCP (Andy Whitcroft)
Newsgroups: comp.sources.wanted
Subject: Re: removing duplicate lines from a text file???
Keywords: duplicate lines, sort(1)
Message-ID: <916@xenon.kcl-cs.UUCP>
Date: 28 Mar 90 18:06:14 GMT
References: <1990Mar25.182039.25565@jarvis.csri.toronto.edu> <2309@network.ucsd.edu> <3081@auspex.auspex.com> <90Mar26.232441est.2199@smoke.cs.toronto.edu>
Reply-To: cf@kcl-cs.UUCP (Andy Whitcroft)
Organization: Dept. of Computing, Kings College London
Lines: 11

Howa about 'uniq' as in ...

	uniq <ifile >ofile

... you may have some other constraint on the data to remove, but if I get it 
right this should work.

Andy.
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Andy Whitcroft |  UUCP: ...!kcl-cs!cf            | Dept. of Computing,
        (C.f.) | JANET: cf%kcl-cs.UUCP@uk.ac.ukc |      Kings College London.