Newsgroups: comp.binaries.ibm.pc.d
Path: utzoo!utgpu!news-server.csri.toronto.edu!rpi!batcomputer!caen!sdd.hp.com!wuarchive!uunet!coplex!disk!tony
From: tony@disk.uucp (tony)
Subject: Need a program to delete duplicate lines of text
Message-ID: <1991Jun14.012035.6708@disk.uucp>
Summary: Need a program that deletes duplicate lines of text
Keywords: duplicate, text, deletes, lines, non-document, ascii file
Organization: Digital Information Systems of KY
Distribution: usa
Date: Fri, 14 Jun 1991 01:20:35 GMT
Lines: 14

For the past weeks I have been creating dictionary lists for a friend's word
game (on his BBS).   I've been taking data files for various programs and 
converting them to word lists.   Each word must be alone on its own line.  OftenI have many duplicate words in every file.  I would love to find a program that
will quickly delete all the duplicates.  Deleting them manually or in blocks 
takes forever.  I had thought about delimiting each word (") and importing
the text into a dbase file, but that would be pretty time consuming too.  Does
anyone know of a program that could do the job I need done?
Thanks!

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
tony@disk.uucp
or
uunet!ukma!corpane!disk!Tony.Safina