Path: utzoo!utgpu!news-server.csri.toronto.edu!cs.utexas.edu!sun-barr!newstop!sun!amdahl!krs
From: krs@uts.amdahl.com (Kris Stephens [Hail Eris!])
Newsgroups: comp.unix.shell
Subject: Re: searching for data
Keywords: shell script
Message-ID: <18dQ01aK5bwe00@amdahl.uts.amdahl.com>
Date: 16 Apr 91 18:14:03 GMT
References: <cs342a37.671481248@zaphod>
Reply-To: krs@amdahl.uts.amdahl.com (Kris Stephens [Hail Eris!])
Organization: Amdahl Corporation, Sunnyvale CA
Lines: 63

In article <cs342a37.671481248@zaphod> cs342a37@cs.iastate.edu (Class login) writes:
>I am a new comer in writing shell scripts. I have the following problem:
>
>I have a data file that I use as a key for searching my Master file. Both files are text files. Each line in the Master file is a record. Both files are sorted by the key. I would like to readaa line in the data file for the key, and then read scan the Master file for the line that contains the key and append that to a file.
>
>I have the following script written:
>
>cat datafile : ( while read line; do fgrep "$line" masterfile >> outputfile ; done )
>
>This however, is very slow as I have about 2000 lines of key in my data file and about 10000 lines of records in my master file, and for each key I have to scan about 10000 lines.
>
>Can I write a shell script to do the following:
>read a line from masterfile
>while more  key to read do
>  read a line from data file
>  while (key from masterfile < line from data file)
>    read line from masterfile
>  (end while)
>  if line from masterfile contains key
>    append to output file
>  else
>    append empty line to output file
>  (endif)
>(end while)

Here's an awk script that handles it, assuming that your awk has enough
room to store all the keys (if not, send some mail to me including this
article and I'll offer an alternative).

### begin merger.awk ###
#
# call as     awk -f merger.awk key=datafile datafile masterfile
#

# Read in keys
FILENAME == key {
	keydata[$1] = $0
	next
}

# Print key info for each line from the masterfile
{
	print keydata[$1]	# Note: blank line if undefined
}
### end merger.awk ###

If the key data should be merged as lines following the possibly-keyed
data in the masterfile, add a

	print			# masterfile record

line right before the

	print keydata[$1]	# Note: blank line if undefined

line in the script.

...Kris
-- 
Kristopher Stephens, | (408-746-6047) | krs@uts.amdahl.com | KC6DFS
Amdahl Corporation   |                |                    |
     [The opinions expressed above are mine, solely, and do not    ]
     [necessarily reflect the opinions or policies of Amdahl Corp. ]