Relay-Version: version B 2.10 5/3/83; site utzoo.UUCP
Posting-Version: version B 2.10 5/3/83; site oliveb.UUCP
Path: utzoo!watmath!clyde!floyd!harpo!seismo!hao!hplabs!oliveb!jerry
From: jerry@oliveb.UUCP (Jerry Aguirre)
Newsgroups: net.news.b
Subject: Re: History rebuild for 2.10.1 expire?
Message-ID: <317@oliveb.UUCP>
Date: Wed, 4-Apr-84 20:52:11 EST
Article-I.D.: oliveb.317
Posted: Wed Apr  4 20:52:11 1984
Date-Received: Sat, 7-Apr-84 05:48:38 EST
References: <212@tymix.UUCP>
Organization: Olivetti ATC, Cupertino, Ca
Lines: 28

I have fixed it and I am currently testing it out.  I needed it to
build the dbm(3) database which we had not been using until then.  Also
some of our machines had their history damaged and need rebuilding.

Using the dbm seems to speed up rnews by a factor of 3 or more.  News
used to still be processing after 11am but is now finished by 8am.

The modifications to expire for rebuild/nohistory are not complex.  I
basically did a popen(3) of a find(1) to generate the names of all the
files (find SPOOLDIR -type f -name '[1-9]*').  It was actually simpler
than both the old code and the code for working with a history file.

I ran into mucho problems with the hread function doing mallocs
of unrecognized header lines which were never freed (a previously
published bug).  As I can find no other reference to the unrecognized
header lines I took the simple solution of commenting the malloc out.

I also added an option to keep expired IDs in the dbm database for 90
days.  This solves the problem of articles which time warp into your
system again after they have been expired.

If every thing works out I plan to install it on our other 4 sites and
after that post the changes to the net.  The code used popen already
so that should not be a portability problem.  Does everybody have
the find program?

					    Jerry Aguirre
    {hplabs|fortune|ios|tolerant|allegra|tymix}!oliveb!jerry