Path: utzoo!attcan!uunet!cs.utexas.edu!usc!ucsd!rutgers!att!mcdchg!ddsw1!karl From: karl@ddsw1.MCS.COM (Karl Denninger) Newsgroups: news.software.b Subject: Re: How do articles get in the wrong order? Summary: The most common (perhaps) problem and two possible solutions Message-ID: <1989Sep11.033148.29604@ddsw1.MCS.COM> Date: 11 Sep 89 03:31:48 GMT References: <5200@looking.on.ca> <66812@uunet.UU.NET> <1989Sep7.151826.11816@i88.isc.com> <3919@hplabsz.HPL.HP.COM> <10478@looking.on.ca> Reply-To: karl@ddsw1.MCS.COM (Karl Denninger) Organization: Macro Computer Solutions, Inc., Mundelein, IL Lines: 75 In article <10478@looking.on.ca> brad@looking.on.ca (Brad Templeton) writes: >It might be useful to list the ways in which articles can get in the wrong >order. ..... >Here are some of my thoughts on different methods. If we can list these out, >maybe we can make some news software that eliminates some or all of these. >In particular, maybe we can make a batcher/unbatcher to do part of the work. > >A) > The original comes in while expire's running. The followup comes > in after expire runs, but before articles queued for later processing > get processed. (Also applies to other things that spool articles for > later processing) > > Solution: Empty the queue ASAP. If a new article comes in, > empty anything in the queue first. Better solution: Set "SPOOLNEWS" on your system. Then ALL articles coming in get spooled by definition. Local articles don't, but that isn't a problem since you can't follow up to something you haven't unpacked yet. This also doesn't require any modifications to the news 2.11b source or "C" News -- both can do this without trouble (it's how we've configured both here for ourselves and anyone I do news installations for). This also has the nice side effect that you never get into "uuxqt fights" which can happen with long-running uuxqt processes on some older uucp kits. >B) This one's hard to figure. Normally uucp and other transport mechs > send stuff in the order they got it, unless their sequence numbers > wrap around. There might be problems caused by interrupted > transmissions or people who move news at different priorities. > > Cross posting on a followup article that's not on the original can > allow the followup to take a higher priority path, but this is rare. This one is difficult. While uucp sends things in the order it gets the batches (most of the time), it doesn't always follow that uuxqt processes them in the same order. If I recall, uuxqt doesn't sort the list of work files before it starts -- which means you are at the mercy of the ordering that may 'fall out' in the directory scan. Usually this will be chronological -- but I wouldn't bet on it, especially if you often get files from more than one system at a time. This may be the major cause of mis-sorted articles at the present time. >C) Again, for this to happen, we need something to go wrong. The > faster of your feeds has to lose the original, so that the followup > gets there before the slow route sends the original. > > Because normally originals and followups have the same newsgroups > line, and they will both move on any channel that moves one. > >Problem C is the hardest to deal with. "C" is something I am not sure you can deal with. Sites do lose news occasionally; disks fail, power goes off, etc. When that happens you may very well get into this situation. If uuxqt is the source of the trouble, that may be the hardest to deal with, as most of us (myself included) don't have source access to our uucp packages! To deal with problem "B", one might try having the sending system order the files and pass on the ordering. This requires that the "rnews" command that is passed be changed to something like "rnews ddsw1xxxxxxx", where "xxxxxxx" is a hex-encoded time or a sequence number. Now the unbatcher can process in chronological order, and by site. This would require changes in the news software, although they should be relatively trivial. The site name has to be included, of course, else you risk two (or more) feeds scribbling on each other's batches. -- Karl Denninger (karl@ddsw1.MCS.COM, !ddsw1!karl) Public Access Data Line: [+1 312 566-8911], Voice: [+1 312 566-8910] Macro Computer Solutions, Inc. "Quality Solutions at a Fair Price"