Newsgroups: comp.archives Path: utzoo!utgpu!news-server.csri.toronto.edu!ox.com!msen.com!emv From: rossc@extro.ucc.su.oz.au (Ross Cartlidge) Subject: [aus.archives...] Re: finger access to ftp archives Message-ID: <1991Apr19.212009.781@ox.com> Followup-To: aus.archives,aus.general Sender: emv@msen.com (Edward Vielmetti, MSEN) Reply-To: rossc@extro.ucc.su.oz.au (Ross Cartlidge) Organization: Sydney University Computing Service, Sydney, NSW, Australia References: <1991Apr11.231700.13058@metro.ucc.su.OZ.AU> Date: Fri, 19 Apr 1991 21:20:09 GMT Approved: emv@msen.com (Edward Vielmetti, MSEN) X-Original-Newsgroups: aus.archives,aus.general Archive-name: ftp/admin/aus-archive-database/1991-04-16 Original-posting-by: rossc@extro.ucc.su.oz.au (Ross Cartlidge) Original-subject: Re: finger access to ftp archives Reposted-by: emv@msen.com (Edward Vielmetti, MSEN) rossc@extro.ucc.su.OZ.AU (Ross cartlidge) writes: >... >We could then regularly fetch this file and add merge it into our database. >Our ftp finger database is a "find -print" of our anon >ftp area. "ls -lr" is no good because it doesn't list full filenames. >what about each archive site installing a crontab entry like:- >0 5 * * 6 cd /pub; find -print | xargs ls -ld > pub.find >... To speed up the fetching of these files (and to save you disk space) I'd like to change the format to a compressed pub.find. A compressed pub.find is about the same size as a compressed "ls -lR". So the crontab entry should be something like:- 0 5 * * 6 cd ;find -exec ls -ld {} \; |compress -c >pub.find.Z Replace with ftp's home directory Replace with a list of all the directorys in whcih have fetchable files. NB: I have omitted the "xargs" of the previous example as some machines don't have the command - but if you can use xargs as it heaps quicker. Please mail me when you have done this - I currently have monu6.cc.monash sirius archive.su.oz.au ccadfa.adfa Thanks for your help. To use the database try "finger help@directory.su.oz.au" Its the "ftp" database. -- ________________________________________________________________________ Ross Rodney Cartlidge | rossc@extro.ucc.su.oz.au University Computing Service, H08 | Phone: +61 2 6923497 University of Sydney, NSW 2006, Australia | FAX: +61 2 6606557