Path: utzoo!utgpu!news-server.csri.toronto.edu!rpi!usc!elroy.jpl.nasa.gov!aero-c!gumby.dsd.trw.com!deneva!news
From: thomsen@spf.trw.com (Mark R. Thomsen)
Newsgroups: comp.compression
Subject: Re: Report on Data Compression Conference 1991.
Message-ID: <28399BB3.2EA6@deneva.sdd.trw.com>
Date: 21 May 91 22:14:10 GMT
References: <782@spam.ua.oz>
Sender: news@deneva.sdd.trw.com
Organization: TRW Inc., Redondo Beach, CA
Lines: 82

Ross Williams writes
  Data Compression Conference 1991 (DCC'91): The Unauthorized Report

  ... skip a bunch of good stuff ...

  Space and Earth Science Data Compression Workshop
  -------------------------------------------------
  Snowbird Utah, April 11, 1991
  
  Held in conjunction with the Data Compression Conference (DCC'91)
  Snowbird Utah, April 8-10, 1991.
  
  This workshop seeks to explore  the opportunities for data compression
  to  enhance the  collection and  analysis of  space and  earth science
  data. In  seeking to  identify the  most appropriate  data compression
  approaches,  the   workshop  will   focus  on  the   scientists'  data
  requirements,  as well  as  on the  constraints  imposed  by the  data
  collection, transmission, distribution and archival systems.

  ... skip a bunch more good stuff ...

  There seemed  to be  a trend  towards image compression.  Many TEXTs 
  (including  myself) seemed  to  be a  little envious and curious about
  the  techniques so fluently bandied about by the SIGNALS and I think we
  will see some defections next year. This is a healthy trend, as images
  are likely  to end up taking far more space than text in the long run.

  ... skip a little more good stuff ...

  There were  several people  on
  satellite data projects.  One large software company  was there partly
  to  sniff  out ways  to  crunch  up programs  so  as  to save  on  the
  distribution media. Another was there  to find new algorithms for data
  compression  products. One  guy was  on a  project that  was going  to
  collect SIX PETAbytes of data -- I had to go and look it up. The scale
              ----
  goes like this:
  
      10^3  Kilo
      10^6  Mega
      10^9  Giga
      10^12 Tera
      10^15 Peta
      10^18 Exa
  
  You  would have  about six  petabytes of  data  if you  gave half  the
  population of Australia  a different compact disk  each. However, this
  would make  it very hard  for disk jockeys to  choose songs so  do not
  attempt this in your own country.

  ... skip a whole bunch more good stuff ...

  Enjoy,

  Ross Williams
  ross@spam.ua.oz.au


Three years ago I learned the term 'petabyte' in conjunction with EOS.
This NASA program will be collecting 1 terabyte per day, every day, for
over a decade. This massive collection is to support the actual measure-
ment and study of environmental phenomena, e.g., is it getting warmer
and what are all of the dynamics of clouds, mosture, wind, etc.? This
undertaking will stretch a number of technical fields including data
compression. Lossless compression for scientific data is extremely
important - those least significant bits might contain the key informa-
tion, which may not be known until years after collection when the
state-of-the-art and attention span catch up.  Lossy compression for
browsing (window shopping) the massive archives across these very same
networks will have a role too.

Image compression and n-dimensional data array compression will evolve
rapidly as earth science becomes more of a national priority. The amount
of data and the number of people needing/wanting access will drive this
technology. Researchers and the conversations I watch here will be quite
important, IMHO.

Thanks for the report. I think you are right - signals (images, data
arrays) will evolve into an important part of compression R&D.

Mark R. Thomsen
TRW