l i n u x - u s e r s - g r o u p - o f - d a v i s
Next Meeting:
July 7: Social gathering
Next Installfest:
Latest News:
Jun. 14: June LUGOD meeting cancelled
Page last updated:
2002 Mar 07 19:39

The following is an archive of a post made to our 'vox-tech mailing list' by one of its subscribers.

Report this post as spam:

(Enter your email address)
Re: [vox-tech] reading a .gz .Z after offset
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [vox-tech] reading a .gz .Z after offset

On Wed, 6 Mar 2002, Eric Engelhard wrote:

> Does anyone on the list have experience using perl read
> (FILEHANDLE,SCALAR,LENGTH,OFFSET) to drop into compressed files (.Z and
> .gz) and extract readable results? I am ignorant of both compressed file
> anatomy and/or perl mods which can handle this issue. 
> I currently process large reference files (up to 1.8GB compressed)
> through a decompression/recompression pipe, but would like to divide and
> conquer on parallel cluster nodes without having to read through the
> entire file at each node.

I don't think you can do seeks in a compressed file... you have to read it

If you have a plan for dividing up the uncompressed data, perhaps you
should do that first and store the split data as separate files
(recompressed or not) for purposes of computation.

Jeff Newmiller                        The     .....       .....  Go Live...
DCN:<jdnewmil@dcn.davis.ca.us>        Basics: ##.#.       ##.#.  Live Go...
                                      Live:   OO#.. Dead: OO#..  Playing
Research Engineer (Solar/Batteries            O.O#.       #.O#.  with
/Software/Embedded Controllers)               .OO#.       .OO#.  rocks...2k

vox-tech mailing list

LUGOD Group on LinkedIn
Sign up for LUGOD event announcements
Your email address:
LUGOD Group on Facebook
'Like' LUGOD on Facebook:

Hosting provided by:
Sunset Systems
Sunset Systems offers preconfigured Linux systems, remote system administration and custom software development.

LUGOD: Linux Users' Group of Davis
PO Box 2082, Davis, CA 95617
Contact Us

LUGOD is a 501(c)7 non-profit organization
based in Davis, California
and serving the Sacramento area.
"Linux" is a trademark of Linus Torvalds.

Sponsored in part by:
Sunset Systems
Who graciously hosts our website & mailing lists!