Hi Eric,

With what OS ?

On Windows, there was (is) a file size limit (4GB on FAT32 and 16GB on NTFS).

Dominic

Dominic Boisvert

Responsable de la gouvernance des données d’entreprise

Bureau du vice-recteur adjoint (CIO)

Technologies de l’information



T  514 343-6111 #33475<tel:+15143436111,33475>



Pavillon Roger-Gaudry

Bureau T-224, 2900, boul. Édouard-Montpetit

Montréal QC  H3T 1J4

C.P. 6128, succursale Centre-ville, Montréal QC H3C 3J7



[log in to unmask]<mailto:[log in to unmask]>



________________________________
De : Code for Libraries <[log in to unmask]> de la part de Eric Lease Morgan <[log in to unmask]>
Envoyé : jeudi 16 juin 2022, 11 h 54
À : [log in to unmask] <[log in to unmask]>
Objet : [CODE4LIB] file too large

AVIS: Ce courriel provient de l'extérieur de l’Université de Montréal. Veuillez ne pas cliquer sur les liens ni ouvrir les fichiers joints si vous n’êtes pas certain(e) de la légitimité du courriel.


I need help uncompressing a tar file.  8-D

I have a 67 GB tar file. I believe it contains about 700,000 files equally distributed between two subdirectories. When I try to uncompress the tar file, I eventually get a repeated "file too large" error looking like this:

 tar: document_parses/pdf_json/40afe13d64d6a5ef6640537e9f2334c0d86dfa88.json: Cannot open: File too large

tar uncompresses many of the files, but not all of them. It seems to get stuck on the file names that are rather long. In the subdirectories, where the files are being stored, the number of files is above 28,000. The files are being saved on an AFS file system.

I can't believe the file names are too long since all of the files have same length of file name. Nor, is my file system (quota) full.

What is going on here? What file is too large?

--
Eric Morgan
University of Notre Dame