And from here, it seems that if the AFS File Server does not support 64-bit
file sizes, then their maximum size is 2GB :(
http://docs.openafs.org/ReleaseNotesWindows/ch03s13.html
Filipe
_________________________________________________________________
Filipe Bento | BL Labs Technical Lead | The British Library | +44 (0)20 7412
7925
-----Original Message-----
From: Code for Libraries <[log in to unmask]> On Behalf Of Dominic
Boisvert
Sent: 16 June 2022 17:13
To: [log in to unmask]
Subject: Re: [CODE4LIB] file too large
Hi Eric,
With what OS ?
On Windows, there was (is) a file size limit (4GB on FAT32 and 16GB on
NTFS).
Dominic
Dominic Boisvert
Responsable de la gouvernance des données d'entreprise
Bureau du vice-recteur adjoint (CIO)
Technologies de l'information
T 514 343-6111 #33475<tel:+15143436111,33475>
Pavillon Roger-Gaudry
Bureau T-224, 2900, boul. Édouard-Montpetit
Montréal QC H3T 1J4
C.P. 6128, succursale Centre-ville, Montréal QC H3C 3J7
[log in to unmask]<mailto:[log in to unmask]>
________________________________
De : Code for Libraries <[log in to unmask]> de la part de Eric Lease
Morgan <[log in to unmask]> Envoyé : jeudi 16 juin 2022, 11 h 54 À :
[log in to unmask] <[log in to unmask]> Objet : [CODE4LIB] file
too large
AVIS: Ce courriel provient de l'extérieur de l'Université de Montréal.
Veuillez ne pas cliquer sur les liens ni ouvrir les fichiers joints si vous
n'êtes pas certain(e) de la légitimité du courriel.
I need help uncompressing a tar file. 8-D
I have a 67 GB tar file. I believe it contains about 700,000 files equally
distributed between two subdirectories. When I try to uncompress the tar
file, I eventually get a repeated "file too large" error looking like this:
tar:
document_parses/pdf_json/40afe13d64d6a5ef6640537e9f2334c0d86dfa88.json:
Cannot open: File too large
tar uncompresses many of the files, but not all of them. It seems to get
stuck on the file names that are rather long. In the subdirectories, where
the files are being stored, the number of files is above 28,000. The files
are being saved on an AFS file system.
I can't believe the file names are too long since all of the files have same
length of file name. Nor, is my file system (quota) full.
What is going on here? What file is too large?
--
Eric Morgan
University of Notre Dame
|