I found this at https://computing.help.inf.ed.ac.uk/afs-top-ten-tips
"You can have around 64,000 files (directory entries) in an AFS
directory /if/ the filenames are all less than 16 characters long. If
there are filenames with 16 characters or more, the maximum number of
files decreases."
and
"The AFS client has no way of knowing exactly how much can be written to
the /afs filesystem, since this depends on the permissions of the
individual user. It would also take a long time to search the whole of
the AFS file space on start up. To get around this, the AFS client
arbitrarily claims 8.6GB as the size of the /afs filesystem. This cannot
easily be changed."
On 6/16/22 10:54 AM, Eric Lease Morgan wrote:
> I need help uncompressing a tar file. 8-D
>
> I have a 67 GB tar file. I believe it contains about 700,000 files equally distributed between two subdirectories. When I try to uncompress the tar file, I eventually get a repeated "file too large" error looking like this:
>
> tar: document_parses/pdf_json/40afe13d64d6a5ef6640537e9f2334c0d86dfa88.json: Cannot open: File too large
>
> tar uncompresses many of the files, but not all of them. It seems to get stuck on the file names that are rather long. In the subdirectories, where the files are being stored, the number of files is above 28,000. The files are being saved on an AFS file system.
>
> I can't believe the file names are too long since all of the files have same length of file name. Nor, is my file system (quota) full.
>
> What is going on here? What file is too large?
>
> --
> Eric Morgan
> University of Notre Dame
--
*Tim McMahon*
West Liberty Public Library
|