Re: [tlug] Limits on file numbers in sort -m

[Jim Breen <jimbreen@example.com>]

On 28 May 2014 11:27, 黒鉄章 <akira.kurogane@example.com> wrote:

>     A small precursor to consider is if the filename expansion (i.e. from
> *.interim to all the separate files) will exceed the size of ARG_MAX. On my
> system you'd be OK (it's ~2M, i.e. more than ~10k * 20 chars = ~200k)
>
> akira@akira-t3500-ub:~$ getconf ARG_MAX
> 2097152

Same here. So that shouldn't be a problem (file names are actually
20 chars, as it happens.)

>     I am not aware of any filehandle limit that would affect the sort
> program, other than the general limits for any process. In this case there
> would an issue on my system (4096 hard limit for open files < ~10k):
>
> akira@akira-t3500-ub:~$ cat /proc/self/limits | grep -P "^Limit|^Max open
> files"
> Limit                     Soft Limit           Hard Limit           Units
> Max open files            1024                 4096                 files

Same here. So I'll have to do it in batches. As it happens I have them
split over 4 directories, so that's not a problem.

Thanks

Jim

-- 
Jim Breen
Adjunct Snr Research Fellow, Japanese Studies Centre, Monash University