13 July 2010

Limit of File Pattern

Symptom:
Usually job can run successfully, but sometimes job failed with this error message.
seq_Read_CCN: Unable to generate a node map from fileset /tmp/import_tmp_433284afb15c.fs.
Cause:
There are too many files to read in file pattern. It hit some OS limit proven by use ls in command line
$ ls -l /etl_uat/source/in/SCP/VOICE*100707*
-bash: /bin/ls: Argument list too long

Workaround:
Separate job to more than 1 job to read small set of files. For example, /etl_uat/source/in/SCP/VOICE*100707*[0-4]  and
/etl_uat/source/in/SCP/VOICE*100707*[5-9]

No comments: