New to unix. Here is the problem. Running a script that extracts data from hyperion essbase and generates a file in unix. This script fails most of the times with a very low success rate. The data has increased a lot in the last few months resulting in the file being more than 2 gb.
Some of the findings,
the last three runs, script failed when file size reaches 2147483647. Now when i a did a getconf to see if its a 32 bit os since my friend suggested that 32 bit systems have trouble handling files greater than 2gb(did an isainfo mentioned below for this).
In the result of getconf, found that SEM_VALUE_MAX and SEM_NSEMS_MAX are set to 2147483647 (file size mentioned above...Not sure how this is related).
result of isainfo -v is the below,
64-bit sparcv9 applications
ima fmaf vis2 vis popc
32-bit sparc applications
ima fmaf vis2 vis popc v8plus div32 mul32
Any help regarding this is much appreciated, because i might get fired soon
SEM_VALUE_MAX probably has nothing to do with it since this constant relates to semaphores.
My gut feeling is that the programme that is creating the output file, being called by the script, wasn't compiled with the necessary large file support. If the programme writing the file is one you've created then rebuilding it with large file support enabled is all that should be necessary. For a programme written in C, you may need to add one or more of these options from the command line:
If the failing programme isn't yours, then you'll need to hunt for a version that is large file aware.
It's also possible that the filesystem being written to was mounted with a 'nolargefiles' option which limits a file to 2GiB. Can you create a 3GiB file manually on the filesystem? If so, then it's the programme and not the filesystem.