Hi,
I am looking for an opensource alternate to replace syncsort. Can you please suggest ?
Believe it or not, we replaced syncsort with plain the UNIX sort command, and got comparable results. syncsort was still about 10% faster, which did not justify the cost differential, USD $60K vs zero.
Hi Jim,
Thanks for your response. Apart from sorting we require to perform operations like "merge - combining as many as sequencial sets into one data set under same sequence" and "copy - to reproduce a file, bypassing the sorting process entirely"
So can we achieve these also ?
Thanks,
Ambika
You can usually achieve the "copy" procedure with "cp". Or if you're sticking a bunch together, "cat".
UNIX sort also has a 'merge' option, check the manual page to see if it can be used exactly in the manner you require.
The cp and cat functions Corona mentions are more efficient than the syncsort version.
Merge is simple as well: merge filea and fileb giving filec with the merge key being two fields pos 8-30 and pos 43-49:
sort -k 8,40 -k 43,49 filea fileb > filec
Ok. Thank you. I will try out these.
hello AmbikaValagonda,
I'm from Syncsort, and saw your thread and the answer you got.
I'm not going to emphasize how good our product is bla bla bla.
Nevertheless, let me just add a few words.
Syncsort SORT is faster than the other sorts when volumes are BIG, i.e. when the source data don't fit into memory. Then, we fear no comparisons.
(and i don't speak about 10%, but 30% to 60%)
Be also aware that each version of Syncsort is faster than the previous ones. If you're using Syncsort 3.X, you may want to give a try to v7.1 before going further.
Syncsort has implemented new features like workspace compression which could accelerate your processes and save additional disk space.
And last, we now have a graphical interface which could reduce your dev and maintenance time, helping you to make more savings than by implementing and maintaining unix shell scripts.
Syncsort solves problems, especially performance problems when data volumes are BIG.
Of course, young geeks prefer scripting. Being able to handle pattern language makes them feel smart.
Best regards,
Steven
Please consider that you're saying this to a large population of young administrators and experienced administrators alike, where the most busy forum by a factor of five is shell scripting.
Also consider just how much more useful your product is as part of an automatic process, the kind of administration probably involved in creating that automatic process, and how some knowledge of programming is helpful in deciding whether your product is worth the purchase.
I've got a client flying to meet me so I can assist in processing large volumes of data in person... Again. In their words, I've accomplished in days things they've been picking away at with insufficient tools for years. I don't think I'm conceited, or a genius, but I sure appreciate finding useful applications for my "geek" skills.
Sure, I do consider this, and be sure that I have a great respect for people having the knowledge and expertise to write shell scripts.
I know how valuable such expertise is each time I need a system administrator to help me to integrate Syncsort Stuffs into an IS :).
Best regards,
Steven