Flat File Validation

UNIX for Beginners Q & A
1

Hi Team

there is a requirement to do validate on Flat files using Shell Scripting.

Suppose we have two flat files ( F1, F2).

Validation

  1. Row count between F1 and F2
    a) Write it in a file with results of count of each file and differences if any

  2. Apply checksum or any other efficient way of hashing each row in given data in both F1 and F2
    a) compare each rows in F1 and F2 using hashing technique, log the exact mismatched column value in a row or entire row based on mismatches found if any

  3. Have a provision to exclude columns in a file such that condition mentioned above 1 * 2 will be excluded during comparison check.

any help would be greatly appreciated.

thank you

2

Do not post classroom or homework problems in the main forums. Homework and coursework questions can only be posted in this forum under special homework rules.

Please review the rules, which you agreed to when you registered, if you have not already done so.

More-than-likely, posting homework in the main forums has resulting in a forum infraction. If you did not post homework, please explain the company you work for and the nature of the problem you are working on.

If you did post homework in the main forums, please review the guidelines for posting homework and repost.

Thank You.

The UNIX and Linux Forums.