Matching the header of a .CSV file with dynamic field names

Shell Programming and Scripting
1

I have a .CSV file (frequency - weekly) whose header contains the year-week value in two of the columns which keeps changing every week. For an instance please see below.

Column1,Column2,Column3,Column4,Column5,Column6,Column7,Column8,Column9,Column10,Column11,Column12,Column13,201420 Column14,201420 Column15

I have to check if the data is placed under the right column and then proceed loading that data into the datamart. I created a standard header to compare it with the header of this file, but due to the dynamic nature of the field 14 and 15, I am not able to match the header every week. There is no date in the field name and I cannot use sysdate. Could you please suggest me how can I achieve this either using cat / awk / sed or any wildcards? Also let me know if you need more information.

2

Try

awk 'NR==1 {getline X < "stdhead"; split (X, ST); for (i=1; i<=NF; i++) if (ST != $i) print i " - " ST " - " $i}' FS="," file.csv
14 - Column14 - 201420 Column14
15 - Column15 - 201420 Column15
3

Appreciate your response RudiC. Your code prints the columns with their columns numbers as shown below.

1 -  - Column1
2 -  - Column2
3 -  - Column3
4 -  - Column4
5 -  - Column5
6 -  - Column6
7 -  - Column7
8 -  - Column8
9 -  - Column9
10 -  - Column10
11 -  - Column11
12 -  - Column12
13 -  - Column13
14 -  - 201420 Column14
15 -  - 201420 Column15

For this, what should be the standard header and how do I compare the header of my file file with that of the standard header?

Thank you in advance...

4

Replace the "stdhead" after the getline with your actual standard header file name.

5

That was one of my concerns RudiC. I am unable to decide what the standard header should be as the header of the file keeps changing every week. This check should be part of my shell script.