I am trying to merge all csv files from source path into one single csv file in target. but getting error message:
hadoop fs -cat /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/TCH-charge_*.csv > /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/final/TCH_pb_charge.csv
getting error message:
-bash no such file exists at this path: /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/final/TCH_pb_charge.csv
I have 11 csv files in the first path, now thinking the above command will automatically merge all 11 csv files into 1 csv file.
I tried to use this command also is this a proper merge command line with csv files into 1 single csv file.
hadoop fs -text /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/TCH-charge_*.csv | hadoop fs -put - /user/hive/warehouse/stage.db/PK_CLOUD_CHARGE/final/TCH_pb_charge.csv
Thanks a lot for the helpful info.