I'm writing files daily using Spark to a HDFS location. The HDFS location contains multiple csv part files. I want to write a shell script which looks for a newly added part file with extension .csv and email the .csv file to distribution list.
↧
I'm writing files daily using Spark to a HDFS location. The HDFS location contains multiple csv part files. I want to write a shell script which looks for a newly added part file with extension .csv and email the .csv file to distribution list.