The Data pipeline automation helps in the reduction of the dependency of individuals on manually collecting, cleaning, transforming and transferring the data from one place to another. Automated data pipelines can do routine jobs in a consistent manner, can schedule the processing of data, can validate the data that comes in, and can manage some failure and retries. Data automation can assist companies in the rapid processing of information while minimizing mistakes and time consumption. Data automation can be helpful for organizations dealing with big amounts of data or continuously changing data. An efficient automated data pipeline can be monitored on the basis of its performance, failures, latency and throughput.