Position Overview
Responsibilities:
Design and develop robust, scalable, and high-performance data pipelines, ensuring data integrity, reliability, and efficiency. Collaborate with cross-functional teams including data scientists, analysts, and software engineers to understand data requirements and implement solutions accordingly. Optimize data infrastructure and architecture to improve the overall performance and reliability of our data systems. Implement and maintain ETL (Extract, Transform, Load) processes to efficiently process and transform large volumes of data from diverse sources. Develop and maintain data models, ensuring their accuracy, efficiency, and accessibility for analytics and reporting purposes. Perform data profiling, validation, and quality assurance to identify and rectify data anomalies or inconsistencies. Troubleshoot and resolve issues related to data pipeline failures, performance bottlenecks, and data quality problems...