Position Overview
The ETL Developer is responsible for designing, developing, and maintaining scalable and efficient data pipelines that move and transform data from various sources into target data warehouses or data lakes, ensuring data quality and accessibility for analytics.
Key Responsibilities
- Pipeline Development: Design, build, and deploy robust ETL/ELT pipelines using tools like Informatica, Talend, Apache NiFi, or cloud-native services (e.g., AWS Glue, Azure Data Factory).
- Data Transformation: Write complex SQL queries, stored procedures, and scripts to clean, transform, and aggregate data according to business rules.
- Monitoring and Optimization: Monitor pipeline performance, troubleshoot data flow issues, and optimize ETL jobs for efficiency and latency.
- Documentation: Create and maintain technical documentation for data mappings, ETL processes, and database schemas.
- Data Quality: Implement data validation and error handlin...