Position Overview
The Senior Data Engineer will design, build, and optimize scalable data pipelines and solutions leveraging
Databricks,
Python, ETL, DevOps. This role requires strong experience in cloud-based data platforms and advanced data engineering practices to support analytics and business intelligence initiatives.
Key Responsibilities
- Architect and implement data pipelines using Databricks and Delta Lake for batch and streaming data.
- Develop and maintain ETL/ELT workflows integrating diverse data sources into cloud data lakes and warehouses.
- Implement data governance, security, and compliance standards.
- Automate workflows using Python scripting and CI/CD pipelines.
- Troubleshoot and resolve issues in data ingestion, transformation, and storage.
Required Skills & Experience
- 8+ years in data engin...