Position Overview
Responsibilities - Develop, deploy, and manage data pipelines following CI/CD practices
- Orchestrate data pipelines using tools such as Airflow, Oozie, or Azure Data Factory
- Develop Python scripts or Scala code for efficient data processing
- Collect and analyze pipeline requirements to ensure business alignment
- Consult on architectural and design principles for robust pipeline development
- Securely transfer data between different network domains and environments
- Improve the performance and enhance the structure of data models and pipelines
Requirements - Degree in Statistics, Computer Science, Telecommunication Engineering, Informatics, or a related field
- Proven experience working with Python or Scala
- Experience with orchestration tools like Airflow or Oozie
- Proficiency with CI/CD and DevOps tools such as Git, AWS CI/CD Pipelines, or Azure DevOps
- Strong knowledge ...