Data Engineer

Washington DC (Day1 onsite)

Key Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark

Implement complex data transformations using Spark SQL and Python (mandatory)

Build and manage analytics models using DBT Core / DBT Cloud, following analytics engineering best practices

Develop and orchestrate data ingestion and transformation workflows using Azure Data Factory

Ensure data quality, reliability, and performance across batch and near real time pipelines

Integrate Databricks workloads with downstream reporting, analytics, and AI/ML use cases

Collaborate with cross functional teams to understand business requirements and translate them into technical solutions

Implement CI/CD pipelines and source control using Azure DevOps

Apply secure data engineering practices aligned with WBG data governance and compliance standards

Leve...