Candidate should have:
Background in processing and managing large data sets
Strong knowledge of Structured Query Language (SQL)
Experience building data pipelines using Azure Databricks and Azure Data Factory
Knowledge of analytics platform including Azure store, Azure Data Lake, Azure SQL DW/Synapse, Azure Stream Analytics
Experience with Databricks Delta tables and Databricks optimization (clusters, code, etc)
Strong coding skills in PySpark – working with data frames, reading from different sources, and writing to different resources
Bachelor’s degree in Computer Science or a related analytical field or equivalent experience is preferred.
5+ years of IT experience
2 years of experience in Azure Platform
Familiarity with Terraform and Azure DevOps
Strong coding skills in Python
A high degree of self-motivation, commitment, and integrity
Ability to deal with some levels of ambiguity
Excellent communicati...