Position Overview
Responsibilities
End-to-End Data Architecture
- Collaborate with Databricks PS and customer
- on comprehensive end-to-end data architecture on Databricks platform
- Design and implement data ingestion strategies from various source systems
- Architect scalable storage solutions leveraging Delta Lake and lakehouse architecture
- Develop efficient data processing frameworks using Apache Spark and Databricks workflows
- Create data consumption layers for analytics, reporting, and machine learning use cases
- Ensure seamless data flow across the entire data lifecycle
Governance, Security & Compliance
- Collaborate with Databricks PS on implementing robust governance frameworks
- Design and enforce security policies and access controls within Databricks environments
- Ensure compliance with regulatory requirements and industry standards
- Implement data lineage...