Job Summary
We are looking for 4-5 years of experience as a Data Engineer with strong expertise in Spark (Py Spark), SQL, and data pipeline architecture. The role involves designing, building, and optimizing scalable data workflows to support analytics and real-time insights. The ideal candidate is hands-on, detail-oriented, and enjoys building reliable data solutions while collaborating with cross-functional teams.
Job Requirements
- Strong expertise in Spark (Py Spark) and SQL
- Experience in designing and building data pipelines
- Understanding of AI concepts
- Good communication and collaboration skills
- Experience with streaming tools like Kafka/Kinesis
- Proficiency in Python, with exposure to Databricks or Azure
- Familiarity with Airflow/Ni Fi, Debezium, HTAP systems, or logistics domain is a plus
Job Responsibilities
- Design and architect scalable data pipelines for batch and real-time processing.
- Develop and optimize data solutions usin...