JOB SUMMARY

The Data Engineer is responsible for designing, developing, and maintaining data processing systems that ensure efficient data collection, transformation, and integration. The role focuses on designing scalable architectures for batch and real-time processing, applying transformation and modeling techniques to ensure data quality, consistency, and availability for analytics and decision support.

PRINCIPAL DUTIES

1. Build and maintain pipelines to ingest high-volume, high-velocity data from shopfloor equipment, testers, PLCs, IoT gateways, and external systems using APIs, message queues, and industrial protocols.

2. Develop scalable ETL/ELT workflows and real-time streaming pipelines for sensor, production, and transactional data; ensure pipelines support both batch analytics and low-latency operational insights.

3. Design relational, dimensional, and time-series data m...