Position Overview
Hi,
Our client is looking for a Big Data Engineer with a Long-Term Contract project in Multi location - USA below is the detailed requirement.
Position: Big Data Engineer
Location: Multi location - USA
Duration: Contract/Fulltime
Job Description:
Responsibilities:
Using AWS cloud services. Develop and maintain automated data pipelines, ensuring data accuracy and efficient processing using Airflow DAG. Write high-quality, maintainable code in Python to support data operations. Integrate various internal and external data sources (including SharePoint, One Drive, One Note, to create a unified data platform. Build tools for document ingestion, dynamic file previewing, and tabular data extraction. Manage graph database systems and support large text corpus management. Implement security controls ...