Role- Data Engineer

Location:-

US (Dallas preferred)

Job type- Fulltime

Perform for the end-to-end datastore migration from on-prem Data-Lake to AWS hosted Lake-House,Java or PYTHON, PYSPARK,HIVE,SNOWFLAKE,APACHE,BIG Data must have skills

Responsibilities:

Skill set one:-

Hands on programming Python, Pyspark.

Skills:- Apache Spark, Hadoop (HDFS/Hive), Sybase IQ, Shell scripting ,

Apache Iceberg ,

AWS Ecosystems for bigdata processing ( EMR, Redshift, Athena, Glue eic...), AWS Lamda expressions ,Step functions,

CI/CD

best practices

K8s deployment

experience

Skill set two:-

Hands on programming JAVA, Python

Skills:- Snowflake, Kafka,

SnowSQL, Apache Iceberg,

Shell scripting ,

Apache Iceberg ,

AWS Ecosystems for bigdata processing ( EMR, Redshift, Athena, Glue eic...), AWS Lamda expressions ,Step functions, Data moulding ex...