In-depth understanding of big data concepts and distributed systems
Proficiency in Python and writing code in PySpark
Should possess good understanding of SQL concepts and must be proficient writing complex SQL queries
Thorough understanding of optimization and performance improvement for Spark based Workloads
Experience with working on at least one Cloud platform will be a good to have
Conceptual knowledge and fitment for Data Structures & Algorithms
Possessing in-depth knowledge of various Data Processing Patterns (Batch/NRT/RT processing) & capable of providing design & architecture of typical business problems
Knowledge and experience with NoSQL Database (Cassandra/HBase/MongoDB/CouchDB/Neo4j),SQL Database (MySQL/Oracle).
Kafka, Redis, Distributed Message Queues along with Distributed Caching