Position Overview
Responsibilities:
Selects the right tools and technologies for data ingestion, transformation, and storageImplements and maintains connectors for data ingestion from various sourcesEnsures the quality, integrity, and consistency of data through comprehensive transformation processesConfigures and manages databases (SQL, NoSQL, graph, etc.), ensuring they are suitable for large-scale analytics and machine learningCollaborates with Data Scientists to define the appropriate data pipeline strategy (ETL vs. ELT)Monitors data systems to ensure smooth operation, identifying issues and resolving them promptlyDocuments database schemas, models, and pipelines, ensuring transparency and scalabilityBuilds and maintains scalable search solutions to enable efficient data retrievalOptimizes data pipelines and storage solutions to balance performance and cost ...