Database ETL

Responsibilities:

• Developing scalable and reliable ETL pipelines and processess to ingest data from a large number and variety of data sources.

• Deep understanding of real-time data productions availability to inform on the real time metric definitions.

• Maintaining and optimizing the performance of our data analytics infrastructure to ensure accurate, re-liable and timely delivering of key insights for decision making.

• Design and deliver the next-gen data lifecycle management suite of tools/frameworks, including ingestion and consumption on the top of data lake to support real-time, API-based and serverless use-cases, along with batch as relevant.

Requirements:

• Bachelor degree in Computer Science, Software Engineering, Information Technology or related field

• At least 5+ years of relevant experience in developing scalable, secured, distributed, fault tolerant, resilient & mission-critical Big Data platforms.

• Proficiency in at least one of the programming languages Pyhton, Scala or Java.

• Strong understanding of big data and related technologies like Flink, Spark, Airflow, Kafka , etc

• Experience with different databases - NoSQL, Columnar, Relational

• You have a hunger for consuming data, new data technologies and discovering new and innovative solutions to the company’s data needs

• Organized, insightful and can communicate your observations well, both written and verbally to your stakeholders to share updates and coordinate the development of data pipelines.

• Have a good understanding of Data Structure or Algorithms or Machine Learning models

• Fluent in English