Data Engineer

Pemrosesan Data

Key Responsibilities - Design, develop, and maintain scalable data pipelines for efficient data processing and transformation. - Build robust data storage and retrieval systems optimized for large-scale datasets. - Develop and deploy RESTful APis to enable seamless interaction with data systems. - Work closely with cross-functional data teams, ensuring seamless integration of data workflows and fostering a collaborative environment. Skills & Requirements - Proficient in tools and technologies like Apache Spark, Kafka, and Airflow. - Experience with cloud platforms, particularly Google Cloud Platform (GCP). - Python, SQL, Linux, and experience with RESTful APIs. - PostgreSQL, Big Query, HDFS, Starrock or other Data Storage. - Docker, Kubernetes, CI/CD tools like Jenkins. - Excellent communication skills, with the ability to explain complex concepts to non-technical stakeholders. - Strong problem solving skills and attention to detail