Data Engineer

Job Description

• Develop and maintain ETL/ELT processes and data integration workflows.

• Develop and optimize SQL queries for data processing.

• Build and maintain ETL processes using SSIS and Informatica.

• Work with IBM InfoSphere tools, including DataStage, IA, BPM, RAD/Workbench, PME, and DB2.

• Develop big data processing solutions using Apache Spark, including PySpark, Spark R, or Scala.

• Develop data processing scripts using Python and/or R.

• Support data modeling, data architecture, and data warehousing activities.

• Automate data flows and data integration across different platforms.

• Monitor, troubleshoot, and optimize data processing and integration processes.

• Ensure data quality, consistency, and integrity.

• Work closely with technical teams and business stakeholders to support data requirements.

Requirements

• Minimum 1 year of experience in Data Engineering, ETL, Data Integration, or a related field. Equivalent skills or experience may be considered.

• Good knowledge of SQL and data processing.

• Experience with SSIS.

• Experience with IBM InfoSphere Family (DataStage, IA, BPM, RAD/Workbench, PME, DB2).

• Experience with Informatica Data Engineering Integration.

• Experience with Apache Spark using PySpark, Spark R, or Scala.

• Experience with Python and/or R.

• Understanding of ETL, data modeling, data architecture, and data warehousing.

• Knowledge of data integration, data flow automation, and data processing.

• Knowledge of various database technologies.

• Good analytical and problem-solving skills.