- Singapore
Working Location
Job Description
Responsibilities
Position: Data Engineer (ETL/ELT Development using Informatica)
Location: Singapore
Contract: 12+ Months and Extendable
KEY SKILL -
ETL/ELT Development using Informatica
Power Center and Teradata
Data Platform Expertise
Data Pipeline & Orchestration using enterprise scheduling tools
Performance Optimization
Data Integration & CDC
MDM - Reference data management
ETL Framework & Automation Development
KEY RESPONSIBILITES AND SKILL SET
• Create EDW ETL/ELT codes using Teradata SQL, Informatica, Apache Spark, QueryGrid, Trino to perform various transformations and load into Teradata based data warehouse or datamarts
- Performance tuning of highly complex applications to reduce resource
- Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with control
- Build in-house CDC framework using Java to process OR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable
•Install and build Master Data Management (MDM) application for various user uploads along with data validations and approval workflow
- Strong hands on experience with the ETL(Informatica Power Center) and Teradata based ETL development, similarly Hadoop ecosystem (Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, Nifi, Flink etc.,), and data pipeline orchestration.
- Create EDW ETL/ELT codes using Teradata SQL, Informatica, apache Spark, QueryGrid, Trino to perform various transformation and load into Teradata based data warehouse or datamarts
- Performance tuning of highly complex applications to reduce resource
- Create framework using GCFR, shell scripts, BTEQ and shell scripts to automate end to end. Also to integrate with control
- Build in-house CDC framework using Java to process OR logs from SAP(Oracle) and ingestion the data into Teradata. Create framework around this CDC ingestion to make it configurable
- Install and build Master Data Management(MDM) application for various user uploads along with data validations and approval workflow Usage
Important Information
Never provide your bank or credit card details when applying for jobs. Do not transfer any money or complete unrelated online surveys. If you see something suspicious, Report this Job ad.