- Singapore
工作地点
职位描述
岗位职责
We're Hiring: Data Engineer!
Location: Singapore, Singapore
Work Mode: Work from Office
Role: Data Engineer
We are seeking an experiencedData Engineerwith 6+ years ofexpertiseinenterprise data warehouse (EDW),ETL/ELT development, andbig data engineering. The ideal candidate willbe responsible fordesigning, developing, andoptimizingscalable data pipelines and frameworks across Teradata-based data warehouse environments and modern Hadoop ecosystem platforms.
This role requires strong hands-on experience in ETL development usingInformatica PowerCenter,Teradata SQL, andSpark, along with deep exposure to data pipeline automation, performance tuning, and CDC (Change Data Capture) frameworks. The candidate will also contribute to building enterprise-grade data ingestion, transformation, and governance solutions supporting both structured and semi-structured data across complex enterprise systems.
Key Responsibilities
Design, develop, and maintain ETL/ELT processes using Teradata SQL, Informatica PowerCenter, Apache Spark,QueryGrid, and Trino.
Build andoptimizedata pipelines to load and transform data into Teradata-based data warehouses and datamarts.
Develop and implement scalable data engineering frameworks to support end-to-end automation using GCFR, BTEQ, and shell scripting.
Perform performance tuning and optimization of complex ETL jobs and data processing workflows to reduce resource consumption and improve efficiency.
Build andmaintainin-house CDC (Change Data Capture) frameworks using Java to process OLR logs from SAP (Oracle) systems and ingest data into Teradata.
Design configurable and reusable CDC ingestion frameworks to support enterprise-wide data integration requirements.
Develop and support Master Data Management (MDM) solutions for user data uploads, including data validation, enrichment, andapprovalworkflows.
Work with Hadoop ecosystem technologies including Hive, Impala, Spark, Kafka, Iceberg,NiFi, Ranger, Atlas, and Flink for data ingestion, processing, and governance.
Implement data pipeline orchestration and scheduling mechanisms to ensure reliable andtimelydata delivery.
Collaborate with business, analytics, and application teams to translate requirements into scalable data engineering solutions.
Ensure data quality, consistency, and governance across enterprise data platforms.
Support troubleshooting, root cause analysis, and production issue resolution for data pipelines and ETL processes.
Continuously improve data engineering standards, frameworks, and automation capabilities.
Job Qualifications and Requirements
Bachelor’s degree in Computer Science, Information Technology, Engineering, ora relatedfield.
Minimum6+ years of experience in Data Engineering, ETL development, or Enterprise Data Warehouse environments.
Strong hands-on experience inTeradata SQLandEDW/ETL development.
Proven experience withInformatica PowerCenterfor enterprise ETL development.
Strong experience withHadoop ecosystem technologies(Apache Spark,Hive,Kafka,NiFi,Iceberg,Impala, etc.)
Strongexpertisein performance tuning and optimization of large-scale data pipelines.
Hands-on experience with shell scripting, BTEQ, and automation frameworks.
Strong understanding of data pipeline orchestration and workflow automation.
Experience withCDC (Change Data Capture)concepts, preferably withJava-based implementation.
Experience building frameworks for data ingestion, transformation, and automation in enterprise environments.
Strong understanding of data modeling, ETL design patterns, and data warehousing concepts.
Experience working with enterprise systems such as SAP (Oracle) for data integration.
Experience with Master Data Management (MDM) solutions including data validation andapprovalworkflows.
Strong analytical, problem-solving, and debugging skills.
Excellent communication and stakeholder management abilities.
Experience working in Agile or enterprise-scale delivery environments.
Ready to make an impact? Apply now and let's grow together!
重要安全守则
申请工作时,切勿提供您的银行或信用卡详细资料。不要转账或完成无关的在线调查问卷。如果您发现可疑内容,请举报此招聘广告。