Data Governance & Quality: Implement data quality monitoring frameworks, enforce privacy compliance (PDPA), and maintain data lifecycle policies including retention and archiving.
Cross-Functional Collaboration: Support Business Analytics and Data Science teams by disseminating clean, high-quality datasets and delivering automated downstream reporting extracts.
2 to 5 years of experience in data engineering, custom Python ETL scripting, scalable pipeline orchestration, and cloud infrastructure management.
...
Work with stakeholders including the Product, Business and Analytic teams to assist with data-related issues and support their data transformation requirements.
Conduct Data Discovery, Data Assessment and Data Workshops with customers to understand current architecture, data sources, data quality and business requirements.
Analyze customer data environments and recommend approaches for data consolidation, integration, migration, modernization and analytics.
Support presales activities, including discovery sessions, solution discussions, technical proposals, effort estimation, POCs and customer presentations.
...
Apply data governance, access control and data quality standards to keep enterprise data secure and trusted.
Partner with business and IT stakeholders to translate requirements into effective analytics solutions, improving data accessibility, self-service adoption, and overall user satisfaction.
Deliver high-quality technical work on assigned projects, share expertise, and mentor junior team members to help raise data literacy across teams.
...
Write, optimize and troubleshoot complex T-SQL queries, stored procedures, views, functions and triggers to support data transformation, loading, and validation logic within MS SQL Server, in line with established coding and naming standards.
Orchestrate and schedule complex data workflows, ensuring timely and reliable data delivery.
Implement and manage monitoring solutions to proactively address and prevent performance issues. Monitor daily job statuses and perform troubleshoot and recovery when necessary.
...
Develop and maintain data transformation pipelines using Talend / Talend Studio, Python and other related tools, integrated with Snowflake and other cloud platforms.
Provide support to project team members and external vendors by offering subject matter expertise in Snowflake-based data warehousing and Talend-driven data integration and transformation.
Maintain and support existing and future Data Warehouse solutions, including Snowflake environments (schemas, roles, virtual warehouses, and cost-efficient usage).
...
Maintain and manage the observability of infrastructure environment of Data Engineering, including monitoring, logging, alerting, notification and so on, focusing on the monitor system performance and proactively identify and resolve issues. Optimize system performance and resource utilization.
Work closely with cross-functional teams to understand business needs and deliver data-driven insights.
Provide technical support, data ops environment on-call and training to team members and stakeholders on data operation tools and best practices.
...
Build and optimize ETL/ELT frameworks supporting batch and near real-time processing.
Develop enterprise Data Warehouse and Lakehouse solutions for analytics, reporting, and AI/ML use cases.
Create and maintain dimensional data models including Fact and Dimension tables, Star Schema, Snowflake Schema, and Slowly Changing Dimensions (SCD).
...