全职 Data Engineer 工作, 薪水, CloudMile Federal Territory 公司招聘中 - Ricebowl

Position: Data Engineer

Location: Malaysia

Employment Type: Contract

About the Role

We are looking for a skilled and detail-oriented Data Engineer to join our team. The ideal candidate has strong experience in building scalable data pipelines, designing data models, and working with modern data platforms and orchestration tools. Prior exposure to Hadoop ecosystems or financial services data environments will be advantageous but not mandatory.

This role will support the design, development, and optimization of enterprise data workflows, enabling analytics, reporting, and downstream applications.

Key Responsibilities

• Design, build, and maintain robust and scalable ETL/ELT data pipelines.
• Develop and optimize data models, ensuring data consistency, quality, and performance.
• Work with data integration tools (e.g., Fivetran or similar) to ingest data from various systems.
• Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
• Manage and operate Data Warehouse solutions (e.g., BigQuery or other RDBMS).
• Develop and maintain workflow orchestration using tools such as Airflow or equivalent.
• Support data quality checks, schema validation, lineage tracking, and metadata management.
• Participate in version control and deployment workflows with Git and basic CI/CD practices.
• Troubleshoot data pipeline issues and ensure high system reliability.
• Work with Hadoop-based platforms such as HDFS, Hive, or MAPR for legacy data ingestion or migration work. (nice to have).
• Support data development using tools like WhereScape (nice to have).

Required Skills & Experience

• Hands-on experience with Data Warehouses such as BigQuery, Snowflake, Redshift, or traditional RDBMS.
• Strong proficiency in ETL/ELT development and understanding of data engineering best practices.
• Practical experience with orchestration tools such as Airflow, Cloud Composer, Dagster, or similar.
• Familiarity with Git workflow (branching, merge requests, conflict resolution, etc.).
• Basic knowledge of CI/CD pipelines and deployment processes.
• Experience with Fivetran or similar data integration/ingestion platforms.
• Experience in data model design (relational, dimensional, or vault).
• Experience in FSI / Banking domain is a strong plus.
• Good SQL skills and understanding of database performance tuning.

Good-to-Have Skills

• Experience with Hadoop ecosystem (HDFS, Hive, MapReduce, MAPR) — welcome but not mandatory.
• Experience with WhereScape or similar data automation tools.
• Experience with cloud platforms such as GCP, AWS, or Azure.
• Knowledge of data governance, security, and compliance standards.

Attributes We Value

• Strong problem-solving skills and attention to detail.
• Ability to work independently and collaboratively in a fast-paced environment.
• Good communication skills, both written and verbal.
• A proactive mindset with ownership of tasks and deliverables.