- Kuala Lumpur Federal Territory Malaysia
Working Location
Job Description
Responsibilities
Duration: Approximately 6 - 12 months, subject to project requirements
Experience Required: Minimum 5 years of relevant working experience
Job Description
Esmera Global Solutions is seeking an experienced Data Engineer for a project-based assignment.
The Data Engineer will be responsible for designing, building and maintaining scalable data pipelines and data infrastructure supporting analytics, reporting and digital initiatives across enterprise environments.
Key Responsibilities
The successful candidate will be responsible for designing, developing and maintaining scalable ETL and ELT pipelines for structured and unstructured data sources. The role includes building and optimising data models, data warehouses and data lakes for analytics and reporting purposes.
The Data Engineer will implement data-quality checks, validation rules and monitoring controls to maintain data accuracy and integrity. The position also involves automating data workflows and supporting CI/CD practices for pipeline deployment and version control.
The candidate will monitor pipeline performance, troubleshoot data issues and support business continuity. The role requires close collaboration with technical and business stakeholders to translate requirements into practical data solutions.
The Data Engineer will also optimise database and pipeline performance, including query tuning and resource utilisation, while supporting data governance, security, documentation and technical standards.
Qualifications and Experience
Candidates should hold a Bachelor's degree in Computer Science, Information Technology, Engineering or a related discipline.
A minimum of 5 years of hands-on experience in Data Engineering, ETL development or a similar role is required.
Strong proficiency in SQL and at least one programming language such as Python or Scala is required. Candidates should have a solid understanding of data warehousing, dimensional modelling and data architecture principles, together with experience working with relational and NoSQL databases.
Exposure to cloud data platforms such as AWS, Azure or GCP is highly desirable.
Experience within energy, oil and gas or another large enterprise environment would be advantageous.
Strong analytical, problem-solving and communication skills are required.
Relevant Technologies and Tools
Relevant technologies may include Python, PySpark, SQL Server, Oracle, PostgreSQL, Talend, Informatica, AWS Glue, AWS S3, Athena, Azure Data Factory, Snowflake, BigQuery, dbt, Apache Airflow, Apache Spark, Hadoop, Git, GitLab, Power BI and Tableau.
Important Information
Never provide your bank or credit card details when applying for jobs. Do not transfer any money or complete unrelated online surveys. If you see something suspicious, Report this Job ad.