Your key responsibilities
As a Data Engineer; you will engage with our long-term clients to help them find new ways to unleash the value of their data. You will work on projects across a wide range of traditional BI and DW environments and gain the opportunity to work on a cutting-edge big data and advanced analytics projects.
You will work closely with clients to keep them focussed on their vision and strategy around data and reporting environments. You will be at the forefront of projects that are critical in removing bottlenecks.
Due to our continued demand we’re looking for an experienced data engineer to join our Malaysia Practice.
Your key responsibilities
- Develop and maintain scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity.
- Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
- Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Writes unit/integration tests, contributes to engineering wiki, and documents work.
- Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
- Works closely with a team of frontend and backend engineers, product managers, and analysts.
- Defines company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models.
Skills and attributes for success
- At least 2 years’ experience with skills ranging from data architecture, information management, software engineering, devops, to Agile delivery
- Hands on experience in the following:
- ETL Azure Data Factory, Datastage, Informatica, SAP DS
- Database – Azure SQL database, Teradata, DB2, SQL Server, Oracle
- Knowledge and experience with end-to-end project delivery, either traditional SDLC or agile delivery methodologies (or hybrid approaches)
- Exceptional communication, documentation and presentation skills
Ideally, you’ll also have
- Experience in engaging with both technical and non-technical stakeholders
- Strong consulting experience and background, including engaging directly with clients
- You will have demonstrative knowledge or hands-on experience with some of the following;
- Analytics – SAS, R, Hadoop, Hive
- BI / Data Visualisation – PowerBI, Tableau, Qlikview,