Job Description
We are seeking a highly skilled Data Engineer to design, develop, and support enterprise-scale data integration and data warehousing solutions across Teradata and Hadoop ecosystems. The successful candidate will be responsible for building scalable ETL/ELT pipelines, data ingestion frameworks, automation capabilities, and performance-optimized data processing solutions to support enterprise reporting, analytics, Master Data Management (MDM), and Change Data Capture (CDC) initiatives.
The ideal candidate will possess strong hands-on experience in Informatica PowerCenter, Teradata, Hadoop technologies, and enterprise data engineering best practices, with the ability to work closely with business and technology stakeholders to deliver high-quality data solutions.
Key Responsibilities
- Design, develop, and maintain enterprise ETL/ELT solutions using Informatica PowerCenter, Teradata SQL, Apache Spark, QueryGrid, and Trino.
- Build and support scalable data pipelines for ingestion, transformation, and integration of large-scale enterprise data.
- Develop and optimize Teradata-based Enterprise Data Warehouse (EDW) and Data Mart solutions.
- Perform performance tuning and optimization of complex ETL jobs, SQL queries, and data processing applications to improve efficiency and reduce resource consumption.
- Design and implement reusable ETL frameworks, automation utilities, and orchestration capabilities using shell scripting, BTEQ, and enterprise scheduling tools.
- Develop and enhance Change Data Capture (CDC) solutions for near real-time data ingestion and synchronization.
- Build configurable data ingestion frameworks leveraging Java and enterprise integration technologies.
- Support implementation and enhancement of Master Data Management (MDM) platforms, including data validation, approval workflows, and reference data management.
- Integrate data across multiple enterprise systems while ensuring data quality, consistency, and governance standards.
- Collaborate with business users, solution architects, application teams, and infrastructure teams to gather requirements and deliver scalable solutions.
- Troubleshoot production issues, perform root cause analysis, and implement preventive measures.
- Ensure adherence to enterprise data governance, security, and compliance requirements.
- Prepare and maintain technical documentation, operational procedures, and deployment guides.
- Participate in project planning, estimation, design reviews, and code reviews.
Requirements
Education
- Bachelor's Degree in Computer Science, Information Technology, Engineering, Data Science, or a related discipline.
Experience
- Minimum 5 years of experience in Data Engineering, Data Warehousing, or ETL Development.
- Proven experience delivering enterprise-scale data integration and analytics solutions.
- Experience working in large-scale data warehouse and big data environments.