Apply modern data engineering best practices, including modular development, automated testing, orchestration, CI/CD pipelines, version control, and environment promotion.
Data Pipeline Development Design, build, and maintain scalable batch and real-time data pipelines using ETL/ELT patterns. Ingest and integrate structured, semi-structured, and unstructured data from diverse sources, including APIs, databases, files, and event streams.Implement incremental loading, change data capture (CDC), and idempotent pipeline design.
What You'll Do: Design, build, and maintain robust data pipelines️ Collaborate with cross-functional teams to integrate data sources Optimize database performance and ensure data integrity Implement ETL processes for efficient data flow Ensure security and compliance of all managed datasets Support analytics and BI teams with reliable data solutions
Data Quality Assurance: Collaborate with all the data owners to implement processes that ensure data reliability, efficiency, and quality, including data cleaning and validation. Implement and maintain a robust Row-Level Security.
Data Quality Assurance: Collaborate with all the data owners to implement processes that ensure data reliability, efficiency, and quality, including data cleaning and validation. Implement and maintain a robust Row-Level Security.
Data Quality Assurance: Collaborate with all the data owners to implement processes that ensure data reliability, efficiency, and quality, including data cleaning and validation. Implement and maintain a robust Row-Level Security.
Hands-On Engineering: Play an active role in day-to-day engineering tasks, coding, reviewing, and designing complex data solutions. Share knowledge and best practices with peers through code review and technical discussion, contributing to a culture of engineering excellence without a formal management remit.
What You'll Do: ️ Design, build, and maintain scalable data pipelines and ETL processes Optimize database performance and ensure data reliability Collaborate with analysts, scientists, and stakeholders to deliver actionable insights Implement best practices for data security and compliance standards ️ Integrate new technologies to enhance existing infrastructure Document architecture, processes, and workflows clearly