InfoCepts Hiring! Full Time Senior Data Engineer in - Ricebowl

InfoCepts is a global leader of end-to-end data & analytics solutions with nearly 20 years of experience, also named as Gartner’s 2020, 2021 and 2022 customers’ choice for Data & Analytics providers. We continue to grow rapidly year over year, now employing more than 1,200 people in offices across the globe. As we have grown, we have stayed true to our mission—to always help our customers stay modern that help them make smart, data-driven decisions. Since 2004, we have deployed hundreds of high performance analytics applications over web and mobile platforms, built several advanced analytics models, processed petabytes of data using Big Data technologies and delivered several high impact business solutions. Driven by our vision of delivering great customer experiences, we are looking for professionals who are passionate about making the world a better place by leveraging the power of data.

We are hiring aspiring / proven Senior Data Engineer to join us in government project!

Location: Central

Roles and Responsibilities:

• Lead the development and optimisation of scalable, production-grade data pipelines on Databricks, ensuring data integrity, quality and availability.
• Define and own the data architecture, data modelling standards and engineering best practices across the project.
• Collaborate with stakeholders to understand business and data needs, translating them into technical solutions and delivery plans.
• Provide training, guidance and support to users to improve their data processing and analysis capabilities on Databricks/Snowflake.
• Monitor and tune data workflows, Spark jobs and queries for performance, reliability and cost efficiency.
• Implement data governance, security and compliance best practices (access control, data lineage, cataloguing) within the client’s environment.
• Document data architecture, pipelines and processes for knowledge sharing and future reference.
• Troubleshoot and resolve complex issues related to data processing and Databricks functionality, acting as the escalation point for the team.
• Conduct code reviews, mentor junior engineers and drive adoption of CI/CD and DevOps practices.

Skills Required:

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5+ years of proven experience as a Data Engineer, with a strong focus on Databricks.
• Strong proficiency in Python/PySpark, SQL and data modelling techniques.
• Experience designing and delivering data warehouse and Lakehouse projects end to end.
• Experience with ETL/ELT tools and data integration processes.
• Experience with cloud platforms (AWS or Azure), CI/CD and version control.
• Excellent communication skills, with the ability to explain complex concepts to non-technical users.
• Experience in mentoring team members, and in providing user support and training, is highly desirable.