We are looking for Senior Data Engineer to join our hedge fund and manage our data operations. You will be responsible for engaging with various data vendors, designing and implementing data pipelines, and ensuring data quality and security. You will also mentor other data engineers who support the data infrastructure and pipelines of the fund.
Responsibilities:
Engage with various data vendors to find the best data for the fund’s investment and trading activities
Evaluate data quality, delivery timing, frequency, method, and symbology of different data sources
Follow up contract and budget approval process with data vendors and internal stakeholders
Keep records of cost splits and propose ratio drafts for data vendor invoices
Design data pipelines to process various internal and external data according to the nature of the data and the need of internal users
Make sure the data pipeline and storage solutions are performant and scalable
Implement automated data quality checks and alert system to monitor and troubleshoot data issues
Provide adequate access control and usage audit solutions to ensure data security and compliance
Research and evaluate latest data related technologies and tools to keep our data platform updated and competitive
Lead and mentor a team of data engineers and ensure they have the necessary skills, tools, and resources to perform their tasks
Collaborate with the investment and trading teams to understand their data needs and provide them with relevant and timely data access and delivery
Requirements:
Bachelor’s degree in computer science, electronic engineering or similar engineering background
At least 5 years of experience in data engineering, preferably in the hedge fund industry or a related field
Curiosity about the finance industry and the ability to handle the data correctly based on the understanding of how users use it
Able to code in at least one static language, such as Java, C# etc.
Familiar with PostgreSQL and experienced with best practices and performance tuning
Familiar with Apache data tool stack, such as Airflow, Spark, Kafka, etc.
Experience with vendor management, price negotiation, and contract review is a plus
Familiar with KDB and other specialized database is a plus
Experience with storage cost optimization and data center hardware for high availability data storage is a plus
Excellent communication, presentation, and interpersonal skills
A keen interest and understanding of the financial markets and hedge fund strategies