全职 Data Engineer :USDS Data Platform Data BP:BPO 工作, 薪水 up to MYR 15,000, It Business Solutions Federal Territory 公司招聘中 - Ricebowl

JD-DataEngineer:USDSDataPlatform

Data BP:BPO

Responsibilities

TeamIntro:

TheDataEngineering teaminDataPlatformUSDSisfocusedonensuringthestability, reliability,

scalability and risk management of TikTok's US data processing ecosystem. We maintain and

operate both batch andstreamingpipelines for multiple vertical businesses such as TikTok,

Lemon8whilesimultaneously adhering to strict data compliance standards. We collaborate with

ahostofinternal teams to better enable user experience by delivering high quality at scale.

As adataengineerinthedataplatformteamarea,youwillhavetheopportunitytosupport,

optimize and growoneofthelargestdataplatforms in theworldthatdirectly supports the

TikTok app. You'll have the opportunity to gain hands-on experience on all kinds of systems in

the data platform ecosystem. Your work will have adirect and hugeimpactonthecompany's

core products as well as hundredsofmillions of users.

Responsibilities:

Maintaining uptime, monitoring system performance, and ensuring SLA data pipelines are

delivered on time

Troubleshooting, debugging, and managing incidents (on-call) to minimize downtime,

followed by post-mortems for root cause analysis.

Forecasting and managinginfrastructure needs to support scaling requirements.

Extract data from various sources such as APIs, HIVE tables and other structured and

unstructured data sources to process and store large volumes of data ensuring data

accuracy, consistency, and security.

Implementandmonitorqualitycontrol measures toensuredataaccuracy, completeness,

andconsistency.

Create and maintain technical documentation, such as data dictionaries, data flow diagrams,

andsystemdocumentation,toensureefficient and effective data management and analysis.

Optimize pipelines, dashboards, frameworks, and systems to facilitate easier development of

data artifacts.

Collaborate with engineers, product managers, and data scientists to understand data needs,

representing key data insights in a meaningful way.

Ability to analyze and visualize data to provide business stakeholders with impactful,

actionable insights.

Establish solid design and best engineering practice for engineers as well as non-technical

people.

Qualifications

MinimumQualifications

2+ years of experience working with data analytics and data engineering, including

experience with data cleaning and preprocessing, data ingestion and ETL(Extraction,

Transformation & Loading), data analysis and dashboard development.

2+ years experience building dashboards in Tableau, Power BI or any similar visualization

tool.

Preferred Qualifications

Proficiency in distributed data processing using Big Data technologies like Spark/Scala,

Python, Hadoop/HDFS/AWS/S3andKafka.

Proficiency in data modeling, data design, SQL and databases.

3+ years of experience with Big Data technologies (Hadoop, M/R, Hive, Spark, Metastore,

Presto, Flume, Kafka, ClickHouse, Flink etc).

Strong background in algorithms and datastructures.

Experience working with PII and GDPRdata.

Ability to communicate effectively, both written and verbal, with technical and non-technical

partners.

Ability to deliver consistent high quality results while working in a fast paced environment.

Passionate, curious, and seeking to tackle every day problems with innovation.

Pay: RM8,000.00 - RM15,000.00 per month

Benefits:

• Health insurance
• Opportunities for promotion
• Parental leave
• Professional development

Work Location: In person