Build real-time intelligence for reliability and edge capacity while working on hyperscale data pipelines for TikTok USDS JV’s Edge and CDN platform. This onsite role in San Jose, CA supports SRE, capacity planning, and analytics by transforming edge and CDN operational telemetry into actionable insights.
As a Data Engineer, you will design, deliver, and maintain streaming and offline data systems that consolidate measurements from CDN operations, edge access logs, and infrastructure telemetry into reliable data products. The team also focuses on improving alerting, infrastructure cost visibility, and platform insights through robust monitoring, data quality, and lineage.
Compensation: USD 136,800 - 359,720 per year (base salary range for the selected city). Compensation may vary based on qualifications, skills, competencies, experience, and location. This base pay is one part of the Total Package, which may include discretionary bonuses/incentives and restricted stock units.
Responsibilities
- Design and implement high-concurrency, real-time streaming pipelines using Flink, Spark Streaming, or Kafka to ingest and process CDN measurement data, edge access logs, and infrastructure telemetry.
- Lead the design and maintenance of high-quality offline and real-time data warehouses with robust ETL/ELT processes that unify edge, network, and client-side data into a source of truth.
- Build data and analytics products that power intelligent SRE workflows, including statistical and ML-assisted anomaly detection, alerting, and root-cause analysis for the global edge fleet.
- Develop cost attribution and optimization datasets to quantify edge resource spend (bandwidth, compute, storage, peering) and identify optimization opportunities across PoPs, ISPs, and product lines.
- Create demand forecasting and capacity planning datasets combining historical traffic, seasonality, growth, and event signals to support procurement and deployment decisions.
- Design and deliver dashboards, compasses, and self-service analytics that surface health, performance, cost, and growth of the Edge and CDN platform for engineers, leaders, and cross-functional partners.
- Establish proactive monitoring, data quality, and lineage frameworks to maintain pipeline stability and ensure integrity of critical business and reliability metrics.
Requirements
- Bachelor’s degree (or higher) in Computer Science, Data Engineering, or a related quantitative field.
- 3+ years of data engineering experience building production-grade real-time and offline pipelines on Big Data platforms.
- Strong proficiency in SQL and at least one of Python, Java, Scala, or Go, with hands-on experience using distributed processing frameworks (Spark, Flink, or equivalent) and streaming systems (Kafka, Pulsar, or equivalent).
- Experience working at hyperscale with data lake/lakehouse architectures (Hudi, Iceberg, Delta) and OLAP engines (ClickHouse, Doris, Presto/Trino).
- Domain experience with CDN, edge, networking, or large-scale infrastructure telemetry (access logs, RUM, NetFlow, peering data) and SRE/observability use cases such as anomaly detection and SLO analytics.
- Demonstrated leadership and self-direction, with strong written and verbal communication skills, including the ability to teach others and learn new techniques.
Technology
Flink, Spark Streaming, Kafka, Spark, Python, Java, Scala, Go, Pulsar, Hudi, Iceberg, Delta, ClickHouse, Doris, Presto/Trino, ETL, ELT, OLTP/OLAP warehouses, data lakes, message queues, caches, streaming engines, OLAP engines.
Benefits
- Day one access to medical, dental, and vision insurance
- 401(k) savings plan with company match
- Paid parental leave
- Short-term and long-term disability coverage
- Life insurance
- Wellbeing benefits
- 10 paid holidays per year
- 10 paid sick days per year
- 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure)
- Eligible for additional discretionary bonuses/incentives and restricted stock units
About USDS: TikTok USDS Joint Venture LLC is dedicated to the safety and security of millions of Americans who create, discover, and connect with what they love on the apps we operate. The Joint Venture has been established in compliance with the Executive Order signed by President Trump on September 25, 2025. Teams are onsite to support speed, alignment, and agility, shifting from a hybrid model to a fully in-person schedule up to 5 days a week.
Reasonable accommodation: USDS is committed to providing reasonable accommodations in recruitment for candidates with disabilities, pregnancy, sincerely held religious beliefs, or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, reach out at https://tinyurl.com/USDS-RA.
