AI Data Platform Lead

Our client is a high-scale global consumer platform serving millions of users daily. They are rebuilding their data foundation as an AI-native platform to power the next generation of programmatic advertising, personalized discovery, and marketplace intelligence.

We are hiring a hands-on Staff / Lead Data Engineer (AI-Native) to architect petabyte-scale systems that feed real-time bidding, recommendation models, and LLM-powered analytics products.

Role Mandate: 80% Hands-on Engineering / 20% Technical Leadership

Key Responsibilities:

1. Data Platform Architecture (Core)

Design and build enterprise Lakehouse architecture (Batch + Real-time) using Spark, Flink, Kafka, Paimon / Hudi, BigQuery

Own end-to-end ETL / ELT frameworks, data modeling, metrics layer, and unified data services

Replace fragmented analytics (GA etc) with unified attribution, conversion tracking and marketing intelligence platform

Implement data governance, data quality, SLA frameworks (target 98%+), cost optimization

2. Marketing & Growth Engineering

Build large-scale marketing data platform serving Growth, Affiliate, User Acquisition, Marketing Automation

Design platform-level analytics abstraction for multi-region campaign management, attribution, user growth analytics

Integrate Marketing APIs (Google, Meta, TikTok) and build RTB / ad delivery data pipelines

3. AI & Agent Development

Build LLM-based Data Assistant / Marketing Performance Agent using RAG, Vector Search, Function Calling

Develop reusable Agent framework: orchestration, tool calling, MCP integration, prompt/context management, evaluation

Collaborate with ML team to optimize feature pipelines and LTV / ROI prediction models

Tech Stack We Expect You to Own:

Who You Are:

8+ years in Data Platform / Infra platform team

Proven track record building a company-level data platform from 0-1 (not just using it)

Strong in distributed systems, data warehouse modeling, and real-time pipelines

Experience in AdTech / Growth / Marketing Tech is a major plus – RTB, attribution, acquisition

Bonus: Hands-on with LLM Agents, RAG, Gemini / GPT, Agent Frameworks