Skip to main content

Machine Learning Data Engineer

L6

discover internationalWhite Plains, NYtoday

$220,000-$280,000

Machine Learning Data Engineer (LLM & Generative AI)
Location: New York, NY (hybrid, 2-3 days onsite)
Type: Full-time
Base salary: $220,000-$280,000, plus annual performance bonus and equity
About the Company: Our client is a fast-growing, well-funded fintech building AI-powered financial products. The team is mission-driven, moves with urgency, takes extreme ownership, and collaborates without ego.
The Role: You’ll build the foundational data infrastructure that powers the company’s Large Language Models and autonomous AI agents. You’ll own the end-to-end data lifecycle, from real-time production telemetry to the pipelines that train and refine the models, making sure they’re fed high-quality, diverse and well-structured data.
What You’ll Do:
  • Fine-tuning pipelines: Build and maintain scalable, automated pipelines that extract, clean and format massive datasets for LLM fine-tuning (SFT, RLHF and DPO)
  • Real-time evaluation: Develop telemetry and sampling systems that ingest production data and continuously measure the performance, latency and accuracy of live LLMs and AI agents
  • Synthetic data: Architect and scale synthetic data workflows that use foundation models to augment training data, cover edge cases, and reduce bias where real data is scarce or privacy-restricted
  • Data quality: Implement automated quality checks, deduplication and toxicity filtering to keep training data trustworthyMLOps and CI/CD: Partner with ML researchers and DevOps to connect data pipelines to training infrastructure and ship model updates smoothly
  • Vector databases: Manage and optimize data flows into vector databases that support RAG and agentic workflows
  • What You Bring
Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering or a related field 5+ years of professional experience in data engineering, machine learning engineering or MLOpsExpert-level Python and advanced SQLHands-on experience with LLM APIs (OpenAI, Anthropic), open-source models (Hugging Face, Llama) and orchestration frameworks (LangChain, LlamaIndex or AutoGen) Proven experience generating and validating synthetic data using prompt engineering and programmatic techniques Strong experience with workflow orchestration tools Experience with scalable cloud infrastructure (GCP preferred) and distributed data processing Experience with Docker, Kubernetes and CI/CDEquivalent competencies will be considered in place of any of the above.
Nice to Have:
  • Vector search and vector databases (Pinecone, Milvus, Weaviate, Qdrant)LLM evaluation frameworks (RAGAS, TruLens, DeepEval) and automated benchmarking suitesPII redaction and other privacy-preserving techniques for sensitive training data
  • Streaming pipelines (Kafka, Flink, Kinesis), especially feeding real-time context into agentic workflows and streaming RAG systems
  • Bilingual English/Spanish
  • What’s Offered
  • Base salary of $220-280KAnnual performance bonus and initial stock option grant
  • Unlimited PTO and paid parental leave
  • Health, dental and vision plans 401(k) with employer match
  • Continuous learning and strong growth opportunities in a dynamic, entrepreneurial environment
Equal Opportunity Employer.
Apply now (opens in a new tab)
Apply now (opens in a new tab)

Level

LeadL6

Salary

$220,000-$280,000

Location

White Plains, NY

Occupation

Data Scientists

Industry

Computer Systems Design Services

Posted

today

To get sharper similar jobs, create your profile using the link below.

Create profile