View All Jobs 164824

Senior Software Engineer

Design and implement robust ML infrastructure pipelines for large language models deployment
New York
Senior
$175,000 – 225,000 USD / year
yesterday
Consumer Edge

Consumer Edge

A data analytics firm specializing in providing insights and solutions for the consumer goods and retail sectors.

5 Similar Jobs at Consumer Edge

Senior Software Engineer

Consumer Edge is a leading data and AI company specializing in transaction-based intelligence across the global consumer economy. Our technology transforms complex data into clear, actionable insights for enterprise clients. We believe technology is the foundation of innovation, and our engineering teams turn that belief into reality every day.

As a Senior Software Engineer (Infra) on the AI Products team, you'll design and scale the infrastructure that supports AI model training, deployment, and monitoring. You'll build pipelines, evaluation frameworks, and tooling that enable rapid iteration on AI features, ensuring reliability, cost efficiency, and security in production systems.

Your main responsibilities include:

  • Build and operate training and inference pipelines for LLMs and ML models.
  • Develop and maintain evaluation and monitoring frameworks for AI performance.
  • Implement metrics and alerts for data drift, model quality, and latency.
  • Optimize infrastructure for throughput, cost, and observability.
  • Work closely with Data Scientists to productionize models and APIs.
  • Contribute to MLOps best practices for versioning, testing, and CI/CD of models.
  • Document architectural decisions and mentor engineers on ML system design.

We're looking for someone with:

  • 7+ years of software engineering experience in ML infra or backend development.
  • Proficiency in Python and experience with ML/DS libraries (Pandas, TensorFlow, PyTorch).
  • Hands-on with Vertex AI, BigQuery, Dataflow, Dagster, and Terraform.
  • Familiarity with LLM tooling (Hugging Face, OpenAI SDKs).
  • Strong CI/CD and container skills (Docker, Kubernetes).
  • Effective collaboration skills and attention to system reliability.

You'll work within AI Products, collaborating with Data Scientists and Platform Engineers across EU and US time zones. Stack includes Python, Vertex AI, BigQuery, Dataflow, Dagster, and Terraform. Focus on building ML infrastructure with robust guardrails for quality and efficiency.

We are a remote-first company with a distributed environment and flexible working arrangements. We believe that distributed workers should be first-class citizens. We also have an office in New York if offices are your thing.

The annual base salary for this role is between $175,000 – $225,000 based on experience, with the opportunity for a performance-based bonus, company equity, 401(k) matching, paid parental leave, flexible and generous time off, work-from-home flexibility, and subsidized health benefits.

+ Show Original Job Post
























Senior Software Engineer
New York
$175,000 – 225,000 USD / year
Engineering
About Consumer Edge
A data analytics firm specializing in providing insights and solutions for the consumer goods and retail sectors.