Software Engineer, Infrastructure
Scaled Cognition
Software Engineer, Infrastructure
Scaled Cognition is the world's only model lab dedicated exclusively to customer experience and pioneering agentic models purpose-built for reliable action-taking enterprise applications. Backed by Khosla Ventures, the company's flagship Agentic Pretrained Transformer (APT) eliminates hallucinations, enforces enterprise policies and increases reliability in real-world CX workflows. Founded by serial AI entrepreneurs, former Microsoft Corporate Vice President of Conversational AI Dan Roth, and UC Berkeley AI Professor Dan Klein, and built by a team of world-class PhD researchers and engineers, Scaled Cognition advances the science of agentic AI to deliver safe, policy-aligned automation that enterprises can trust.
As a Software Engineer, Infrastructure at Scaled Cognition you will:
- Design and improve inference infrastructure that powers our AI models.
- Benchmark, profile, monitor and analyze latency and throughput and drive improvements throughout the stack.
- Collaborate with research scientists and product engineers to streamline the end-to-end process from model development to production deployment.
You might be the right person for the job if you:
- Are a continuous learner and are eager to explore new tools and technologies.
- Thrive in a dynamic environment and are comfortable adapting to changing priorities while maintaining a focus on delivering high-quality solutions.
- Have successfully navigated projects with significant product and technical ambiguity, and you excel at the intersection of complex technical challenges and user-focused solutions.
Key Qualifications:
- Experience deploying systems on major cloud platforms (AWS, GCP, Azure).
- Prior experience designing and implementing GPU infrastructure / tooling.
- A strong sense for scalability and developing secure, highly reliable environments.