As an engineer working on Large Scale Inference you will build and scale software systems that accept, distribute, and purchase compute for inference work loads. We're working with a cutting edge technology company as our partner. You will play a key role in building out and defining the inference products at SFC. You will work closely with a small competent team driving high impact revenue generating changes. You will have the opportunity to deliver the highest quality, most affordable inference products at scale.
On a day-to-day basis, you might…
Quantify, optimize, and visualize the unit economics of inference
Design solutions to maximize compute utilization
Create automated compute purchasing software to optimally fulfill inference job demand
Scale inference software pipeline systems to hundred trillion token scale
This role may be a good fit for you if…
You enjoy the craftsmanship of software
You're a thoughtful high-agency engineer
Have a deep appreciation for reliable fault tolerant systems
Are a strong communicator and work well with others
Have SQL experience
Bonus points if you…
Have previously worked at a startup
Have interest in market dynamics
Have previously scaled distributed work scheduling systems
Are comfortable working in Rust
Have some Kubernetes or terraform experience
The San Francisco Compute Company is committed to maintaining a workplace free from discrimination and harassment.
We make employment decisions based on business needs, job requirements, and individual qualifications, without regard to race, color, religion, belief, national origin, social or ethical origin, age, physical, mental, or sensory disability, sexual orientation, gender identity or expression, marital status, civil union or domestic partnership status, past or present military service, HIV status, family medical history or genetic information, family or parental status including pregnancy, or any other status protected by law.
We welcome the opportunity to consider qualified applicants with prior arrest or conviction records. Our commitment to diversity includes hiring talented individuals regardless of their criminal history, in accordance with local, state, and federal laws, including San Francisco's Fair Chance Ordinance and California's ban-the-box laws.
If you require reasonable accommodation for any reason, please reach out to us at team@sfcompute.com.