View All Jobs 1580
Software Engineer, Data Acquisition
Architect and implement algorithms for data indexing and search capabilities.
San Francisco Bay Area
Senior
$310,000 - 385,000 USD / year
4 months ago
✨ About The Role
- Responsible for leading engineering projects in data acquisition, including web crawling, data ingestion, and search capabilities
- Collaborate with various sub-teams to ensure smooth data flow and system operability
- Develop and deploy highly scalable distributed systems capable of handling petabytes of data
- Architect and implement algorithms for data indexing and search capabilities
- Deploy solutions in a Kubernetes Infrastructure-as-Code environment and conduct routine system checks
âš¡ Requirements
- Experienced software engineer with a minimum of 5 years in the industry, particularly in software development and data acquisition
- Proficient in handling large stateful distributed systems and data processing
- Skilled in Kubernetes and Infrastructure-as-Code concepts
- Comfortable working with compliance and data privacy matters
- Strong communication skills and ability to collaborate with cross-functional teams
Software Engineer, Data Acquisition
San Francisco Bay Area
$310,000 - 385,000 USD / year
Engineering
About OpenAI
Building artificial general intelligence