✨ About The Role
- Responsible for participating in architecture and engineering decisions to accelerate research towards AGI
- Ensuring the security, integrity, and compliance of data according to industry and company standards
- Scaling analytics and data platforms reliably to handle large amounts of data
- Empowering engineers, researchers, and teammates with excellent data tooling and systems
- Collaborating with product engineers, trust & safety, and other teams to build technical foundations for new features and capabilities
âš¡ Requirements
- Experienced in building stream and batch data processing pipelines using technologies like Kafka, Spark, and Flink
- Proficient in modern infrastructure management tools such as Kubernetes and Terraform
- Passionate about observability systems, especially in the context of ML training
- Skilled in software engineering, particularly in Python, and comfortable working with large codebases
- Familiar with data lifecycle management systems for large organizations and the associated challenges