You will join our team of world-class experts developing the AlphaSense platform. The team is right at the very core of what we do and responsible for implementing cutting-edge technology for scalable, distributed processing of millions of documents.
We are seeking a highly skilled Senior Software Engineer to join our dynamic team responsible for building and maintaining data ingestion systems at scale. As a key member of our team, you will play a crucial role in designing, implementing, and optimizing robust solutions for ingesting millions of documents per month from the public web. You are a good fit if you're a proactive problem-solver with a "go-getter" attitude, startup experience, and a readiness to learn whatever comes your way!
Design, develop, and maintain scalable data ingestion pipelines to process large volumes of documents efficiently and reliably.
Collaborate with cross-functional teams to understand requirements and translate them into technical specifications and system designs.
Implement best practices for data ingestion, storage, and processing to ensure high performance, scalability, and reliability.
Optimize data ingestion workflows to improve throughput, reduce latency, and minimize resource utilization.
Monitor system performance, troubleshoot issues, and implement solutions to address bottlenecks and ensure smooth operation.
Stay up-to-date with emerging technologies and industry trends related to data ingestion and multimedia processing, and propose innovative solutions to enhance our capabilities.
Work closely with Product Management to translate product requirements into software architectures
Follow the engineering processes, DevOps practices, and trends inside the company (monitoring, alerting, performance optimization, integration testing, design documentation) and make sure the teams improve related knowledge as well
Design, develop, and maintain high-performance, scalable applications.
Solve complex technical challenges with innovative solutions that enhance product features and operational efficiencies.
Collaborate across teams to integrate applications, optimize system performance, and streamline data flows.
Take full ownership of projects from inception to deployment, delivering high-quality solutions that improve user experience.
Lead or support data ingestion processes, ensuring seamless data flow and management.
Continuously learn and adapt to new tools, frameworks, and technologies as they arise, embracing a growth mindset.
Mentor and guide junior developers, fostering a collaborative, innovative culture.
4+ years of backend development experience, with a strong understanding of Python or Java
Experience with any cloud platforms (AWS, Azure, GCP).
Working knowledge of SQL and NoSQL databases.
Proactive problem-solver with a keen eye for tackling challenging technical issues.
A willingness to learn and adapt to new technologies and challenges as they arise.
Strong team player with a go-getter attitude, comfortable working both independently and within cross-functional teams.
Knowledge of data processing, microservices architecture, or DevOps practices.
Familiarity with Crossplane and/or ArgoCD for GitOps-based infrastructure management.
Experience with working on Docker, K8s
Experience with GenAI coding tool for productively achieving day-to-day tasks.