SW Engineer - Data Services For Genai, Aidp

SW Engineer - Data Services For GenAI, AiDP

People at Apple don't just build products — they craft the kind of experience that have revolutionized entire industries. The diverse collection of our people and their ideas inspire innovation in everything that we do. Imagine what you could do here! Join Apple, and help us leave the world better than we found it. Data powers Apple's software, services, and product development. Apple's Data Services Org. Provides a diverse range of data solutions, including SQL and NoSQL databases, search engines, and streaming platforms with GenAI capabilities. Apple's Data Services team supports building data platforms for several large-scale data science applications. We work on many high-impact projects that serve various Apple lines of business. We use the latest in open source technology and as committers on some of these projects, we are pushing the envelope. Working with multiple lines of business, we manage many streams of Apple-scale data. We bring it all together and extract the insights & value. We do all this with an exceptional group of software engineers, data scientists, SRE/DevOps engineers, and managers. We are looking for a talented and dedicated big data engineer to join our team to bring passion for infrastructure and distributed systems to build world-class data platforms/products at a very large scale across multiple cloud environments running on S3, Kafka, Flink, Spark, LLMs and AI/ML! You would work on developing/deploying large-scale big data analytics or streaming applications and services.

Description

What are we expecting? This position demands the best and brightest software engineers; with Computer Science fundamentals, strong programming and problem solving skills. The ideal candidate will bring a lot of energy, innovation and excitement! in everything that we do. You will be eager to learn various deployment models, RAG based apps and explore cutting edge technologies(Mistral, Haystack) that aid in design and development of self-healing applications. You will be ready to learn and explore cutting edge technologies in distributed computing and big data. You like to automate anything which you do and you document it for the benefit of others. You are an independent problem-solver who occasionally takes directions from seniors and is capable of exhibiting deftness to handle multiple simultaneous competing priorities and deliver solutions in a timely manner. Provide incident resolution for all technical production issues. Create and maintain accurate, up-to-date documentation reflecting configuration, and responsible for writing justifications, training users on complex topics, writing status reports, documenting procedures, and interacting with other Apple staff and management. Provide guidance to improve the stability, security, efficiency, and scalability of systems. Strong troubleshooting ability will be used daily; will take steps on their own to isolate issues and resolve root causes through investigative analysis in environments where the candidate has little knowledge/experience. Administer and ensure the proper execution of the backup systems. We are dedicated to the goal of building a culturally diverse and pluralistic team that reflects the multicultural variety of our customers.

Minimum Qualifications

Bachelor's Science in Computer Science or equivalent focus area
2+ years of industry experience in software development or production operations experience in a large-scale environment
1+ year experience with shell & python scripting, Linux system internals
Experience with deploying, supporting OR monitoring services, platforms, OR application stacks
Kubernetes experience in industry

Preferred Qualifications

Master's Science in Computer Science or equivalent
2+ years of experience in designing and managing large scale production grade deployments both in on-prem and in the cloud (any one of AWS, Azure, and GCP) with a focus on their included ML services
Basic understanding of distributed database architectures with MPP / OLTP
Comfortable working in a fast-paced environment while continuously evaluating emerging technologies. Familiarity with logging and observability technologies such as Splunk, Grafana, Prometheus or similar technologies.
Experience with containers and container orchestration platforms such as Docker, Kubernetes, or similar
Strong understanding of data structures & algorithms- skips lists, B-trees and inverted indices
Strong problem solving skills, with the ability to break down complex problems into manageable components to develop innovative solutions
Ability to adapt to changing priorities, technologies and requirements swiftly with a desire to learn and grow
Effective time management skills with the ability to prioritize tasks, manage multiple projects and meet deadlines
Excellent verbal and written communication skills, able to work collaboratively with cross-functional teams, including data scientists, program managers and engineers
Experience in Open Source software development using GitHub and CI/CD is desirable
Exposure to data pre-processing, feature extraction and data visualization tools is preferred