Azure Data Engineer With SQL & Databricks

Azure Data Engineer With SQL & Databricks

Azure Data Engineer with SQL & Databricks Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.

Job Location: Atlanta, GA / Chicago, IL (Hybrid)

We are looking for a skilled Azure Data Engineer with SQL & Databricks to design and develop scalable data pipelines and real-time event streaming processes. This role involves working closely with Data Analysts and cross-functional teams to gather requirements, set up interfaces, and implement robust data solutions using Azure technologies. The ideal candidate will have hands-on experience with both batch and real-time data ingestion patterns and a strong understanding of Azure Data Lake (EDL), Data Warehouse (ASL), and Operational Data Hub (ODH).

Key Responsibilities:

• Design and develop data pipelines from source systems to Azure Data Lake (EDL) and Data Warehouse (ASL).
• Build event streaming solutions from data producers to consumers using best design practices.
• Collaborate with Data Analysts and other stakeholders to gather and refine data requirements.
• Implement various ingestion patterns to onboard data into target platforms.
• Ensure data quality, scalability, and performance across all data solutions.
• Integrate real-time data flows into the Operational Data Hub (ODH).

Required Skills & Technologies:

• Data Engineering & Azure Tools:
• Databricks
• PySpark
• SQL
• Azure Data Factory
• Delta Lake
• Synapse Analytics (Dedicated SQL Pool)
• Erwin, Hackolade, or similar data modeling tools
• Real-Time & Event Streaming Technologies:
• Kafka
• Azure Event Hub
• Azure Functions
• Azure Logic Apps
• Java
• CosmosDB

Preferred Qualifications:

• Experience with real-time data processing and streaming architectures.
• Strong understanding of data modeling and metadata management.
• Familiarity with Agile development methodologies.
• Excellent problem-solving and communication skills.

Life at Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

• Flexible work
• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Disaster Relief

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship. Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Salary Transparency: Capgemini discloses salary range information in compliance with state and local pay transparency obligations. The disclosed range represents the lowest to highest salary we, in good faith, believe we would pay for this role at the time of this posting, although we may ultimately pay more or less than the disclosed range, and the range may be modified in the future. The disclosed range takes into account the wide range of factors that are considered in making compensation decisions including, but not limited to, geographic location, relevant education, qualifications, certifications, experience, skills, seniority, performance, sales or revenue-based metrics, and business or organizational needs. At Capgemini, it is not typical for an individual to be hired at or near the top of the range for their role. The base salary range for the tagged location is $80420 to $106050/yearly. This role may be eligible for other compensation including variable compensation, bonus, or commission. Full time regular employees are eligible for paid time off, medical/dental/vision insurance, 401(k), and any other benefits to eligible employees.