Data Engineering - Remote Eligible

Data Engineer

Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl? As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role? Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips. As a Data Engineer at Kyndryl, you'll be at the forefront of the data revolution, crafting and shaping data platforms that power our organization's success. This role is not just about code and databases; it's about transforming raw data into actionable insights that drive strategic decisions and innovation. In this role, you'll be engineering the backbone of our data infrastructure, ensuring the availability of pristine, refined data sets. With a well-defined methodology, critical thinking, and a rich blend of domain expertise, consulting finesse, and software engineering prowess, you'll be the mastermind of data transformation. Your journey begins by understanding project objectives and requirements from a business perspective, converting this knowledge into a data puzzle. You'll be delving into the depths of information to uncover quality issues and initial insights, setting the stage for data excellence. But it doesn't stop there. You'll be the architect of data pipelines, using your expertise to cleanse, normalize, and transform raw data into the final dataset—a true data alchemist. Armed with a keen eye for detail, you'll scrutinize data solutions, ensuring they align with business and technical requirements. Your work isn't just a means to an end; it's the foundation upon which data-driven decisions are made – and your lifecycle management expertise will ensure our data remains fresh and impactful. So, if you're a technical enthusiast with a passion for data, we invite you to join us in the exhilarating world of data engineering at Kyndryl. Let's transform data into a compelling story of innovation and growth.

Every position at Kyndryl offers a way forward to grow your career. We have opportunities that you won't find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector, you can find your opportunity here.

You're good at what you do and possess the required experience to prove it. However, equally as important – you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused – someone who prioritizes customer success in their work. And finally, you're open and borderless – naturally inclusive in how you work with others.

Responsibilities:

• Design, develop, and deploy high-quality, cost-optimized data solutions (processing time, cluster utilization, and Azure services), secure, and scalable (batch and/or real-time) in accordance with the unified data architecture (Cloud/On-Premise) and implementation strategies (To-Be and transient).
• Develop solutions using best practices, frameworks, components, and tools standardized by the Data COE.
• Lead root cause analysis (RCA) and provide solutions.
• Perform freeze and production deployment of data solutions, participating in the deployment flow, developing quality process deliverables and maintaining healthy rejection and rollback indicators.
• Develop deliverables and documentation, defined in the Data process, corresponding to the data solution.
• Propose efficient and effective implementation strategies for solutions in accordance with the unified data architecture.
• Implement automations and reusable components that allow for standardizing solution development and construction practices.
• Analyze and optimize production processes that show performance degradation and improper use of computing resources in order to maintain platform stability, thereby capturing lessons learned and sharing best practices with the Data COE.
• Co-create guidelines, best practices, development standards, and provide technical advice on solutions.
• Demonstrate technical leadership and resolve complex data engineering issues related to cloud services, solution programming, and data processing in the Lakehouse Cloud.
• Deliver project progress presentations to management and executive levels.
• Actively contribute by applying knowledge and experience to the Data COE community.

Seniority: 5 or more years of experience in the required technologies

Competencies:

• 5 or more years of experience implementing cloud solutions (regardless of the cloud) with the required technologies, having performed the following activities:
• Analysis and development of data ingestion and transformation flows in Lake House using cloud services.
• Analysis and development using distributed processing in Spark using PySpark/Spark in batch (mandatory) and real-time (desirable).
• Optimization of existing or existing processes with a focus on cost reduction (processing time, cluster usage, and Azure services) in the consumption of cloud services.
• Analysis and scheduling of processes according to user-defined criteria.
• Deployment of solutions in production using continuous integration and deployment (DevSecOps) tools.
• Development of cross-cutting solutions for continuous improvement of the development framework and solution deployment.
• Development of best practices, frameworks, and development standards for cloud platforms.
• Consulting and technical advice on solution implementation strategies for cloud platforms.
• Hold the following Azure certifications (desirable) and/or equivalent certifications in other clouds:
• Databricks: Databricks Certified Associate Developer for Apache Spark, Databricks Certified Data Engineer Associate (desirable)
• Azure: Azure Data Engineer Associate and Data Engineer Professional (desirable)
• 5 or more years of experience working on at least 3 of the following cloud projects:
• Analyzing and processing large volumes of data
• Building data pipelines, ETL, and ELT
• Deploying scalable solutions in production, preferably for banking entities
• Migrating processes to cloud platforms
• Process optimization using distributed processing

Diversity is a whole lot more than what we look like or where we come from, it's how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we're not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you – and everyone next to you – the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That's the Kyndryl Way.

With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter – wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.