Lead Big Data Engineer

Lead Big Data Engineer

Wells Fargo is seeking a Lead Big Data Engineer to join our Enterprise Data & Analytics Technology team, supporting mission-critical data platforms and services.

The person in this role will lead engineering efforts across large-scale distributed data systems, guiding the design, development, and optimization of data pipelines that power analytics, AI, and operational intelligence across the bank.

This is a great opportunity for a hands-on technologist with deep expertise in big data ecosystems (e.g., Hadoop, Spark, Kafka) to drive innovative, scalable solutions that impact a wide variety of business functions. The ideal candidate will bring strong leadership, architectural insight, and a passion for data engineering excellence.

In this role, you will:

• Lead complex initiatives with broad impact and act as key participant in large scale software planning for the Technology area.
• Design, develop, and run tooling to discover problems in data and applications and report the issues to engineering and product leadership.
• Review and analyze complex software enhancement initiatives for business, operational or technical improvements that require in depth evaluation of multiple factors including intangibles or unprecedented factors.
• Make decisions in complex and multi-faceted data engineering situations requiring understanding of software package options and programming language and compliance requirements that influence and lead Technology to meet deliverables and drive organizational change.
• Strategically collaborate and consult with internal partners to resolve highly risky data engineering challenges.
• This role is required for Design and lead the Collections dataspace technical team. Lead engineer is for building and maintaining metadata drive-in pipelines for ingesting, transforming, and mastering content metadata with the goal of providing clean and accurate metadata for various use-cases to support business objectives throughout the collection's organization.
• This role is important in ensuring the quality and expediency of our reporting in regard to content KPIs.
• Lead the successful design and development of our Data Products and Operational Datastore around Collections Technology.
• Design and develop scalable data warehousing solutions, building ETL pipelines (cloud, on-prem, hybrid). Previous knowledge in SSIS Preferred
• Designing, building data pipelines, data migration experience is needed.
• Performance tuning of JVM tuning, OpenShift, Kubernetes, Jenkins, Spark/Hive Tuning, UCD1
• Design, implement and support high-performance, low-latency, client-facing front end and back-end applications.
• Support data pipelines within SQL Server, Spark, Hive, S3, Hadoop.
• Help architect data solutions/frameworks around operational data store.
• Collaborate with Product Managers, POs, Architects and Principal Engineers to design, implement, and deliver successful data solutions.
• Maintain detailed documentation of your work and changes to support data quality and data governance.
• Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers.
• Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team
• Serve as an advanced resource to other Data Engineers on the team and mentor and coach more junior members of the team helping to improve their skills, knowledge, and productivity.

Required Qualifications:

• 5+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
• 4+ years of experience in system migrations (application and data migration)
• 3+ years of experience with scripting, including Java, Spark, Kafka, Hadoop, Hive, Python and Bash
• 4+ years of experience in familiarity with Scrum and Agile methodologies
• 5+ years of experience in Java and Spring frameworks

Desired Qualifications:

• 4+ years of experience in full stack development experience, Nice to have React, Angular JS experience.
• 2+ years of Familiarity with Data Modeling techniques and ODS standard methodologies and practices
• 2+ years of in-depth experience developing applications Domain driven approach
• Excellent problem-solving skills with a strong attention to detail and excellent analytical and communication skills
• GCP/Kubernetes certification is plus.

Job Expectations:

• This position is not eligible for Visa sponsorship
• Ability to work on-site at approved location listed
• Relocation assistance is not available for this position

Pay Range:

Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to achievements, skills, experience, or work location. The range listed is just one component of the compensation package offered to candidates.

$143,000.00 - $224,000.00

Benefits:

Wells Fargo provides eligible employees with a comprehensive set of benefits, many of which are listed below.

• Health benefits
• 401(k) Plan
• Paid time off
• Disability benefits
• Life insurance, critical illness insurance, and accident insurance
• Parental leave
• Critical caregiving leave
• Discounts and savings
• Commuter benefits
• Tuition reimbursement
• Scholarships for dependent children
• Adoption reimbursement