Senior Data Engineer - ai/bi Analytics

Senior Data Engineer-AI/BI Analytics

Join a groundbreaking team at Bank of America, at the forefront of innovation in AI. We are building the next generation of Gen AI platform, empowering new AI initiatives across Consumer, Small Business, Global Banking, and Wealth organizations. This is a unique opportunity to contribute to a critical platform that will enable secure, scalable, and high-performance AI capabilities across the organization. We value curiosity, collaboration, and a passion for pushing the boundaries of what's possible with AI. This position is focused on design, build, and serve the Gen AI inferencing capabilities. This job is responsible for defining and leading the engineering approach for complex features to deliver significant business outcomes. Key responsibilities of the job include delivering complex features and technology, enabling development efficiencies, providing technical thought leadership based on conducting multiple software implementations, and applying both depth and breadth in a number of technical competencies. Additionally, this job is accountable for end-to-end solution design and delivery.

Responsibilities include:

• Assembling large, complex data sets that meet functional and non-functional requirements, ensuring that the design and engineering approach is consistent across multiple systems
• Maintaining, improving, cleaning, and manipulating large data for operational and analytics data systems, building complex processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management, and communicating required information for deployment, maintenance, and support of business functionality
• Utilizing multiple architectural components in the design and development of client requirements and collaborating with development teams to understand data requirements and ensure the data architecture is feasible to implement
• Defining and building data pipelines to enable data-informed decision making, ensuring adherence to release processes and risk management routines
• Contributing to existing test suites including integration, regression, and performance, analyzing test reports, identifying any test issues and errors, and leading triage of underlying causes
• Leading the identification of gaps in data management standards adherence and working with appropriate partners to develop plans to close gaps, leading concept testing and conducting research to prototype toolsets and improve existing processes
• Mentoring Data Engineers in the delivery and release of continuous integration and continuous delivery events and defining key performance indicators and internal controls
• Ensuring that the design and engineering approach for complex features are consistent with the larger portfolio solution. Accountable for the availability, stability, scalability, security, and recoverability enabled by the designs
• Defining the technology tool stack for the solution and evaluating and adapting new testing tool/framework/practices for team(s)
• Enabling team(s)/applications with Continuous Integration/Continuous Development (CI/CD) capabilities and engaging with other technical stakeholders pertaining to efficient functioning of CI-CD pipeline
• Guiding and influencing team(s) on design and best practices for high code performance –e.g. pairing, code reviews
• Providing end-to-end delivery of complex features, including automation, for either a single team or multiple teams, at the program level
• Conducting research, design prototyping and other exploration activities such as evaluating new toolsets and components for release management, CI/CD, and features
• Working with stakeholders to establish high-level solution needs and with architects for technical requirements
• Proficient written and verbal communication skills to support and shape the platform and clearly articulate technical designs and concepts; and to communicate effectively with all levels within the organization
• Design and execute the implementation plans to both move forward strategically, while at the same time ensuring the current technology stack is supporting current needs
• Manage multiple priorities, and simultaneously engage with multiple teams worldwide
• Coach and mentor team members

Required qualifications include:

• 10+ years strong experience designing and delivering AI, ML, Data platform, and advanced analytics platforms capabilities using open-source technologies in large enterprise environment
• Experience with emerging technologies e.g. of GenAI (public and open source), MCP, Agents, AI BI etc.
• Hands-on experience on data science, big data, cloud, governance technologies
• Experience architecting next generation AI analytical product delivery to all levels of users in organization using self-service interfaces
• Proven track record in data, analytics, insight and AI/ML platforms supporting multiple business units
• Experience in designing, developing, and maintaining software frameworks using Open-Source technologies such as Python, Spark, Jupyter, FastAPI, LabelStud.io, Ragas etc.
• Strong working experience of how metadata management, semantic layers, labeling, annotations is important for enabling AI BI, MCP, Agents, Data Assistants etc.
• Experience with using various Open source and Cloud model for AI BI, Summarization etc., and tuning those models and deployment to provide higher throughput for latency and cost optimizations
• Experience of building RAG with knowledge base, data sources and Vector Store platforms such as Redis, Solar, Postgres DB, FAISS, Teradata, Oracle, SQL Server, Hadoop etc.
• Hands on experienced building RAG, RAG Fusion, CAG etc.
• Experience with various inference metrics, and related monitoring and observability
• Experience with serving multiple tenants/clients with model endpoints with secure boundaries
• Experience with AI gateway, OPA, authentication & authorization, policy as code, API based systems Integration, cost management, and model routing

Desired qualifications include:

• Experience developing Gen AI training and RAG platform with open-source model, inferencing & servicing capabilities, MCP modules etc.
• Hands on experience on driving and maintaining a culture of quality, innovation, and experimentation
• Research on new tools and capabilities for better UI and UX for advanced analytics platform, quick prototype and demonstrate the features and capabilities, and participate on various user forums

Skills include:

• Analytical Thinking
• Application Development
• Data Management
• Risk Management
• Solution Design
• Agile Practices
• Architecture
• Collaboration
• Decision Making
• DevOps Practices
• Business Acumen
• Data Quality Management
• Financial Management
• Solution Delivery Process
• Test Engineering

Shift: 1st shift (United States of America)

Hours Per Week: 40

Bank of America and its affiliates consider for employment and hire qualified candidates without regard to race, religious creed, religion, color, sex, sexual orientation, genetic information, gender, gender identity, gender expression, age, national origin, ancestry, citizenship, protected veteran or disability status or any factor prohibited by law, and as such affirms in policy and practice to support and promote the concept of equal employment opportunity, in accordance with all applicable federal, state, provincial and municipal laws. The company also prohibits discrimination on other bases such as medical condition, marital status or any other factor that is irrelevant to the performance of our teammates.