Openpay MX - Asesor DATA Engineer - Remote Eligible

Openpay Data Engineer

Openpay is the platform for receiving and sending electronic payments of Grupo BBVA specialized in the development of digital tools to carry out accessible, secure, and innovative commercial transactions. We are the strategic ally of entrepreneurs and global leaders. We empower the digital transformation of businesses, we are the preferred platform for thousands of brands to process their payments.

BBVA is a global company with more than 160 years of history that operates in more than 25 countries where we serve more than 80 million customers. We are more than 121,000 professionals who work in multidisciplinary teams and with profiles as diverse as financial, legal experts, data scientists, developers, engineers, or designers.

What We Are Looking For

Key Responsibilities:

• Design and Maintenance of Pipelines: Construction of architectures type Medallion (Bronze, Silver, Gold Layers) in Databricks.
• High Performance ETL/ELT Development: Mastery of PySpark/Spark SQL for processing and transformation of large-scale data.
• Orchestration and Management: Orchestration of loads through Workflows, Delta Live Tables, and Asset Bundles.
• Optimization: Creation and optimization of Delta Tables (Gold/Silver) and data assets for ML/BI consumption.
• Governance: Use of Databricks Unity Catalog for management of metadata, data security, and lineage.
• Ingestion: Integration of pipelines with S3 and support for extraction and loading in relational and non-relational databases.
• AWS: Knowledge of key AWS tools for ingestion (e.g., AWS Glue, DMS, Kinesis/MSK or analogs).
• Quality and Monitoring: Normalization, automation of incremental loads, implementation of data quality checks and monitoring of pipelines and jobs through UI or custom logs.

Essential Skills and Knowledge:

• Dominance of Python (oriented to PySpark and automation).
• Dominance of SQL ANSI / Spark SQL for transformations and queries.
• Experience with Apache Spark 3.0+ and Delta Lake.
• Knowledge of the fundamentals of Machine Learning (ML) and Data Science:
• Understanding of the ML lifecycle (training, deployment, inference, and monitoring).
• Knowledge about the creation and management of Feature Stores and serialization of models.
• Basic understanding of data models and statistics for data cleansing and quality.

In case of requiring any reasonable adjustments* in your selection process, communicate to the recruiter in the first contact.

In BBVA we believe that having a diverse team makes us a better bank. For this reason, we actively support diversity, inclusion, and equal opportunities, regardless of your ethnic or national origin, sex, age, religion, disability, sexual orientation, gender identity or expression, social status, health condition, opinions, marital status, or any other that may undermine human dignity and have the purpose of nullifying or undermining the rights and freedoms of people. We are sure that cultivating a collaborative and inclusive work environment will allow us to show the best of ourselves.

*Reasonable adjustments comprise the modifications and/or adaptations that the company may make, during your selection process, with the purpose of allowing you to carry out said process adequately.

**For the Talent Attraction process, platforms of the BBVA Group, of which Openpay is part, are used. However, the hiring will be directly by Openpay SA de CV, which means that there is no labor link with any other company of the said Group.