The Data Engineer is a specialist in the construction and optimization of data pipelines, infrastructure, and cloud services, with a focus on scalability, security, and cost efficiency. They master the use of GCP components such as Cloud SQL, Dataflow, Pub/Sub, and IAM to build robust and governed environments. They use Python to develop efficient and scalable pipelines, automations, and APIs, always following good engineering practices. They focus on the continuous optimization of queries, memory, processing, and infrastructure costs, ensuring maximum efficiency. Additionally, they design and expose APIs and microservices for data ingestion, orchestration, and consumption, ensuring standardized contracts, security through IAM/OAuth, and reliable consumption for business products and teams.
Principales Responsabilidades:
Design and develop efficient pipelines, optimizing performance and costs on BigQuery. Implement and maintain analytical data models (Data Warehouse / Data Marts) in BigQuery. Develop and version transformation code using Dataform. Integrate data sources from internal systems, APIs, and real-time streams (Pub/Sub, etc.). Implement quality controls, automatic tests, and monitoring of datasets. Automate processes using Cloud Functions / Cloud Run / Composer / Dataform. Manage data security and governance, ensuring compliance with internal policies (IAM, policy tags, policy row, etc.). Collaborate with business teams to understand requirements and translate them into data solutions. Document processes, structures, and data flows following engineering standards.
Technical & Power Skills:
Beneficios:
Being a maker is cool: we have very good benefits and many activities to have fun! Don't worry, be happy: 3 additional days off per year in addition to your vacations. Leave without pay to fulfill your dreams. Wellness program focused on balancing work and personal life. 100% free complementary insurance for makers. Training programs, English classes, and much more! Free day for your birthday and half a day for the birthdays of your children. Bonuses that give respite: national holidays, Christmas, marriage/AUC, birth/adoption of children, etc. Agreements and preferential prices with banks. 3 additional days for parents for birth or adoption of child/children. Insurance agreement for your pets! Our culture is horizontal, innovative, challenging and above all, it is filled with good vibes! In the context of our commitment to labor inclusion, the following vacancy is open to Law 21.015, we urge you to apply through our portal.