We are hiring a Senior Data Engineer to join our Engineering team. In this role, you will take the lead on building and maintaining the metadata ingestion and lineage systems for integrations. You'll collaborate closely with design, product management, and engineering to shape our core platform, improving performance, and influencing our product roadmap. We value your problem-solving skills, technical acumen, and ability to communicate complex ideas. We prioritize your potential, passion for learning, and commitment to best practices that will bring meaningful impact and help shape our platform's future.
Roles and responsibilities
Build and maintain the services related to data lineage and integrations for our product
Optimize and troubleshoot existing data infrastructure to ensure reliability and performance
Work cross functionally with engineers, design, and product
Design and maintain scalable and efficient data pipelines for processing and analyzing large datasets
Implement data models and structures to support the organization's data needs.
Stay up-to-date with industry trends, advancements in data quality tools, and emerging technologies related to data engineering
The ideal candidate should have:
At least 5 years of industry experience working as a data engineer
A fundamental understanding of some of the core technologies in our stack
Experience with big data technologies (e.g., Apache Spark, Hadoop) and data processing frameworks
Familiarity with database systems, both SQL and NoSQL, and experience with data modeling and database design
Proficiency in communicating complex technical issues to both technical and non-technical audiences
Passion for delivering scalable, reliable software
Nice to have
Building integrations for Modern Data Stack tools, i.e, Snowflake, Looker, dbt
Building a SQL parser
Building complex data pipelines
Secoda provides a competitive salary, excellent benefits, and an opportunity to be a part of a growing, dynamic, and innovative environment, employee discounts, wellness programs, and other perks.