Principal Data Engineer

Data Modeling And Reporting Expert

We are seeking an expert in data modeling and reporting to optimize the analysis of customer data. In this role, you will focus on designing and enhancing reporting solutions using Databricks. You will be responsible for creating and managing data sets that integrate customer and product data, making it accessible for internal teams to query and analyze. This position contributes to the enterprise's success by contributing to enterprise data services for analytic and operational data solutions focused on the Customer and Product domains. The candidate must demonstrate a proven track record in successfully implementing the design and optimization of a high-performance data store, for real-time, complex reporting on large-scale POS transactions, enabling dynamic, multi-dimensional queries by customer and product. This position is also responsible for contributing to the design and development of data pipelines supporting the Customer data store. We are looking for an expert-level candidate. Key responsibilities include:

• Designing and optimizing data models to support reporting on customer and product data
• Building and maintaining datasets that include key customer information, such as rewards program participation, ordering preferences, store location preferences, and geographic data
• Ensuring data accuracy, consistency, and accessibility for internal teams to leverage in their analysis and decision-making
• Collaborating with cross-functional teams to ensure data is structured and presented in a way that supports business objectives
• Working with data engineering and technical product manager teams to develop the data model to support customer analytical and operational use cases
• Translating complex business logic into streamlined data models to support a variety of data consumers
• Designing data models to scale and be extensible
• Working with data engineering team to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline and sources
• Developing and maintaining documentation relating to all assigned systems and projects

The ideal candidate will have strong expertise in Databricks and reporting, with the ability to work with complex data sets to deliver valuable insights for the organization.

Skills and Requirements:

• 10+ years of data analysis
• 7+ years SQL Platform
• 7+ years PySpark
• 4+ years Data modeling on Databricks
• 3+ years parsing JSON into reusable data products
• Strong reporting experience with Power BI, Tableau
• Experience using Azure preferred for data applications
• Effective communication skills
• Excel at problem solving
• Strong working knowledge of SQL and No-SQL Platforms
• Proficiency in debugging, troubleshooting, performance tuning and relevant tooling
• Experience using one of the public cloud (AWS or Azure preferred) for data applications
• Expert understanding of data design patterns and best practices
• Proficiency in logging and monitoring tools, patterns & implementations
• Practice agile and DevOps
• Experience in the financial trading world with high performance transaction
• Experience from social media companies or other companies with lots of data