Data Engineer

Job Posting

We are looking for a skilled and driven Data Engineer to join our team in San Juan Capistrano, California. This role centers on building and optimizing data pipelines, integrating systems, and implementing cloud-based data solutions. The ideal candidate will have a strong grasp of modern data engineering tools and techniques and a passion for delivering high-quality, scalable solutions.

Responsibilities:

• Design, build, and optimize scalable data pipelines using tools such as Databricks, Apache Spark, and PySpark.
• Develop integrations between internal systems and external platforms, including CRMs like Salesforce and HubSpot, utilizing APIs.
• Implement cloud-based data architectures aligned with data mesh principles.
• Collaborate with cross-functional teams to model, transform, and ensure the quality of data for analytics and reporting.
• Create and maintain APIs while testing and documenting them using tools like Postman and Swagger.
• Write efficient and modular Python code to support data processing workflows.
• Apply best practices such as version control, CI/CD, and code reviews to ensure robust and maintainable solutions.
• Uphold data security, integrity, and governance throughout the data lifecycle.
• Utilize cloud services for compute, storage, and orchestration, including platforms like AWS or Azure.
• Work within Agile and Scrum methodologies to deliver solutions efficiently and collaboratively.

Requirements:

• A minimum of 5 years of experience in data engineering, software development, or a related field.
• Proficiency with Databricks, Apache Spark, PySpark, and relational or cloud databases.
• Strong Python programming skills for data integration and processing.
• Experience with API development and testing tools like Postman and Swagger.
• Expertise in cloud platforms such as AWS (e.g., S3, Lambda, AppFlow) or Azure.
• Solid understanding of data pipelines, architectures, and integration best practices.
• Familiarity with CRM integration, particularly Salesforce and HubSpot.
• Excellent problem-solving abilities and communication skills, with a collaborative mindset.