Big Data Engineer

Big Data Solutions Engineer

Responsibilities

Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.

Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.

Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.

Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques.

Optimize data processing workflows for maximum performance and efficiency.

Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems.

Implement best practices for data governance, security, and compliance.

Document technical designs, processes, and procedures to support knowledge sharing across teams.