Data Engineer– Remote - INTL India

Data Engineer Azure Consultant

Insight Global is looking for two Data Engineer Azure Consultants who will be responsible for designing data models, data flows, and integration patterns necessary to build a robust and optimized cloud-based Azure data warehouse. They will work with business to understand their current state architecture and contributing data sources, technologies, interfaces, performance issues, and system configurations. They will work closely with the team across the overall data warehousing program including data acquisition, data curation, and data syndication. They will apply knowledge of the Microsoft platform tooling involved in successful Azure implementations. They will serve as the subject matter expert with respect to Azure, cloud applications, and system administration best practices. They will have experience designing data lakes, database schemas, and data models for large scale data platform implementation on Azure. They will develop system integrations using Azure Logic Apps, Integration Services, Power Automate, PowerApps, etc. They will perform project management activities including project documentation, business requirements, and project tracking. They will ensure data quality and consistency through data cleaning, transformation, and integration processes. They will monitor and troubleshoot data-related issues within the Azure environment to maintain high availability and performance. They will collaborate with data scientists, business analysts, and other stakeholders to understand data requirements and implement appropriate data solutions. They will implement data security measures, including encryption, access controls, and auditing, to protect sensitive information. They will automate data pipelines and workflows to streamline data ingestion, processing, and distribution tasks. They will utilize Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making. They will keep abreast of the latest Azure features and technologies to enhance data engineering processes and capabilities. They will document data procedures, systems, and architectures to maintain clarity and ensure compliance with regulatory standards. They will provide guidance and support for data governance, including metadata management, data lineage, and data cataloguing.

Tech Stack: Python, SQL and NoSQL databases, Scala, Spark-SQL

Experience with Azure: ADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB, Analysis Services, Azure Functions, Serverless Architecture, ARM Templates

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.