Cloud Data Engineer - Remote Eligible

Cloud Data Engineer

Apex Systems is seeking a Cloud Data Engineer to work with a team of subject matter experts and developers to design and implement full lifecycle data pipeline services for Azure cloud based data lake, SQL, and NoSQL data stores. The position can work remotely with potential travel to the Washington D.C. on special occasions.

As a Cloud Data Engineer, you will translate business requirements to data engineering solutions to support an enterprise scale Microsoft Azure based data analytics and reporting platform. You will support continued maintenance of legacy SQL Server ETL operations and transition to modern cloud native solutions. The ideal candidate is mission focused and delivery oriented, and applies critical thinking to create innovative functions and solve technical issues.

Responsibilities:

• Maintain and operate legacy ETL processes utilizing Microsoft SSIS, Powershell, SQL procedures, SSAS, .NET code, and other technologies.
• Implement full lifecycle Azure cloud native data pipeline development and operation.
• Work closely with client personnel and team members to understand data requirements and develop appropriate data solutions.
• Support the design and implementation of data models and data pipelines for relational, dimensional, data lakehouse (medallion architecture), data warehouse, data mart, SQL and NoSQL data stores.
• Utilize Microsoft Azure services including Azure Data Factory, Synapse Pipelines, Apache Spark Notebooks, Python, SQL, stored procedures to develop high performing data pipelines.
• Redevelop existing SSIS extract, transform, load scripts to Azure Data Factory and Synapse Pipelines.
• Identify, create, prepare data required for advanced analytics, visualization, reporting, and AI/ML.
• Implement data migration, data integrity, data quality, metadata management, and data security functions to optimize data pipelines.
• Monitor and troubleshoot data related issues to maintain high availability and performance.
• Implement governance, build, deployment and monitoring to automate platform operation.
• Actively support Agile DevOps process, including Program Increment planning.
• Actively engage in continuous learning to increase relevant skills.
• Maintain strict versioning and configuration control to ensure integrity of data.

Qualifications:

• BS degree in Computer Science or related field with 8+ years or Masters with 6+ years of experience required.
• 4+ years of experience developing and maintaining ETL processes using Microsoft SSIS, SQL, SQL Agent, and scripting languages including Powershell.
• 4+ years of experience with more than one of the following scripting languages: SQL, T-SQL, Python, PySpark.
• Experience working with Microsoft database and business intelligence tools, including SQL Server, including stored procedures, SSIS, SSRS, SSAS (cubes), scripting languages including PowerShell.
• Experience designing and building ETL/data engineering solutions utilizing various cloud services such as Azure Data Lake Services, Azure Synapse.

Other Requirements:

• Must be a U.S. Citizen with ability to successfully obtain a government-issued Public Trust clearance.

EEO Employer

Apex Systems is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Apex will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law.