Data Engineer IV - #26 - 10792

Senior Software Engineer

The Data Office is building modern, enterprise data platforms that make data easy to understand, trust, and consume at scale. The Data Marketplace is a core capability in this vision, serving as the enterprise gateway for discovering data assets within the data enterprise.

We are seeking a Senior Software Engineer with a strong background related to our tech stack to build and operate the software, data, and metadata foundations of the Data Marketplace. This is a hands-on individual contributor role focused on platform needs for scalable services, search and catalog capabilities, and enabling other experiences that improve how employees find and use data.

Responsibilities

• Design, develop, and maintain Python-based services, Lambda functions, and data pipelines.
• Provision and manage AWS infrastructure using Terraform, following best practices for modularity, security, and maintainability.
• Build and operate AI/ML and search capabilities on OpenSearch, including vector search, semantic retrieval, and integration with LLM-driven workflows.
• Collaborate with data, platform, and security teams to deliver end-to-end solutions across AWS services (Lambda, API Gateway, Glue, S3, DynamoDB, IAM, VPC, etc.).
• Modernize Dynatrace alarming using Terraform and Python.
• Champion code quality through reviews, automated testing, CI/CD pipelines, and observability.
• Mentor junior engineers, share best practices, and contribute to architectural decisions and technical standards.
• Be able to think unconventionally to find the best way to solve for a defined use case with fuzzy requirements.
• Self-starter mentality. Willing to do their own research to solve problems and can clearly present findings and engage in conversation on what makes one solution better than another.

Must-Have Tech Stack

• 5 years of professional software development experience and must be able to code.
• Python: strong proficiency, including type hints, testing (unittest/pytest), and packaging.
• Terraform specifically for Infrastructure as Code related to AWS.
• GitHub
• Confluence
• OpenSearch: index design, query DSL, and vector/k-NN search.
• AI/ML: embeddings, RAG patterns, foundation models, and ML model integration.
• AWS services: DynamoDB, Glue, IAM, S3, API Gateway, Lambda

Nice to Have

• Collibra or experience integrating with enterprise data catalog or governance platforms.
• Kafka or other event-driven architecture.
• AWS services: Lake Formation

US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

AI Statement: By applying, you acknowledge that AI-assisted tools may be used during hiring.