Role Overview

We are seeking a Backend Engineer to design and build the foundational systems that power AI-driven products. This role is ideal for someone with a strong backend engineering background who is excited to work at the intersection of infrastructure and applied machine learning. The engineer will be responsible for creating robust services and infrastructure that enable scalable, intelligent applications.

Key Responsibilities

Backend System Design: Architect and implement scalable backend services and APIs that serve as the foundation of ML-powered applications.
Prompt Engineering Support: Collaborate with ML teams to experiment with prompt engineering techniques and perform lightweight model tuning to improve application behavior.
ML Infrastructure Development: Build and maintain infrastructure to support training, deployment, and monitoring of machine learning models using platforms such as SageMaker and Vertex AI.
Production Integration: Work closely with data scientists to integrate models into production systems and establish reliable pipelines for inference, logging, and observability.
Cross-Functional Collaboration: Partner with product, ML, and platform teams to deliver cohesive and performant AI solutions.

Tech Stack

Languages: Python (primary), with occasional use of Bash or Go
Cloud & Infrastructure: Google Cloud Platform (GCP), Terraform
ML Ops Tools: Vertex AI, SageMaker
Search & Indexing: Elasticsearch
AI/LLMs: Prompt engineering, light model customization

Ideal Candidate Profile

Proven experience building and scaling backend systems in Python
Strong knowledge of cloud infrastructure and infrastructure-as-code tools (e.g., Terraform)
Experience working with or supporting ML pipelines and data-driven systems in production
Comfortable experimenting with LLMs and prompt techniques to improve product functionality
Collaborative mindset with a strong sense of ownership and execution

Oscar Associates Limited (US) is acting as an Employment Agency in relation to this vacancy.

Oscar

Latest Jobs

Backend ML Engineer