Senior Backend Engineer: Machine Learning Infrastructure
Remote · location unlistedFull-time$80–120K/yrPosted 2mo agoStill listed 4 days ago
Most applications go out cold — see where you stand first. No sign-up to start.
Watch jobs like this. New remote roles like this one, by email.
Don't just apply. Show up ready.
Olive works from this exact posting.
At a glance
Olive lists jobs from US employers, including remote roles you can work from the United States.
Job overview
Constructor seeks a Senior Backend Engineer to design, build, and operate high‑load distributed services for its machine learning infrastructure, delivering self‑service, scalable components that empower product teams while ensuring reliability, performance, and continuous improvement.
Skills & qualifications
Skills
Qualifications
Benefits
Full job description
About Us Launched in 2019, Constructor is an AI-first e-commerce search and discovery platform that helps shoppers find the right products at the right time and enables leading global e-commerce brands to drive meaningful revenue and conversion gains.
About The Role The ML Infrastructure team builds and operates the shared backend services and platform capabilities that Constructor's ML and product teams rely on to develop, deploy, and run machine learning at scale - from model serving (including LLMs) to the specialized storages and data pipelines behind it. We are a service team by nature: our roadmap is shaped by the needs of product teams, and we succeed when they can move faster with less friction. We're looking for a Senior Backend Engineer who is comfortable with, and motivated by this dynamic, and who will take end-to-end ownership of core services. In the near and mid-term, our focus areas include:
-
Making ML workloads easy to run, scale, and operate for every team
-
Providing self-service, configurable infrastructure components to ML and product teams
-
Owning and evolving core ML services and related pipelines with a high bar for reliability and performance
Challenges you will tackle
-
Design, build, and operate high-load distributed backend services that power the company's ML infrastructure
-
Take end-to-end ownership of core ML services and related data pipelines: from design and implementation to deployment, observability, and continuous improvement
-
Partner with ML and product teams to understand their needs and turn them into reliable, reusable platform capabilities
-
Make and defend technical decisions: evaluate trade-offs, design first, and own the outcome
-
Be responsible for what you and your team do
Requirements
-
5+ years of professional experience in backend or platform engineering
-
Extensive Python knowledge (our primary language)
-
Hands-on experience developing on a public cloud (AWS, GCP, or Azure) or with self-managed Kubernetes - AWS is our primary platform, but we're not limited to it
-
Experience designing and building distributed, high-load services and APIs
-
Strong knowledge of data structures, algorithms, and their trade-offs
-
Design-driven engineering mindset: we're a coding-assistant-friendly environment and expect you to use modern AI tools - but you lead with system design and a strong understanding of their applicability and trade-offs
-
Ownership and proactivity: you can't close your eyes to problems, but are ready to solve them and take responsibility for outcomes
-
You are friendly and willing to help your teammates & others
Nice to have:
-
Experience with Rust (or C/C++/Go) - a strong plus
-
Experience developing or contributing to ML platforms or ML infrastructure - a strong plus
-
Experience setting up and operating any vector database (Qdrant, Milvus, Weaviate, OpenSearch, pgvector, etc.) - a strong plus
-
Experience with model serving / inference infrastructure, including LLMs
-
Experience with Infrastructure as Code (Terraform or similar)
Benefits
-
🏝️ Unlimited vacation time - we strongly encourage all of our employees take at least 3 weeks per year
-
🌎 Fully remote team - choose where you live
-
🛋️ Work from home stipend! We want you to have the resources you need to set up your home office
-
💻 Apple laptops provided for new employees
-
🧑🎓 Training and development budget for every employee, refreshed each year
-
👪 Maternity & Paternity leave for qualified employees
-
🧠 Work with smart people who will help you grow and make a meaningful impact
-
💵 Base salary: $80k–$120k USD, depending on knowledge, skills, experience, and interview results
-
📈 Stock options - offered in addition to the base salary
-
🎉 Regular team offsites to connect and collaborate
Diversity, Equity, and Inclusion at Constructor At Constructor.io we are committed to cultivating a work environment that is diverse, equitable, and inclusive. As an equal opportunity employer, we welcome individuals of all backgrounds and provide equal opportunities to all applicants regardless of their education, diversity of opinion, race, color, religion, gender, gender expression, sexual orientation, national origin, genetics, disability, age, veteran status or affiliation in any other protected group. Studies have shown that women and people of color may be less likely to apply for jobs unless they meet every one of the qualifications listed. Our primary interest is in finding the best candidate for the job. We encourage you to apply even if you don’t meet all of our listed qualifications. How we handle your data. By submitting this application, you acknowledge that Constructor will collect and process the personal data you provide for the purpose of evaluating your candidacy for this role. If you are not selected, we will retain your data for a limited period as described in our Recruitment Privacy Notice. After that period your data will be deleted or anonymized.
Similar jobs, posted recently
Open roles like this one, listed in the last 30 days.
Senior Machine Learning Engineer, Autonomous DefenseHorizon3.ai · Remote · US · $211–249K/yrPosted 3w agoPosted 3w ago
Senior Software Engineer, Machine Learning Infrastructure & AutomationFal · Remote · US · $170–230K/yrPosted 1 day agoPosted 1 day ago
Sr. Manager, Software Engineering - Machine Learning SimulationsUpstart · Remote · location unlisted · $195–270K/yrPosted 4w agoPosted 4w ago
Sr. Director of Machine LearningHims & Hers Health Inc. · Remote · US · $330–360K/yrPosted 1w agoPosted 1w ago
Manager, Machine Learning Operations (Remote)Kohl's · Remote · USPosted 4 days agoPosted 4 days ago
You've read the whole posting — now see how you match it.