Skip to main content

All remote roles

Engineering fully-remote

Senior Machine Learning Engineer, LLM Inference Optimization

at Nebius

$143,824 – $200,000estimated from 234 similar engineering roles

An estimate from salaries disclosed to us for similar roles, not a figure Nebius published for this role.

Own model and endpoint optimization from model artifacts through production deployment, spanning model internals, quantization, and compression.

Apply on Nebius's site ↗

AI-verified last checked 2026-11-14

Remote policy
fully-remote
Type
—
First seen
2026-11-14

About this role

About Nebius: Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure. Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI. Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.

The role

As a Senior Machine Learning Engineer on the Applied AI team at Nebius Token Factory, you will own model and endpoint optimization from model artifacts through production deployment. Your work will span model internals, quantization and model compression, speculative decoding, KV-cache optimization, inference engines, serving architecture, and benchmarking to improve latency, throughput, memory efficiency, GPU utilization, and cost per token while preserving quality and reliability.

An excerpt of the employer's posting (the opening of 6,813 characters). Read the full posting and apply on Nebius's site ↗

machine-learninginference
Team
ML
Region
APAC
Posted
2026-09-24
Last seen alive
2026-11-14
Last verified
2026-11-14
Verification
AI-verified
Board
greenhouse
Report expired / not remote

Check the employer's posting first. If it is gone or not actually remote, tell us via contact with "Senior Machine Learning Engineer, LLM Inference Optimization at Nebius"; the next ingest drops it.