Easy Apply
Easy Apply
As a Senior ML Runtime Engineer at Fractile, you will integrate AI acceleration hardware with ML software projects, develop high-performance runtimes, and collaborate on co-design methodologies.
At Fractile, we’re taking a revolutionary approach to computing to run the world’s largest language models 100x faster than existing systems. Our fast-growing team is working at the cutting edge of the latest AI developments in both hardware and software. Want to get involved?
We are looking for Senior ML Runtime Engineers with experience of key ML software ecosystem components to work on inference server integrations and the runtime stack of our ground-breaking AI accelerators. You can be based in either our London office or Bristol, the choice is yours.
In this role, you will:
- Integrate Fractile's innovative AI acceleration hardware with leading open source projects like PyTorch, vLLM, and SGLang
- Develop our underlying high-performance Rust runtime
- Work with hardware, lower-level software, and ML engineers in a highly collaborative hardware-software co-design methodology
It would be great if you have:
- Proven experience of working with major ML software ecosystem projects
- A good understanding of the latest ML workloads and inference deployment challenges
- Excellent Python and Rust skills and solid experience of industry standard development tools and technologies
- A creative and innovative mindset, and a willingness to take ownership and drive results in a fast-paced environment
- Computer Science, Electronic Engineering, Maths, Physics, or related degree and 5+ years of industry experience
You may also have:
- Experience of working with GPUs or other machine learning accelerators
- Previous experience in a startup or small team environment
Top Skills
Python
PyTorch
Rust
Sglang
Vllm
Similar Jobs
Semiconductor
The Senior ML Runtime Engineer will integrate AI acceleration hardware with open source projects, develop high-performance Rust runtime, and collaborate on hardware-software design.
Top Skills:
MlPythonPyTorchRustSglangVllm
Healthtech • Logistics • Pharmaceutical
The Head of Support IT will manage the IT support service, focusing on customer experience, proactive solutions, team leadership, and strategic collaboration with multi-functional partners to enhance technology use across the organization.
Top Skills:
AgileChange ManagementDevOpsIncident ManagementItil 4Problem Management
.png)
Greentech • Hardware • Internet of Things • Machine Learning • Software • Business Intelligence • Agriculture
Halter seeks expressions of interest for various roles across teams like Engineering, Product, Hardware, Sales, and Support. Applicants should be passionate about impactful work and problem-solving. A cover letter is required to express interest and qualifications.
What you need to know about the Bristol Tech Scene
Along with Gloucester, Swindon and Bath, Bristol is part of the "Silicon Gorge" tech hub, a region in the U.K. renowned for its high-tech and research-driven industries, with a particular emphasis on sustainability and reducing environmental impact. As the European Green Capital, Bristol is home to 25,000 cleantech companies, including Baker Hughes and unicorn Ovo Energy. The city has committed to achieving net-zero emissions within the next decade.
