Machine Learning Engineer
Job Description
IMC Financial Markets is hiring a Machine Learning Engineer in New York, NY for onsite work to build and optimise large-scale ML systems across global trading operations.
Responsibilities
- Develop large-scale distributed training pipelines for complex datasets and models.
- Partner with quantitative researchers to automate ML experiments, including hyperparameter tuning and model retraining.
- Collaborate with HPC specialists to optimise workflows, improve training speed, and reduce compute cost.
- Build and optimise low-latency inference pipelines for real-time predictions in production systems.
- Maximise performance in both training and inference using GPU hardware and acceleration libraries.
- Extend and improve the internals of machine learning frameworks and open-source tools to better match IMC workloads.
- Design scalable model infrastructure capable of handling high-volume trading data and delivering real-time, high-accuracy predictions.
- Evaluate and roll out third-party tools that enhance model development, training, and inference capabilities.
Requirements
- 3+ years of experience in machine learning, with a focus on training or inference systems.
- Production software engineering background: Python, a testing discipline, and genuine ownership of systems after they ship.
- Machine learning fundamentals: ability to reason about model behaviour, correctness, and performance beyond high-level APIs.
- Systems mindset: measurement-driven evaluation of performance, scale, and reliability; can make build-versus-buy decisions.
- Strong collaboration: can explain technical reasoning, work through differing perspectives with researchers, and adjust approach when evidence supports it.
Technologies
- Python
- PyTorch
- TensorFlow
- JAX
- CUDA
- Triton
Focus Areas
ML Research Engineering
- Develop large-scale distributed training pipelines for complex datasets and models.
- Automate ML experiments with quantitative researchers, including hyperparameter tuning and model retraining.
- Optimise workflows with HPC specialists to improve training speed and reduce compute cost.
ML Performance Engineering
- Build and optimise low-latency inference pipelines for real-time production predictions.
- Maximise performance in training and inference using GPU hardware and acceleration libraries.
Across both areas
- Extend and improve ML framework internals and open-source tools to raise performance for IMC workloads.
- Design scalable model infrastructure for high-volume trading data and real-time, high-accuracy predictions.
- Evaluate and roll out third-party tools that improve model development, training, and inference.
Depth (One or more)
- Distributed training and large-scale systems: parallelism strategy, data pipelines, checkpointing; frameworks such as PyTorch, TensorFlow, or JAX.
- GPU performance and low-level optimisation: memory, compute, and latency reasoning at the device level; optimising across kernels, compilers, and hardware (e.g., CUDA, Triton or equivalent).
- Production inference systems: building and hardening real-time, low-latency prediction pipelines in high-performance environments.
- Numerics and correctness at scale: handling low-precision effects, KV caching, batching, and understanding which optimisations stay bit-exact.
Also a Plus
- Exposure to cloud platforms and orchestration tools.
- A track record of contributing to open-source projects in machine learning, data science, or distributed systems.
Salary and Benefits
- Salary range: USD 175,000 - 250,000 per year.
- Full-time, permanent positions are eligible for a discretionary bonus and benefits, including paid leave and insurance.