Use Spot Instances for Training
Run interruptible jobs at a fraction of the cost.
Cheap Compute, One Catch
Cloud providers rent out spare capacity at a deep discount. These spot instances can cost up to ninety percent less than on-demand machines.
They Can Vanish Anytime
The catch is the provider can reclaim a spot instance with little warning. This interruption is why spot is cheap, and why you must plan for it.
All lessons in this course
- Right-Size Instances and Replicas
- Quantize and Distill for Cheaper Inference
- Use Spot Instances for Training
- Track Cost per Prediction