Mystic Turbo Registry

An optimized Docker registry that enables faster loading of ML models and reduces the time required for cold starts.

Introduction

Optimized Docker registry for faster ML model loading and reduced cold starts.

What is the Mystic Turbo Registry?

Mysterious Turbo Registry is a custom Docker registry and containerd adapter designed to significantly speed up the loading process of ML models, increasing their loading time by as much as 11.4 times while reducing cold startup times by up to 90%. It is a high-performance AI model loader built using Rust, aimed at substantially minimizing the cold startup duration of ML models.

How to use Mystic Turbo Registry?

To use the Mysterious Turbo Registry, you can refer to examples such as loading the SDXL (10GB Docker image) or Llama-70B (85GB Docker image). The website provides benchmark tests and comparisons to demonstrate the speed improvements compared to traditional methods.