Platform for simplified ML model deployment, scaling, and inference via a unified API.
What is WizModel?
WizModel is a platform designed to simplify the deployment and scaling of machine learning models. It provides a unified API for machine learning inference, enabling users to run models without the need for extensive coding. Additionally, WizModel offers tools like Cog2, which help package models into production-ready containers and automatically generate scalable API servers that handle dependencies, GPU configurations, and scaling requirements. Users can also explore and utilize thousands of existing models shared by the community.
How to use WizModel?
To use WizModel, you can either leverage existing models through its API or deploy your own models using Cog2. When deploying your own models, you need to define the environment in the `Cog.yaml` file, specify the prediction logic in the `predict.py` file, and then use Cog2 commands to build, deploy, and run the model. You can also use their AI tools to generate the `Cog.yaml` file for you. Finally, you can use Python to call the REST API and run the model in the cloud.
The core functions of WizModel
Unified machine learning inference API
Cog2 is used to package models into containers suitable for production.
Automatic API generation and expansion
Access to thousands of existing models
Billing on a second-by-second basis