Vast.ai is excited to announce that our GPUs can now be seamlessly rented through SkyPilot, an open-source framework that automates AI, LLM, and batch job execution across multiple clouds. This integration makes it easy to access Vast.ai's low-cost, high-performance GPUs while SkyPilot handles provisioning, scaling, and cost optimization.

Whether you're training deep learning models, fine-tuning LLMs, or running large-scale batch jobs, this partnership provides an efficient and cost-effective solution for developers everywhere.

Why This Integration Matters

Running large-scale AI workloads can be expensive and resource-intensive, especially as GPU availability fluctuates across providers. With Vast.ai's extensive GPU supply and SkyPilot's intelligent cloud orchestration, you can enjoy streamlined access to affordable, on-demand compute resources.

SkyPilot automatically selects the most cost-effective and available infrastructure, provisioning GPUs across multiple providers – including Vast.ai – to ensure seamless execution of AI and batch jobs at scale. As the market leader in low-cost cloud GPU rental, Vast.ai will often be the best option here!

We're thrilled to be partnering with SkyPilot and becoming part of its "sky" network. To understand why this integration is so powerful, let's take a closer look at what SkyPilot is all about.

What Is SkyPilot?

Put simply, SkyPilot is a powerful framework for managing cloud workloads in a way that abstracts away infrastructure complexity. It was developed in the UC Berkeley lab that proposed the concept of "sky computing," which is aimed at making multiple cloud providers function as a single compute pool.

With SkyPilot, you can run AI models and batch jobs across numerous cloud and Kubernetes environments. This enables you to focus on running workloads efficiently and not worry about infrastructure management.

Along with the new Vast.ai integration, SkyPilot has introduced some major updates with its release of v0.8 – including improvements to managed jobs and Kubernetes support, faster GPU provisioning, and adding ready-to-use LLM recipes.

Vast.ai's Role

As we've covered, you can now easily access and manage GPU resources on Vast.ai through SkyPilot. Vast.ai provides a vast supply of cost-effective GPU compute, while SkyPilot automates the selection and provisioning process to match your workload needs – allowing you to run 2000+ concurrent jobs and scale efficiently.

With Vast.ai's extensive GPU marketplace, you get reliable, affordable compute on demand. SkyPilot enhances this by simplifying deployment, ensuring a seamless experience while maximizing access and failover protection.

Getting Started with Vast.ai on SkyPilot

Follow these steps to start using Vast.ai with SkyPilot:

1. To configure Vast access, go to the Account page on your Vast console to get your API key. Then, run:

pip install "vastai-sdk>=0.1.12"
echo "\<your_api_key_here>" > ~/.vast_api_key

Vast.ai and SkyPilot: An Ongoing Partnership

Vast.ai is committed to ongoing collaboration with SkyPilot. Our shared mission is to help developers navigate cloud resource challenges and access compute power more affordably and efficiently. We're excited about what this integration means for developers and look forward to helping make it easier and more cost-effective to run LLMs, AI, and batch jobs anywhere, anytime.

Special thanks to the SkyPilot team for making this integration possible!