Account Settings

Referral Program

A guide for being a semi-professional or professional host on vast.ai

Show User

Show IP Addresses

Get Subaccount

Create Subaccount

Reset API Key

Transfer Credit

Overview

Architecture

Pyworker Introduction

Pyworker Hello World Guide

Pyworker Hello Autoscaler Guide

Pyworker Backends

Pyworker Extension Guide

Route Endpoint

Worker Status Endpoint

Performance Tracking

Debugging

Billing

Overview & Quickstart

CLI Command Reference

Copy Data

Cancel Copy

Search Interface

Rental Types

Reserved Instance Discounts

Launch Modes

How to config templates for Vast.ai instances

Docker repository (registry) authentication

Templates

Docker Execution Environment

SSH/SCP

Jupyter

Data Movement

Cloud Sync

A gradio web UI for running Large Language Models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA.

Oobabooga (LLM webui)

Stable Diffusion is very powerful and you can run it on Vast instances

Stable Diffusion

1) Select the docker image &amp; config options

4) Download the modified DD notebook as a .ipynb file

7) Changing settings and downloading images

Disco Diffusion

How to connect a Vast instance to Google Colab using their "local runtime" feature and port forwarding.

Google Colab

Windows SSH/SCP Guide

A service for automatically managing a group of instances to serve client requests

3) Create an Autoscaling group (autogroup)

Call /route endpoint on autoscaler server

the following fields would be sent from the client to the proxy server

Autoscaler

Hosting

Get Machines

Schedule Maintenance

List Machine

Unlist Machine

Get Instances

Create Instances

Update Instances

Destroy Instances

Reboot Instance

Request Logs

Execute Command

Change Bid Price

Get Machine Earnings

Get Invoices

Set Minimum Bid

Set Default Job

Remove Default Job

Introduction

QuickStart

What operating systems are provided? Windows?

Are vast.ai interruptible instances the same as AWS spot or GCE interruptible?

What happens when my interruptible instance loses the bid?

How can I restart my programs once the instance restarts?

How can I stop the instance from within the instance?

How can I open an identity port map like 32001:32001 where external:internal are the same?

I'm getting very slow transfer speeds using the jupyter download/upload?

What is this HTTPS website unsecure warning?

I'm deleting files in Juypter but it's not freeing disk space! How do I truly delete?

I'm getting some missing library or package error?

How can I more easily download many files?

Jupyter is ok, but can I run colab directly with a vast instance?

How do I connect to an SSH instance on linux/mac?

How do I connect to an SSH instance from windows?

What is this tmux thing? How do I create multiple bash terminals on my ssh instance?

How do you protect my data from other clients?

How do you protect my data from providers?

Can you bill my card automatically so I don't have to add credit in advance?

I didn't enable debit-mode - what are these automatic charges to my card?

Why should I trust vast.ai with my credit card info?

Do you support PayPal? What about cryptocurrency?

How do I upload/download to/from my instance?

How do I upload/download to/from my instance - using scp?

How do I upload/download to/from my instance - using scp with a direct connection?

I'm getting a ConnectionResetError downloading files?

How can I download a Kaggle dataset using wget?

All my instances keep stopping, switching to inactive status, even though I didn't press the stop button. What's going on?

I keep getting this error: spend_rate_limit. What's going on?

I tried to connect with ssh and it asked for a password. What is the password?

I stopped my instance, and now when I try to restart it the status is stuck on \"scheduling\". What is wrong?

Do you support payout in any crypto-currencies?

What happens if I turn off my machine or just lose internet during a compute job?

What security measures protect my machine and my network?

Will guests be able to determine my IP address?

Someone is renting my machine for less than my price, what's happening?

What will the stability of earnings be like?

What operating systems are supported for hosting?

What are the hardware requirements for hosting?

What kind of hardware works best for Deep Learning?

Overview

Guides

GPU Instances

CLI

Account

Billing

Hosting

Instances

Accounts

Machines

Hosts

Data

Search

Autoscaler