
Ongoing product updates are an important part of what we offer at Vast.ai. Our customers get excellent performance and reliability in large part because of the consistency with which we work to improve our service. As a Vast.ai customer, you can not only expect to get outstanding NVIDIA GPU cloud performance on day one, but you can expect that experience to continue to improve over time.

The starting point for every product update is to address any bugs that have popped up along the way. Our latest update is no different, including the fixes listed below --

- Ensuring all instances show on instance page
- Correct port allocation that caused instances to fail to start
- Improve disk speed test rates
- Solve error on 4090s causing NVLINK to show erroneously
- Fix billing page error that showed ratelimit error
- Disable extra filters with the show incompatible filter

If you are an existing user, you will notice that these fixes streamline your experience and make the product more enjoyable to use day after day. For potential new customers, you can rest assured that these fixes were made promptly and the save level of service will be delivered on future corrections that need to be made.

## NVIDIA Cloud GPU Fixes

Fixes are one thing, but we also utilize updates to deliver added capabilities and flexibility to the platform. Here are some of the highlights --

- The Juypter open button will run a test to confirm it is running before displaying
- Updated the mobile UX to improve info bar issues
- GUI filter settings now persist
- Hosts receive email notifications of expired machines
- Add ability to delete templates from recent tab
- Added 4080 and 4070 search filter
- Added function for hosts to disconnect Stripe connect for payouts

To confirm the many features and capabilities offered by Vast.ai, you are welcome to view our full documentation, or you can simply reach out directly to our team for more information. You can chat with us directly here on our site, where we will respond quickly and clear up any confusion you may have about what we offer. We also offer a Discord server that you can join to learn more, or you can drop us a message at support@vast.ai. Either way, we would be happy to assist you with your GPU rental needs.

## Change Log

-bugfix with the instance page to ensure all instances show

-bugfix with port allocation causing instances failing to start

-bugfix on the slow rate of disk speed tests

-bugfix on 4090s causing NVLINK to erroneously show

-bugfix on the billing page which sometimes showed a ratelimit error

-bugfix with the show incompatible filter to disable extra filters

-total instances cost per hour/day meter added in the billing page

-Juypter open button now tests to ensure Juypter is running before displaying

-Filters can be passed into the create page via URL

-Updated the mobile UX to fix login/user infobar issues

-Added the ability for hosts to disconnect Stripe connect for payouts

-Added a new recommended template for Bittensor 3.7.0 with readme (edited)

-Relisting offers will only extend the end date of existing contracts when the new price is the same or less

-CLI command to cancel rsync added

-Added ability to delete templates from recent tab

-Added the ability to create a readme file for templates

-Docs updated to reflect template system

-GUI filter settings now persist

-Hosts now receive email notification of expired machines

-Added 4080 and 4070 to search filter (edited)


Ongoing product updates are an important part of what we offer at Vast.ai...

Vast Product Update | April 2023


Cloud GPU rental services are becoming increasingly popular in the past few years for those who want to train deep learning models. Deep learning is a subset of machine learning that utilizes neural networks with multiple layers to analyze and process data. It has been a rapidly growing field in recent years, with many breakthroughs and advancements in the areas of image recognition, natural language processing, and self-driving cars.

Renting GPUs for training can be more cost-effective than purchasing them outright. It also gives users the ability to access the latest and greatest hardware. With cloud-based solutions, organizations can easily access these new GPUs without having to go through the process of purchasing and installing new hardware.

## GPUs for Deep Learning

Deep learning models, such as neural networks, are composed of many layers of interconnected nodes, or neurons. Each neuron performs a simple mathematical operation, such as a dot product or an activation function, on its input data. However, when these operations are applied to millions of neurons across many layers, the computational requirements become extremely large.

This is where GPUs come in. They are specifically designed to perform massive amounts of parallel computation, making them well suited for deep learning tasks. In contrast, traditional CPUs (Central Processing Units) are not optimized for parallel computation and are not able to keep up with the computational demands of deep learning models.

Another reason why GPUs are used for deep learning is that they can be used to perform both the training and the inference of deep learning models. The training process of a deep learning model requires a large amount of data and computational power. This is because the model needs to adjust the values of its parameters, or weights, to minimize the difference between the predicted outputs and the actual outputs. Inference, on the other hand, is the process of applying the trained model to new data. This also requires a significant amount of computational power.

As deep learning models continue to become more complex and data-intensive, the use of GPUs will likely become even more prevalent in the field.

## Choosing a Deep Learning GPU provider

There are a number of cloud GPU rental services available. Some of the most popular cloud GPU rental providers include Amazon Web Services (AWS), Google Cloud Platform (GCP), and Microsoft Azure. Each cloud provider's GPU cloud instances have different performance and cost characteristics, so it's important to do your research to find the best instance for your deep learning application.

Vast.ai is a decentralized compute marketplace that allows users to rent cloud GPUs at much lower prices when compared to major providers. The company utilizes a peer-to-peer network of individual and corporate GPU owners to provide users with access to powerful GPU resources at a fraction of the cost of traditional cloud providers. Hosts are both semi-professional and professional datacenters.

No matter which cloud provider you choose, cloud GPUs are ideal for running large-scale deep learning applications such as computer vision, natural language processing (NLP), and machine learning algorithms. You can also use cloud GPUs to build and test deep learning models in less time than with traditional CPUs.

## Choosing the Right GPUs for Deep Learning

When choosing a cloud GPU rental service, it is important to consider the needs of your deep learning applications when you pick a particular GPU, such as an A100, A6000 or RTX 4090. Factors to consider include the size of your training dataset, the number of epochs you need to train your model, the training time for each epoch, and the computational and memory resources required.

Based on these factors, you can compare the prices of different cloud GPU providers and choose the one that best suits your needs.

## Reduce Expenses for Large Datasets and Faster Training

The expense of cloud GPU rental services can differ depending on the company and the particular instance type being utilized. In general, though, renting GPUs from the cloud is much more reasonably priced than purchasing them outright - especially when you take into account all of the other benefits that come with using a cloud service.

If you're training deep learning models and are looking for a cost-effective way to do so, cloud GPU rental services are definitely worth considering. The cost of consumer-grade GPUs makes purchasing them less than stellar.

Cloud providers offer reliable and powerful cloud GPU instances that can help you reduce expenses for large datasets and faster training. With cloud GPU rental services, you can focus on building better models without breaking the bank, and access the best GPUs right away.

So cloud GPUs are the way to go if you have large datasets and need faster training times. Cloud GPU rental services can provide the necessary computing resources without breaking the bank.


GPU prices continue to increase, but there exists a happy and unexpected middle ground for AI applications.

High-Performance Deep Learning with Cloud GPUs


Renting cloud GPUs and buying GPUs are two different options for individuals and organizations that need access to powerful graphics processing units (GPUs) for tasks such as machine learning and data analysis. Both options have their own advantages and disadvantages and the choice between them will depend on the specific needs and budget of the user.

Companies, universities, researchers, and home users alike have started to rent a GPU or entire GPU servers for deep learning and neural networks. Renting GPUs has quickly become the preferred option by many people who need access to powerful GPU cards without the long-term commitment or expense that comes with buying them outright.

## Cost advantages to renting a GPU for machine learning

Let's face it: the price of GPUs is high. A single GPU can range in price from a few hundred dollars to upwards of $10,000.

But, they're incredibly necessary for complex tasks that require high performance and reliability, like image rendering, data science, and blockchain processing on a large scale. Renting a GPU takes that anxiety off the table and prevents people from making costly mistakes (and experiencing buyer's remorse). To make matters worse, a GPU's value doesn't increase in value over time. As a rule of thumb, people can expect a [GPU to lose about 15% of its value relative to the MSRP on the used market each year](https://www.techspot.com/article/2107-your-graphics-card-worth/).

This also offers you a great deal of flexibility. You can start and stop at any time, and when a new GPU comes out, you don't have to replace all your old hardware - just rent the next GPU in the technology tree. You can scale your configuration up and down as needed, add memory and performance to your technology stack, and

## Flexible, short-term infrastructure needs

First and foremost, renting a GPU allows you to rent high-performance GPU hardware for short periods of time, allowing you to rent and test different GPUs without the long-term commitment of a purchase. This is ideal for those who may only need the GPU for a small project or experiment. Users can choose the GPU that best suits their needs and easily scale up or down as needed. Additionally, cloud GPU providers often include additional features such as easy data transfer and remote access.

By choosing to rent, it becomes possible for someone to find the GPU that is best-suited for their particular project. Think of renting as a matchmaking service between the project you're working on or dreaming about and the tech you need to bring it to life.

## Get powerful GPU servers for much less

Renting cloud GPUs and buying GPUs are two different options for individuals and organizations that need access to powerful graphics processing units (GPUs) for tasks such as machine learning and data analysis. Both options have their own advantages and disadvantages and the choice between them will depend on the specific needs and budget of the user.

Companies, universities, researchers, and home users alike have started to rent a GPU or entire GPU servers for deep learning and neural networks. Renting GPUs has quickly become the preferred option by those who need access to powerful GPU cards without the long-term commitment or expense that comes with buying them outright.

## Cost advantages to renting a GPU for machine learning

Let's face it: the price of GPUs is high. A single GPU can range in price from a few hundred dollars to upwards of $10,000.

But, they're incredibly necessary for complex tasks that require high performance and reliability, like image rendering, data science, and blockchain processing on a large scale. Renting a GPU takes that anxiety off the table and prevents people from making costly mistakes (and experiencing buyer's remorse). To make matters worse, a GPU's value doesn't increase in value over time. As a rule of thumb, people can expect a [GPU to lose about 15% of its value relative to the MSRP on the used market each year](https://www.techspot.com/article/2107-your-graphics-card-worth/).

This also offers you a great deal of flexibility. You can start and stop at any time, and when a new GPU comes out, you don't have to replace all your old hardware - just rent the next GPU in the technology tree. You can scale your configuration up and down as needed, add memory and performance to your technology stack, and

## Flexible, short-term infrastructure needs

First and foremost, renting a GPU allows you to rent high-performance GPU hardware for short periods of time, allowing you to rent and test different GPUs without the long-term commitment of a purchase. This is ideal for those who may only need the GPU for a small project or experiment. Users can choose the GPU that suits their needs and easily scale up or down as needed. Additionally, cloud GPU providers often include additional features such as easy data transfer and remote access.

By choosing to rent, it becomes possible for someone to find the GPU that is best suited for their particular project. Think of renting as a matchmaking service between the project you're working on or dreaming about and the tech you need to bring it to life.

## Get powerful GPU servers for much less

Additionally, this allows you to rent more powerful GPUs than you can afford to buy. This also gives users the ability to rent GPUs with unique characteristics that may not be available for purchase, such as special processor configurations or multiple cards in one system. Any future updates can be added, enabling you to keep up with the latest trends and new technology, without having to re-sell the old hardware to buy anew.

## Minimize upfront costs

Finally, renting GPUs is much more cost-effective than buying a GPU outright. Not only do you avoid the upfront expense of purchasing GPU hardware, but you also avoid the ongoing costs of maintenance, depreciation, and energy consumption that come with owning a GPU.

GPUs enable computers to process many pieces of data at once, making them invaluable for people who are into deep learning, edit movies, mine cryptocurrencies, frequently use gaming applications, and more. For anyone who has wondered if renting or buying a GPU is best for their needs, read on to find out why renting makes the most sense.

## A high-performance computing cloud that stays relevant

Talk to anyone with an interest in electronics, whether they always want the latest phone, music equipment, or power tool, and they will all say the same thing: "something bigger and better is always right around the corner."

Not to worry when renting, with technology changing quickly, topics like maintenance, upgrades, and new product launches aren't even in your vocabulary. Leave it to someone else--you have access to the latest and greatest at your fingertips!

## Future-proof your systems

Just like with any major purchase, trying to buy something complicated with limited knowledge can turn a purchase into a risky gamble. Renting a GPU will save you tons of time on research. Rather than spending hours reading product reviews and bouncing around to different sites, renting makes your life easy. The company you rent from has done all of the work and condensed hundreds of articles into easy-to-digest information, allowing you to make your selections with a few clicks of a mouse. Now, that's an easy button!

From houses and cars to parking spaces, RVs and tools, the option to rent has become more and more popular. And why wouldn't it -- it takes away the stress and financial implications of owning. Renting a GPU is the smartest way to get access to the resources you need at a lower cost.

## About Vast.ai

Vast.ai is a decentralized compute marketplace that allows users to rent cloud GPUs at much lower prices than major cloud providers like Amazon Web Services (AWS), Google Cloud, and Microsoft Azure. The company utilizes a peer-to-peer network of individual GPU owners to provide users with access to powerful GPU resources at a fraction of the cost of traditional cloud providers. Additionally, this allows you to rent more powerful GPUs than you can afford to buy. This also gives users the ability to rent GPUs with unique characteristics that may not be available for purchase, such as special processor configurations or multiple cards in one system. Any future updates can be added, enabling you to keep up with the latest trends and new technology, without having to re-sell the old hardware to buy anew.

## Minimize upfront costs

Finally, renting GPUs is much more cost-effective than buying a GPU outright. Not only do you avoid the upfront expense of purchasing GPU hardware, but you also avoid the ongoing costs of maintenance, depreciation, and energy consumption that come with owning a GPU.

GPUs enable computers to process many pieces of data at once, making them invaluable for people who are into deep learning, edit movies, mine cryptocurrencies, frequently use gaming applications, and more. For anyone who has wondered if renting or buying a GPU is best for their needs, read on to find out why renting makes the most sense.

## A high-performance computing cloud that stays relevant

Talk to anyone with an interest in electronics, whether they always want the latest phone, music equipment, or power tool, and they will all say the same thing: "something bigger and better is always right around the corner."

Not to worry when renting -- with technology changing quickly, topics like maintenance, upgrades, and new product launches aren't even in your vocabulary. Leave it to someone else--you have access to the latest and greatest at your fingertips!

## Future-proof your systems

Just like with any major purchase, trying to buy something complicated with limited knowledge can turn a purchase into a risky gamble. Renting a GPU will save you tons of time on research. Rather than spending hours reading product reviews and bouncing around to different sites, renting makes your life easy. The company you rent from has done all of the work and condensed hundreds of articles into easy-to-digest information, allowing you to make your selections with a few clicks of a mouse. Now, that's an easy button!

From houses and cars to parking spaces, RVs and tools, the option to rent has become more and more popular. And why wouldn't it -- it takes away the stress and financial implications of owning. Renting a GPU is the smartest way to get access to the resources you need at a lower cost.

## About Vast.ai

Vast.ai is a decentralized compute marketplace that allows users to rent cloud GPUs at much lower prices than major cloud providers like Amazon Web Services (AWS), Google Cloud, and Microsoft Azure. The company utilizes a peer-to-peer network of individual GPU owners to provide users with access to powerful GPU resources at a fraction of the cost of traditional cloud providers.


Blog

Vast Product Update | April 2023

High-Performance Deep Learning with Cloud GPUs

Why Renting GPUs Makes More Sense Than Buying