
# November 2024 Product Update

Another month, another product update! Here at **Vast.ai**, our GPU rental platform continues to prove that accessing compute power for cutting-edge research and machine learning doesn't have to break the bank – we're committed to delivering top-notch performance while keeping costs affordable.

## NVIDIA H200 GPUs Now Available

One of the exciting updates this month is that **NVIDIA H200 GPUs** are now listed on Vast! These industry-leading GPUs offer unprecedented performance, giving you even more options for your computing needs.

---

## Bug Fixes and Performance Improvements

As always, we've prioritized resolving bugs and fine-tuning performance since our last update. Here are some of the latest fixes we've made:

- Fixed issues with virtual machines (VMs) beta related to SSH keys, memory limits, and port reuse.
- Resolved issues with new template search and editor UI.
- Fixed address displayed on downloaded invoice.
- SSH buttons now always display when an instance is running.
- Fixed GPU bandwidth reporting error.
- Fixed potential vulnerability with instances.

---

## NVIDIA Cloud GPU Updates

At Vast.ai, product updates go beyond bug fixes – we're always looking for ways to enhance usability and performance. Whether you're a long-time user or just getting started, these changes are designed to make your experience smoother and more efficient.

### Highlights of the latest enhancements:
- **NVIDIA H200s** (as mentioned) are now listed on Vast.
- Continued VM beta rollout.
- Added direct link button to Jupyter terminal (for Jupyter-enabled instances).
- Updated numerous templates:
  - Whisper ASR
  - PyTorch NGC
  - ROCm Ubuntu
  - Oobabooga
  - NVIDIA CUDA
  - And more.
- Added **Fooocus API template**.

You can find the full list of this month's updates in the **October 2024 change log** at the bottom of the page.

---

## Our Commitment

Here at **Vast.ai**, our mission is to provide an accessible, efficient GPU rental platform that's well suited to the unique needs of both users and hosts. Whether you're launching a new project or fine-tuning a long-term deployment, we're here to support you every step of the way.

**Have questions?** Reach out to us at [support@vast.ai](mailto:support@vast.ai), or join the conversation on our [Discord server](https://discord.gg/vastai) to connect with fellow users and find helpful resources.

---

## Change Log

### Features:
- **NVIDIA H200s** are now listed.
- Continued VM beta rollout.
- Added direct link button to Jupyter terminal (for Jupyter-enabled instances).

### Templates / Miscellaneous:
- Added **Fooocus API template**.
- Updated **Whisper ASR template**.
- Updated **PyTorch NGC template**.
- Updated **NVIDIA RAPIDS template**.
- Updated **ROCm Ubuntu template**.
- Updated **Oobabooga template**.
- Updated **PyTorch (ROCm) template**.
- Updated **NVIDIA CUDA template**.
- Updated **PyTorch (cuDNN Devel) template**.
- Updated **PyTorch (cuDNN Runtime) template**.

### Bug Fixes:
- Fixed issues with VMs beta related to SSH keys, memory limits, and port reuse.
- Fixed issues with new template search and editor UI.
- Fixed address displayed on downloaded invoice.
- SSH buttons now always display when an instance is running.
- Fixed GPU bandwidth reporting error.
- Fixed host verification display issue.
- Fixed potential vulnerability with instances.


November 2024 Product Update


# October 2024 Product Update

Welcome back to another update from the Vast.ai team! Our commitment to excellence means we're always looking for ways to improve your experience. We understand how critical reliable, affordable computing resources are to our customers.

So let's get into the nitty-gritty details of our latest improvements! Here are some of the key bug fixes we've made since our last update:

- **Improved** Billing page display and performance.
- **Fixed** Sentry integration.
- **Added** clearing of cookies/cache after user fails CAPTCHA.
- **Fixed** Search page rent request progress display.
- **Made improvements to** Autoscaler.
- **Fixed** new Templates page performance and issue with saving credentials on Docker login.

## NVIDIA Cloud GPU Updates

Product development is at the heart of what we do. This month we've focused on delivering meaningful improvements that make your experience on Vast even more powerful and intuitive. Our goal is always to give you more control, flexibility, and value with every update.

### Highlights of the latest enhancements:
- **Added** virtual machine (VM) beta for VMs running on Kernel Virtual Machine (KVM) as an optional feature for hosts (see [Docs page for VMs](#)).
- **New Template editor** and listing UXs (opt-in).
- **Added** host call to force delete a machine.
- **Improved** machine maintenance descriptions.
- **Added** info to Docs for machine tiers (datacenter, verified, and deverified).
- **Expanded** Dark Mode support.

For a full list of all changes this month, check out the change log for our October 2024 product updates at the bottom of this page.

---

## Our Commitment

At Vast.ai, we're passionate about delivering a seamless, budget-friendly cloud GPU rental experience that caters to the diverse needs of both renters and hosts. We're committed to being your reliable partner from project inception to completion.

Need assistance? Feel free to drop us a line anytime at [support@vast.ai](mailto:support@vast.ai), or connect with the community on our [Discord server](#) where help and resources are always at your fingertips!

---

## Change Log

### Features:
- **Added** virtual machine (VM) beta.
- **New Template editor UX** (opt-in).
- **New Template listing UX** (opt-in).
- **Added** Host call to force delete a machine.
- **Expanded** Dark Mode support.
- **Improved** machine maintenance descriptions.

### Templates / Miscellaneous:
- **Updated** A1111 template.
- **Updated** PyTorch (cuDNN Runtime) template.
- **Added** SD WebUI Forge template.
- **Docs** for VMs.
- **Added** Ollama template.
- **Updated** Kohya’s GUI template.
- **Updated** TGI template (TLS/Auth).
- **Docs** for template creation.
- **Docs** for machine tiers (datacenter, verified, deverified).
- **Improved** Docs for Autoscaler.

### Bug Fixes:
- **Fixed** Billing page display and performance.
- **Fixed** Sentry integration.
- **Fixed** referral link template selection.
- **Fixed** Search page rent request progress display.
- **Fixed** template change on instances.
- **Fixed** auto-billing issue with empty threshold.
- **Added** clearing of cookies/cache after user fails CAPTCHA.
- **Fixed** new Templates page performance and Docker login credential saving.
- **Autoscaler** improvements.


October 2024 Product Update


# Vast.ai September Updates

It's that time again! We're back with the latest updates here at **Vast.ai**, aimed at bringing you the best possible GPU rental platform experience. This month, we've rolled out numerous template updates as well as added a [new guide](https://vast.ai/docs/use-cases/10-serving-infinity) to our Docs on serving Infinity Embeddings.

As always, addressing bugs is one of our top priorities to ensure seamless performance. Here are some of the latest bug fixes our team has implemented since our last update:

- **Cloud copy** no longer sends wrong parameters.
- **UI login** when CAPTCHA is incorrect should now delete cache/cookies.
- **Billing page** now loads correctly (previously had issues on some browsers).
- Fixed an issue where the **templates page** sometimes rendered before Recommended templates were loaded.

## NVIDIA Cloud GPU Updates

With each update here at Vast.ai, we're focused on improving both the flexibility and capabilities of our platform. It's our hope that these updates will streamline your experience and help maximize your productivity on Vast. Below are some highlights of the latest changes we've made:

- A new guide for [serving Infinity Embeddings](https://vast.ai/article/serving-vllm-embeddings-on-vast-ai) has been added to the Docs section of our website.
- Added separate **8x** and **8x+ GPU #** filters.
- New **GUI & CLI** to change the template of an existing contract (within constraints), then destroy and recreate.
- New **CLI/API** for audit logs of important user commands (create, destroy, etc.) with `user_id`, `timestamp`, `IP`, etc.
- Added new **ComfyUI + FLUX.1** template, **Stable Diffusion WebUI Forge** template, and **Ollama** template.
- Updated **PyTorch** to the most recent compatible version.

For your convenience, you can check out the full changelog for our **September 2024** product updates at the bottom of this page.

## Our Commitment

Our goal at **Vast.ai** is to provide an exceptional and affordable cloud GPU rental service for both renters and hosts. Whether you're beginning a new project or fine-tuning current ones, we're here to support you throughout the entire process. Feel free to reach out any time through the chatbox at the bottom right, send us an email at [support@vast.ai](mailto:support@vast.ai), or join our **Discord server** for ongoing support and resources!

---

## Change Log

### Features:

- Added separate **8x** and **8x+ GPU #** filters.
- New **GUI & CLI** to change the template of existing contracts (within constraints), then destroy and recreate.
- New **CLI/API** for audit logs of important user commands (create, destroy, etc.) with `user_id`, `timestamp`, `IP`, etc.

### Templates / Miscellaneous:

- Added [guide](https://vast.ai/docs/use-cases/10-serving-infinity) for **serving Infinity Embeddings** to the Docs section on the website.
- Updated **PyTorch** to the most recent compatible version.
- Added new **ComfyUI + FLUX.1** template.
- Updated **A1111** template for TLS compatibility.
- Updated **Fooocus** template for TLS.
- Updated **TGI** template (TLS/Auth).
- Updated **Kohya's GUI** template (TLS/Auth).
- Added **Stable Diffusion WebUI Forge** template.
- Added **Ollama** template.

### Bug Fixes:

- Fixed an issue where the **templates page** sometimes rendered before Recommended templates were loaded.
- **UI login** when CAPTCHA is incorrect should now delete cache/cookies.
- **Cloud copy** no longer sends wrong parameters.
- **Billing page** now loads correctly (previously had issues on some browsers).


Discover the latest features and updates from Vast.ai.

September 2024 Product Update


In the complex landscape of data center operations, understanding and adhering to various compliance standards is crucial. This article will explore the differences and similarities between Tier 2/3 data center classifications and compliance standards like HIPAA and ISO 27001, providing insights for businesses navigating these regulations.

# Understanding Data Center Tiers

Data centers are classified into four tiers by the Uptime Institute, based on their uptime and redundancy levels. Tier 2 and Tier 3 data centers are particularly relevant for growing businesses and large organizations.

Tier 2 Data Centers offer a single path for power and cooling but include some redundant and backup components. They promise an uptime of 99.741% per year, translating to up to 22 hours of downtime annually​​.

Tier 3 Data Centers provide multiple paths for power and cooling, with redundant systems that allow maintenance without downtime. They boast an uptime of 99.982% per year, equating to less than 1.6 hours of downtime annually​​.

These tiers offer a balance between performance, reliability, and cost, making them suitable for businesses that require consistent uptime without the need for the extensive redundancies of Tier 4.

## Compliance Standards: HIPAA and ISO 27001

Compliance standards like HIPAA and ISO 27001 are essential for data centers, especially those handling sensitive information.

HIPAA (Health Insurance Portability and Accountability Act) is a U.S. legislation focused on protecting sensitive patient information managed by healthcare organizations. It requires entities to implement physical, administrative, and technical safeguards for Protected Health Information (PHI), which can be supported by the infrastructure and redundancy offered by Tier 2 and Tier 3 facilities​​.

ISO 27001 is an international standard for information security management. It includes 114 controls in areas like access control, physical and environmental security, and incident management. While ISO 27001 certification does not equate to HIPAA compliance, its controls significantly overlap with HIPAA requirements​. Tier 2 and Tier 3 data centers can support ISO 27001 compliance through their security measures, operational sustainability, and staff expertise​​.

# Vast.ai's Datacenter Compliance 

Vast.ai has a network of dozens of datacenters that have ISO 27001 and TIER 2 or 3 ratings. Vast.ai has done due diligence and confirmed that these provider’s equipment is in a facility with an up to date compliance certificate.

To find Vast.ai providers, use the “Secure Cloud (Only Trusted Datacenters)” filter on the search page at https://cloud.vast.ai/create/

Vast.ai secure cloud has providers with at least one of the following certifications:

- ISO 27001
- TIER 2
- TIER 3

For production services where uptime and data security are vital, use the trusted datacenter filter and look for the blue datacenter label.

# Final Thoughts

Choosing a data center that aligns with compliance needs is crucial for businesses. Tier 2 and Tier 3 data centers offer balanced and cost-effective solutions for organizations requiring consistent uptime and robust security measures. Vast.ai's secure cloud offering empowers businesses to navigate this landscape efficiently, ensuring compliance and security. As the digital landscape evolves, staying compliant and resilient remains a top priority, a challenge that Vast.ai is well-equipped to meet.


Navigating Data Center Compliance: Understanding Tier 2/3 and HIPAA/ISO 27001 Standards


As the year comes to a close, we're back one more time with the latest updates here at Vast.ai! At the moment, we're primarily working on a few major features that will be unveiled in due course – but for now, we're pleased to announce the smaller ongoing product updates that continue to make our GPU rental platform better and better over time.

First up are bug fixes. We're proud of our team's response time in getting every hiccup dealt with as quickly as possible, which ensures we're able to deliver a seamless experience for our valued customers. The following are some of our latest fixes:

- Fixed internet speedtest script for Ubuntu 23+
- All Coinbase payments now display a link to the transaction
- Fixed issues with Google Drive token expiration
- Cuda version detection is now fixed for TensorFlow
- Fixed some de-verification issues
- Template editors now accept > and <
- Fixed issues with Dropbox connections

#### NVIDIA Cloud GPU Updates

As mentioned, more changes are on the way! But in the past few weeks, we've implemented some enhancements to our platform that should make Vast even more user-friendly and intuitive for both current and new customers. Here are a few highlights of the latest updates:

- Added RTX 5000 Ada to search page
- Updated CLI documentation - https://vast.ai/docs/cli/commands
- Updated the displayed text for Docker image in the template editor
- Discount factor now visible for reserved instance discounts
- Added machine OS version filter to CLI/API
- Updated recommended templates to use AI Dock's ComfyUI template

Plus, we've updated our [Terms of Service](https://vast.ai/terms) to reflect that credits purchased via credit card cannot be used for cryptocurrency mining. The refund policy has also been clarified. And as usual, you can find the full change log for our December 2023 product updates below for your convenience.

We're proud to be the market leader in low-cost, on-demand cloud GPU rental. With Vast, you can save 5-6X on GPU compute compared to other solutions – all in one simple interface with a supportive Discord community and a responsive customer service team to answer all your questions! We'd love to chat and help you discover what Vast can do for you today. You're welcome to contact us any time via the chatbox at the bottom right or email us at [support@vast.ai](mailto:support@vast.ai). In the meantime, happy holidays!

#### Change Log

- Added RTX 5000 Ada to search page
- Schedule maintenance doesn't require a machine that is listed
- Added strong warning about copying / or /root or /root/.ssh
- Updated our docs to include using the CLI from inside an instance
- Bugfix: fixed internet speedtest script for Ubuntu 23+
- Bugfix: all Coinbase payments now display a link to the transaction
- Bugfix: host end date fix
- Bugfix: Cuda version detection fixed for TensorFlow
- Updated the displayed text for Docker image in the template editor
- Bugfix: host UI schedule maintenance UI button fixed
- Bugfix: display on billing warning message
- Bugfix: fixed some de-verification issues
- Bugfix: template editors now accept > and <
- Bugfix: in the template editor extra filters can be overwritten even if connected to the Docker repo
- Terms of Service has been updated (no mining with credits purchased via credit card; refund policy clarified)
- Reset API key now asks for confirmation
- CLI has more explicit error messages for syntax errors
- Updated CLI documentation - https://vast.ai/docs/cli/commands
- Discount factor now visible for reserved instance discounts
- Added machine OS version filter to CLI/API
- Updated destroyed instance cleanup
- Updated recommended templates to use AI Dock's ComfyUI template
- Bugfix: fixed issues with Google Drive token expiration
- Bugfix: earnings page should not allow you to see charges and payments for export
- Bugfix: kaalia: auto-detection of NVML and bad GPU errors
- Bugfix: kaalia: fix issue with update_scripts not installing on new machines
- Bugfix: fixed issues with Dropbox connections


Update

November 2024 Product Update

October 2024 Product Update

September 2024 Product Update

Navigating Data Center Compliance: Understanding Tier 2/3 and HIPAA/ISO 27001 Standards

December product updates