
# Vast.ai September Updates

It's that time again! We're back with the latest updates here at **Vast.ai**, aimed at bringing you the best possible GPU rental platform experience. This month, we've rolled out numerous template updates as well as added a [new guide](https://vast.ai/docs/use-cases/10-serving-infinity) to our Docs on serving Infinity Embeddings.

As always, addressing bugs is one of our top priorities to ensure seamless performance. Here are some of the latest bug fixes our team has implemented since our last update:

- **Cloud copy** no longer sends wrong parameters.
- **UI login** when CAPTCHA is incorrect should now delete cache/cookies.
- **Billing page** now loads correctly (previously had issues on some browsers).
- Fixed an issue where the **templates page** sometimes rendered before Recommended templates were loaded.

## NVIDIA Cloud GPU Updates

With each update here at Vast.ai, we're focused on improving both the flexibility and capabilities of our platform. It's our hope that these updates will streamline your experience and help maximize your productivity on Vast. Below are some highlights of the latest changes we've made:

- A new guide for [serving Infinity Embeddings](https://vast.ai/article/serving-vllm-embeddings-on-vast-ai) has been added to the Docs section of our website.
- Added separate **8x** and **8x+ GPU #** filters.
- New **GUI & CLI** to change the template of an existing contract (within constraints), then destroy and recreate.
- New **CLI/API** for audit logs of important user commands (create, destroy, etc.) with `user_id`, `timestamp`, `IP`, etc.
- Added new **ComfyUI + FLUX.1** template, **Stable Diffusion WebUI Forge** template, and **Ollama** template.
- Updated **PyTorch** to the most recent compatible version.

For your convenience, you can check out the full changelog for our **September 2024** product updates at the bottom of this page.

## Our Commitment

Our goal at **Vast.ai** is to provide an exceptional and affordable cloud GPU rental service for both renters and hosts. Whether you're beginning a new project or fine-tuning current ones, we're here to support you throughout the entire process. Feel free to reach out any time through the chatbox at the bottom right, send us an email at [support@vast.ai](mailto:support@vast.ai), or join our **Discord server** for ongoing support and resources!

---

## Change Log

### Features:

- Added separate **8x** and **8x+ GPU #** filters.
- New **GUI & CLI** to change the template of existing contracts (within constraints), then destroy and recreate.
- New **CLI/API** for audit logs of important user commands (create, destroy, etc.) with `user_id`, `timestamp`, `IP`, etc.

### Templates / Miscellaneous:

- Added [guide](https://vast.ai/docs/use-cases/10-serving-infinity) for **serving Infinity Embeddings** to the Docs section on the website.
- Updated **PyTorch** to the most recent compatible version.
- Added new **ComfyUI + FLUX.1** template.
- Updated **A1111** template for TLS compatibility.
- Updated **Fooocus** template for TLS.
- Updated **TGI** template (TLS/Auth).
- Updated **Kohya's GUI** template (TLS/Auth).
- Added **Stable Diffusion WebUI Forge** template.
- Added **Ollama** template.

### Bug Fixes:

- Fixed an issue where the **templates page** sometimes rendered before Recommended templates were loaded.
- **UI login** when CAPTCHA is incorrect should now delete cache/cookies.
- **Cloud copy** no longer sends wrong parameters.
- **Billing page** now loads correctly (previously had issues on some browsers).


Discover the latest features and updates from Vast.ai.

September 2024 Product Update


# November 2024 Product Update

Another month, another product update! Here at **Vast.ai**, our GPU rental platform continues to prove that accessing compute power for cutting-edge research and machine learning doesn't have to break the bank – we're committed to delivering top-notch performance while keeping costs affordable.

## NVIDIA H200 GPUs Now Available

One of the exciting updates this month is that **NVIDIA H200 GPUs** are now listed on Vast! These industry-leading GPUs offer unprecedented performance, giving you even more options for your computing needs.

---

## Bug Fixes and Performance Improvements

As always, we've prioritized resolving bugs and fine-tuning performance since our last update. Here are some of the latest fixes we've made:

- Fixed issues with virtual machines (VMs) beta related to SSH keys, memory limits, and port reuse.
- Resolved issues with new template search and editor UI.
- Fixed address displayed on downloaded invoice.
- SSH buttons now always display when an instance is running.
- Fixed GPU bandwidth reporting error.
- Fixed potential vulnerability with instances.

---

## NVIDIA Cloud GPU Updates

At Vast.ai, product updates go beyond bug fixes – we're always looking for ways to enhance usability and performance. Whether you're a long-time user or just getting started, these changes are designed to make your experience smoother and more efficient.

### Highlights of the latest enhancements:
- **NVIDIA H200s** (as mentioned) are now listed on Vast.
- Continued VM beta rollout.
- Added direct link button to Jupyter terminal (for Jupyter-enabled instances).
- Updated numerous templates:
  - Whisper ASR
  - PyTorch NGC
  - ROCm Ubuntu
  - Oobabooga
  - NVIDIA CUDA
  - And more.
- Added **Fooocus API template**.

You can find the full list of this month's updates in the **October 2024 change log** at the bottom of the page.

---

## Our Commitment

Here at **Vast.ai**, our mission is to provide an accessible, efficient GPU rental platform that's well suited to the unique needs of both users and hosts. Whether you're launching a new project or fine-tuning a long-term deployment, we're here to support you every step of the way.

**Have questions?** Reach out to us at [support@vast.ai](mailto:support@vast.ai), or join the conversation on our [Discord server](https://discord.gg/vastai) to connect with fellow users and find helpful resources.

---

## Change Log

### Features:
- **NVIDIA H200s** are now listed.
- Continued VM beta rollout.
- Added direct link button to Jupyter terminal (for Jupyter-enabled instances).

### Templates / Miscellaneous:
- Added **Fooocus API template**.
- Updated **Whisper ASR template**.
- Updated **PyTorch NGC template**.
- Updated **NVIDIA RAPIDS template**.
- Updated **ROCm Ubuntu template**.
- Updated **Oobabooga template**.
- Updated **PyTorch (ROCm) template**.
- Updated **NVIDIA CUDA template**.
- Updated **PyTorch (cuDNN Devel) template**.
- Updated **PyTorch (cuDNN Runtime) template**.

### Bug Fixes:
- Fixed issues with VMs beta related to SSH keys, memory limits, and port reuse.
- Fixed issues with new template search and editor UI.
- Fixed address displayed on downloaded invoice.
- SSH buttons now always display when an instance is running.
- Fixed GPU bandwidth reporting error.
- Fixed host verification display issue.
- Fixed potential vulnerability with instances.


November 2024 Product Update


# October 2024 Product Update

Welcome back to another update from the Vast.ai team! Our commitment to excellence means we're always looking for ways to improve your experience. We understand how critical reliable, affordable computing resources are to our customers.

So let's get into the nitty-gritty details of our latest improvements! Here are some of the key bug fixes we've made since our last update:

- **Improved** Billing page display and performance.
- **Fixed** Sentry integration.
- **Added** clearing of cookies/cache after user fails CAPTCHA.
- **Fixed** Search page rent request progress display.
- **Made improvements to** Autoscaler.
- **Fixed** new Templates page performance and issue with saving credentials on Docker login.

## NVIDIA Cloud GPU Updates

Product development is at the heart of what we do. This month we've focused on delivering meaningful improvements that make your experience on Vast even more powerful and intuitive. Our goal is always to give you more control, flexibility, and value with every update.

### Highlights of the latest enhancements:
- **Added** virtual machine (VM) beta for VMs running on Kernel Virtual Machine (KVM) as an optional feature for hosts (see [Docs page for VMs](#)).
- **New Template editor** and listing UXs (opt-in).
- **Added** host call to force delete a machine.
- **Improved** machine maintenance descriptions.
- **Added** info to Docs for machine tiers (datacenter, verified, and deverified).
- **Expanded** Dark Mode support.

For a full list of all changes this month, check out the change log for our October 2024 product updates at the bottom of this page.

---

## Our Commitment

At Vast.ai, we're passionate about delivering a seamless, budget-friendly cloud GPU rental experience that caters to the diverse needs of both renters and hosts. We're committed to being your reliable partner from project inception to completion.

Need assistance? Feel free to drop us a line anytime at [support@vast.ai](mailto:support@vast.ai), or connect with the community on our [Discord server](#) where help and resources are always at your fingertips!

---

## Change Log

### Features:
- **Added** virtual machine (VM) beta.
- **New Template editor UX** (opt-in).
- **New Template listing UX** (opt-in).
- **Added** Host call to force delete a machine.
- **Expanded** Dark Mode support.
- **Improved** machine maintenance descriptions.

### Templates / Miscellaneous:
- **Updated** A1111 template.
- **Updated** PyTorch (cuDNN Runtime) template.
- **Added** SD WebUI Forge template.
- **Docs** for VMs.
- **Added** Ollama template.
- **Updated** Kohya’s GUI template.
- **Updated** TGI template (TLS/Auth).
- **Docs** for template creation.
- **Docs** for machine tiers (datacenter, verified, deverified).
- **Improved** Docs for Autoscaler.

### Bug Fixes:
- **Fixed** Billing page display and performance.
- **Fixed** Sentry integration.
- **Fixed** referral link template selection.
- **Fixed** Search page rent request progress display.
- **Fixed** template change on instances.
- **Fixed** auto-billing issue with empty threshold.
- **Added** clearing of cookies/cache after user fails CAPTCHA.
- **Fixed** new Templates page performance and Docker login credential saving.
- **Autoscaler** improvements.


October 2024 Product Update


In the complex landscape of data center operations, understanding and adhering to various compliance standards is crucial. This article will explore the differences and similarities between Tier 2/3 data center classifications and compliance standards like HIPAA and ISO 27001, providing insights for businesses navigating these regulations.

# Understanding Data Center Tiers

Data centers are classified into four tiers by the Uptime Institute, based on their uptime and redundancy levels. Tier 2 and Tier 3 data centers are particularly relevant for growing businesses and large organizations.

Tier 2 Data Centers offer a single path for power and cooling but include some redundant and backup components. They promise an uptime of 99.741% per year, translating to up to 22 hours of downtime annually​​.

Tier 3 Data Centers provide multiple paths for power and cooling, with redundant systems that allow maintenance without downtime. They boast an uptime of 99.982% per year, equating to less than 1.6 hours of downtime annually​​.

These tiers offer a balance between performance, reliability, and cost, making them suitable for businesses that require consistent uptime without the need for the extensive redundancies of Tier 4.

## Compliance Standards: HIPAA and ISO 27001

Compliance standards like HIPAA and ISO 27001 are essential for data centers, especially those handling sensitive information.

HIPAA (Health Insurance Portability and Accountability Act) is a U.S. legislation focused on protecting sensitive patient information managed by healthcare organizations. It requires entities to implement physical, administrative, and technical safeguards for Protected Health Information (PHI), which can be supported by the infrastructure and redundancy offered by Tier 2 and Tier 3 facilities​​.

ISO 27001 is an international standard for information security management. It includes 114 controls in areas like access control, physical and environmental security, and incident management. While ISO 27001 certification does not equate to HIPAA compliance, its controls significantly overlap with HIPAA requirements​. Tier 2 and Tier 3 data centers can support ISO 27001 compliance through their security measures, operational sustainability, and staff expertise​​.

# Vast.ai's Datacenter Compliance 

Vast.ai has a network of dozens of datacenters that have ISO 27001 and TIER 2 or 3 ratings. Vast.ai has done due diligence and confirmed that these provider’s equipment is in a facility with an up to date compliance certificate.

To find Vast.ai providers, use the “Secure Cloud (Only Trusted Datacenters)” filter on the search page at https://cloud.vast.ai/create/

Vast.ai secure cloud has providers with at least one of the following certifications:

- ISO 27001
- TIER 2
- TIER 3

For production services where uptime and data security are vital, use the trusted datacenter filter and look for the blue datacenter label.

# Final Thoughts

Choosing a data center that aligns with compliance needs is crucial for businesses. Tier 2 and Tier 3 data centers offer balanced and cost-effective solutions for organizations requiring consistent uptime and robust security measures. Vast.ai's secure cloud offering empowers businesses to navigate this landscape efficiently, ensuring compliance and security. As the digital landscape evolves, staying compliant and resilient remains a top priority, a challenge that Vast.ai is well-equipped to meet.


Navigating Data Center Compliance: Understanding Tier 2/3 and HIPAA/ISO 27001 Standards

Blog

September 2024 Product Update

Vast.ai September Updates

NVIDIA Cloud GPU Updates

Our Commitment

Change Log

Features:

Templates / Miscellaneous:

Bug Fixes:

Continue Reading: