Vast.ai Highlights: 2024 Round-Up

As we set sail on 2024, we'd like to take a moment to reflect on what's been a landmark year for Vast.ai. From expanding our hardware offerings to improving user experience across the board, we've achieved significant progress in making GPU compute more accessible and efficient for everyone.

Let's take a look back at the highlights of the past year!

Q1: Setting the Foundation

We kicked off January by introducing our Teams feature, allowing multiple users to manage a single account with customizable roles and permissions. Along with OAuth support for Google and GitHub, this has made account management more flexible and secure than ever.

February brought exciting news for those working with different architectures – we added support for GH200 as well as ARM64 platforms, including the Grace Hopper superchip.

In March, we began beta hosting support for AMD GPUs. We also introduced @Vasti, the Discord bot that is trained on our documentation and can answer questions when it's tagged in a channel or contacted via direct message.

Q2: Expanding Horizons

May marked a significant expansion in our hardware offerings with the addition of both Radeon and Instinct product lines from AMD. Combined with the existing array of NVIDIA machines available for rent on our marketplace, this update gave users even more options to find exactly the right GPU for their needs.

In June, we eliminated hosting fees entirely. Instead, we transitioned to a more flexible internal surcharge model, making our platform more attractive for hosts while keeping the renter experience unchanged.

Q3: Powering Innovation

July saw the addition of the H100 NVL to our GPU lineup. This NVIDIA powerhouse, designed specifically for large language model (LLM) deployment, expands the possibilities for both hosts and renters – and its addition represents our commitment to supporting cutting-edge AI development.

In August, we were proud to sponsor NextEpoch 2024, contributing both prizes and GPU computing power to support workshop participants as they explored the intersection of machine learning and biological research.

In September, we added to our website resources with the release of a guide on serving Infinity Embeddings. (It can be found in the Docs section of our website, along with many other guides and resources with valuable insights for our users.)

Q4: Looking to the Future

As we entered the final quarter, October brought the beta release of virtual machine (VM) support running on Kernel Virtual Machine, giving hosts more flexibility in their setups. Later in the year, we rolled out the official update: Vast now offers full VMs alongside Docker-based instance rentals. This offering is designed to support larger customers and more diverse workflows via GPU remote desktop.

Rounding out the year, we added NVIDIA's H200 GPUs to our listings in November, ensuring that our platform remains a go-to destination for users seeking cutting-edge hardware.

Looking back, we're proud of how far Vast.ai has come over the past year. Whether you're a host or a renter, a small startup or an established enterprise, we've worked hard to make our platform better serve your needs.

As we move into 2025, we're excited about what's next! Thank you for being part of our journey this year.