August 2024 Update from Vast.ai

Welcome back to another monthly update from the team here at Vast.ai!

As the leading marketplace for affordable GPU rental, we're committed to not only maintaining our platform but also enhancing the ease of use and performance that our customers have come to appreciate.

To keep things running smoothly, we tackle bugs as quickly as possible. Below are some of the latest bug fixes we've made since our last update:

• Billing page now properly shows negative balance and failed payments.
• Added Teams support for hosts.
• Cloud rsync now creates destination drives instead of failing.
• Instance-to-instance copy now supports a progress bar and has better error handling.
• Fixed bug that prevented hosts from stopping their own instances.
• Autoscaler now delays stopping instances that are still working on tasks.
• Fixed issue that was causing Autoscaler to get stale search results.

Cloud GPU Rental Platform Updates

At Vast.ai, we're always looking for ways to improve your experience. Beyond the usual maintenance, we've rolled out some updates this month that enhance our platform's performance and flexibility. Here are some highlights of the latest improvements:

• Launched a new machine page and bulk edit feature.
• PCIe lanes are now displayed on the machine view.
• Added automatic soft blacklisting to search based on a user's personal machine-reporting history.
• Search backend now supports continent options just like the front end.
• Added GPU power/temperature limits to offers and search (ALI/CPI only for now).
• Added a new batch version of stop/start instances to manage multiple instances within rate limits.
• Created a new Blender template and guide, as well as a new Axolotl fine-tuning template.
• Added a recommended template for Stable Diffusion Fooocus.

…And much more! Check out the full August 2024 change log below.

If you have any questions or need assistance with any aspect of our platform, we’re here to help! Whether you’re a new user or a seasoned pro, feel free to reach out through the chatbox at the bottom right, email us at support@vast.ai, or join our active Discord community for support and resources. We’d be delighted to assist you in getting the most out of Vast!

Change Log

Features:

• New machine page and bulk edit feature.
• Added automatic soft blacklisting to search based on user's personal report machine history.
• Search backend now supports continent options like the front end.
• CLI/API logs command now supports a grep option.
• Added GPU power/temp limits to offers & search (ALI/CPI only for now).
• Added CLI/API option to fetch system logs (useful for debugging custom image issues, copy/sync commands, etc.).
• Improved handling of failed Docker commands with retry and feedback to webserver to reduce zombie instances blocking GPUs.
• Added a new batch version of stop/start instances to manage multiple instances at once within rate limits.
• Added Daemon logs as an option to view on instance cards (next to existing instance logs).
• Added a loading spinner for recommended templates as the web UI starts.
• Added recommended template for Stable Diffusion Fooocus.
• Added optimization for rsync & rcopy when copying many small files.
• PCIe lanes displayed on machine view.

Bug Fixes:

• Warning when copying a public template.
• Transfers now show properly on the billing page.
• Autobilling threshold fixed for team accounts.
• GPU occupancy now shows for unlisted machines.
• GPU option search query filter works.
• Open button for auth instances.
• Reserved pricing coherent display.
• Billing page properly shows negative balance and failed payments.
• Cloud rsync now creates destination drives instead of failing.
• Fixed env parsing bug in create_instance using template_hash.
• Added Autoscaler tag option for templates.
• Miscellaneous UX/UI improvements.
• Added Teams support for hosts.
• Instance-to-instance copy now supports progress bar, better error handling.
• Autoscaler now delays stopping instances that are still working on tasks.
• Fixed issue that was causing Autoscaler to get stale search results.
• Offline display & machine list toggle.
• Bw_nvlink added to machines.
• Cloud Connections can now be deleted properly on Cloud Page.
• Fixed Kohya recommended template.
• Fixed bug preventing hosts from stopping their own instances.
• Fixed inconsistent core counts for certain AMD Epyc CPUs.
• Daemon speed test fix: servers that timeout are now discarded.
• Fixed issue where cloud copy commands sometimes used incorrect paths.

Miscellaneous Tasks:

• Added billing reminders.
• Removed obsolete error messages.
• Added Llama3 TGI example & guide.
• Created new Blender template and guide.
• Created new Axolotl fine-tuning template.
• Updated most of our recommended templates to use TLS & auth for open ports.
• Updated versions, tags, and readmes for recommended templates.

Stay tuned for more updates from Vast.ai!