Systems/GPU Programmer

November 15, 2023-Software Engineer

About Us

We have a lot of customers and profit for a startup. Your position with us is secure. We are not a lost ship, hoping to discover product-market-fit island. We are on the island. Come join us. Our GPU marketplace powers AI projects and businesses all over the world.

We are bootstrapped. Your comp includes generous equity. Equity that investors haven't yet been able to purchase. Your salary will increase as we continue to launch new products, hit milestones and grow.

The journey to our destiny will not be easy. Our goal is not the safe harbor of today. You will be taxed, and you will be pushed. We love to work. We can't help it; we are witnessing the birth of AGI.

All technical roles report to Jake Cannell, the CEO and founder. Jake is a prolific writer and thinker on the subject of AI. Two examples from Less Wrong: LOVE in a simbox is all you need (09/28/2022) and The Brain as a Universal Learning Machine (06/24/2015).

We are currently a remote first company. Our headquarters are in Los Angeles.

About the Role

As a systems/GPU programmer you will play a crucial role in developing new matrix multiplication kernels and algorithms that can improve inference for AI models. You will help develop new high performance tensor libraries and auto optimization tools. Working closely with the technical CEO and founder, you will co-design GPU kernels and model architecture to enhance the performance and efficiency of our AI systems. Your ability to research and stay on top of cutting edge papers will be vital in staying up-to-date with the latest advancements in AI model inference and GPU programming techniques.

Example Projects

  • Implement new high performance sparse matrix multiplication kernels
  • Create highly parallel GPU code graph translation and optimization systems
  • Develop or extend parallel generic GPU libraries for approximate sorting, k-max, hashtables, etc
  • Help design and deploy new market based resource management systems for our host daemon
  • Quickly investigate and summarize options for new system architectures

You are:

  • Deeply comfortable in C++, template meta-programming, CUDA, GPGPU, linux
  • Capable and willing to quickly investigate and learn new frameworks and tools
  • A fan of occasional remote pair programming
  • Passionate about pushing the envelope in neural network performance and tooling
  • Excited about the potential of AI

Benefits:

  • Work from anywhere
  • Generous compensation, equity, and benefits
  • Join early into a fast growing, ambitious startup
  • Opportunity to grow into other technical or management roles

Apply by sending a resume/cv intro email to jobs@vast.ai

  • Contact
  • Get in Touch