TABLE OF CONTENTS
Updated: 13 Jan 2025
NVIDIA H100 SXM On-Demand
Wishing all our Hyperstack users a wonderfully Happy New Year!
We hope you had an amazing start to 2025. After an incredible 2024, where Hyperstack Weekly Rundowns became your go-to for updates, we’re back and better. This year, expect new features, more improvements and exciting updates designed to transform how you work with cloud GPUs. So, grab your favourite snack, settle in and explore this week's updates!
What's New on Hyperstack?
With the new year comes new features for our Hyperstack users. Check out what's new this week:
Port Randomisation
Users now have the option to disable port randomisation, offering greater control and customisation for specific workloads.
VM & Volume Optimisations
As always, we're improving our core Hyperstack resources. We’ve made significant optimisations in critical areas such as error handling, billing, and state management for VMs and volumes. These changes aim to provide you with a more reliable and seamless experience across the platform.
Join Us for Our First Event of 2025
Our first event of the year is coming next week on 15th January 2025. The "DevSecOps Gathering" will be hosted at our London office with speakers Alex Tuddenham & Mischa van Kesteren.
What to Expect from this Event?
Get to hear talks that will inspire you at our DevSecOps Gathering.
-
Lightning Talk: Root Access to Raw Power: Trials of a GPUaaS Provider
Get an inside look at managing massive GPU infrastructures and balancing performance with security.
-
Main Talk: AI-Assisted Cybersecurity Learning: A Beginner’s Guide
Discover how Local LLMs can revolutionise your cybersecurity skills with technical walkthroughs.
Why Attend this Event?
Join us to gain hands-on experience with Local LLMs and discover how they can fast-track your cybersecurity knowledge. You'll also gain valuable real-world insights into the challenges and strategies of managing large-scale GPU infrastructures, perfect for anyone working in DevSecOps or high-performance computing. Plus, it's a great opportunity to network with like-minded professionals, share ideas, and enjoy food and drinks in a relaxed atmosphere.
Register Here to Secure Your Spot Today!
New Blog Posts You Can't Miss
It’s time to upskill with our latest blogs and tutorials. Check out our latest blogs on Hyperstack:
Running Meta Llama 3.1 405 B on Hyperstack:
A Step-by-Step Guide to Get Started
It's been a year since the release of Meta Llama 3.1 405B and some still haven't tried it yet. Meta's most advanced open-source large language model, featuring 405 billion parameters excels in multilingual dialogue, outperforming numerous industry benchmarks for both closed and open-source conversational AI models. Check out the latest tutorial here to deploy the Llama 3.1 405B model on Hyperstack.
NVIDIA Project DIGITS:
All You Need to Know About the Blackwell AI Supercomputer
NVIDIA released yet another breakthrough in AI “Project DIGITS”, a personal AI supercomputer powered by the state-of-the-art GB10 Grace Blackwell Superchip. Project DIGITS allows you to prototype, fine-tune and run inferences on large AI models of up to 200 billion parameters. Check out our latest blog to learn more.
5 Key Components of AI Infrastructure:
A Quick Guide to Components
A majority of businesses do acknowledge the importance of AI yet only a few manage to successfully implement it due to infrastructural challenges. To break through these barriers, we need to understand that building and deploying scalable AI solutions requires a robust infrastructure. Check out our latest blog here to explore the key components to build a robust AI infrastructure.
What is vLLM for LLM Inference:
A Quick Guide to LLM Inference
vLLM is an open-source library designed to enhance the efficiency of large language model (LLM) inference and serving. vLLM is a freely available LLM inference and serving engine that allows developers to access, modify, and contribute to its codebase. Check our latest guide here to explore more about vLLM.
Kubernetes Architecture:
The Ultimate Guide to Kubernetes
As a leading open-source container orchestration platform, Kubernetes allows organisations to run containerised applications reliably in diverse environments such as on-premises, in the cloud or hybrid. In our latest article here, we discuss everything you need to know about Kubernetes Architecture.
Hear It from Our Happy Customers 💬
Listen to the experiences of our partners who love working with us. Recently, Araar shared his experience with Hyperstack:
We'd love for you to be the next to share your success story with Hyperstack!
That’s a wrap for this edition of the Hyperstack Weekly Rundown! Stay tuned for more updates, new features and announcements as 2025 is going to be a year filled with exciting developments. Until then, don’t forget to subscribe to our newsletter below for exclusive insights and the latest scoop on AI and GPUs- delivered right to your inbox!
Missed the Previous Editions?
Catch up on everything you need to know from Hyperstack Weekly below: