GPU Cloud Deployment Without Leaving Your IDE — Audry Hsu, RunPod

TL;DR

• 1

  Flash turns a Python function into a GPU endpoint: Audrey shows RunPod's Flash SDK wrapping an async Python function with a decorator so the GPU-heavy part runs in the cloud while the rest stays local.

• 2

  The pitch is speed of iteration, not just cheap compute: Instead of commit, push to GitHub, build Docker, pull from a registry, and provision a GPU every time, Flash hot-reloads file changes straight from the IDE.

• 3

  RunPod has grown fast from a Reddit post to real scale: The company started in 2022 after founders Zennin and Pradeep repurposed spare crypto-mining GPUs, and Audrey says it now spans 30-plus data centers in 10 countries with $120 million ARR.

• 4

  The live demo makes the case with model swapping in real time: Stable Diffusion XL Turbo produces ugly “abstract cats” for a London sky prompt, then Audrey comments out the code and switches to DreamShaper for a clearly better image.

• 5

  Serverless is positioned for bursty, large-scale inference: Audrey explains that pods give you reserved GPUs, while serverless adds autoscaling and charges by request duration, with an H100 example priced at 0.00116 cents per second.

• 6

  The bigger win is orchestration across models: Her final pipeline uses Qwen 3 to rewrite prompts, DreamShaper to generate images, and Nano Banana 2 to compose founder photos, showing Flash as a tool for stitching together multi-step AI workflows.