Create overview.mdx by lavanya-gunreddi · Pull Request #864 · runpod/docs

lavanya-gunreddi · 2026-09-28T17:51:04Z

No description provided.

mintlify · 2026-09-28T17:51:08Z

Preview deployment for your docs. Learn more about Mintlify Previews.

Project	Status	Preview	Updated
runpod-docs	🟢 Ready	View Preview	Oct 19, 2026, 7:07 PM

💡 Tip: Enable Automations to automatically generate PRs for you.

prestwick

Handful of suggested changes and nitpicks.

prestwick · 2026-10-09T15:07:03Z

+    In the GPU picker, find the **External compute** section. It lists the GPU types available on your organization's online machines. Select the GPU you want.
+  </Step>
+  <Step title="Configure and deploy">
+    Configure the rest of the Pod the way you normally would, including the template, storage, and environment variables. Then click **Deploy**.


Is there a doc with the workflow we reference that can be linked here?

prestwick · 2026-10-09T15:08:05Z

+
+## How placement works
+
+When you deploy on external compute, Runpod places the Pod on one of your organization's online machines that matches the GPU you selected. Pods deployed on your machines stay within your organization. Other Runpod customers can't deploy on them.


Suggested change

When you deploy on external compute, Runpod places the Pod on one of your organization's online machines that matches the GPU you selected. Pods deployed on your machines stay within your organization. Other Runpod customers can't deploy on them.

When you deploy on external compute, Runpod places the Pod on one of your organization's online machines that matches the GPU you selected. Pods deployed on your machines stay within your organization. Other Runpod customers can't deploy to them.

prestwick · 2026-10-09T15:59:32Z

+    In the Runpod console, go to **Resources → External compute** and click **Add compute**.
+  </Step>
+  <Step title="Describe the machine">
+    Select your machine type, such as an on-prem server, enter a name for the machine, and click **Next**.


In my testing there was some limitation on the hostnames we could give the machines. Our generated hostnames use underscores by default, and I had to change those to hyphens to get things working. I'm going to escalate this to Mike and Audry, but this may require some mention.

From https://man7.org/linux/man-pages/man7/hostname.7.html

Each element of the hostname must be from 1 to 63 characters long
and the entire hostname, including the dots, can be at most 253
characters long. Valid characters for hostnames are ASCII(7)
letters from a to z, the digits from 0 to 9, and the hyphen (-).
A hostname may not start nor end with a hyphen.

prestwick · 2026-10-09T16:07:20Z

+
+This page covers the most common problems when you connect and use external compute, and what to do about each.
+
+## Verification failed


There is also a "verification timed out" state. When I was testing this was because sshd wasn't listening on all interfaces and therefore ~~Nebula~~ the Runpod control plane couldn't make an SSH connection to the machine. This likely could be generalized as the machine couldn't complete the network connection to the control plane.

Added a “Verification timed out” section, written generally as Runpod not being able to reach the machine, with the sshd fix as the first step. Also added it to the status table on the setup page.

audryhsu · 2026-10-15T15:32:54Z

+
+## Requirements
+
+Runpod Hybrid Cloud is available to organizations only. The Runpod team must enable External Compute for your org account before the feature appears in your console. [Contact us](https://www.runpod.io/everywhere) to get set up.


the term 'external compute' is being debated and might be changed, fyi. TBD if it changes to 'private compute'.

audryhsu · 2026-10-15T15:33:09Z

+## How it works
+
+<Steps>
+  <Step title="Add your machine">


'machine' vs 'compute

Let's use compute. Lines up better with the planned terminology changes.

audryhsu · 2026-10-15T15:34:06Z

+  <Step title="Add your machine">
+    In the console, go to **Resources → External compute** and click **Add compute**. Select your machine type (on-prem server, AWS EC2 instance, or any cloud VM), give it a name, and click **Next**.
+  </Step>
+  <Step title="Install the host agent">


will need to align on how to refer to "host agent". i think we might refer to it as "Runpod agent" preferrably, but let's get a decision memorialized then we can mass update. @prestwick

Current recommendation is Host connector.

audryhsu · 2026-10-15T15:34:19Z

+    In the console, go to **Resources → External compute** and click **Add compute**. Select your machine type (on-prem server, AWS EC2 instance, or any cloud VM), give it a name, and click **Next**.
+  </Step>
+  <Step title="Install the host agent">
+    Copy the install command that appears and paste it into an SSH session on your machine. This installs the Runpod host agent, a small program that connects your machine to Runpod over an outbound-only encrypted connection. No inbound ports are opened. Set your public and private IPs, open the required firewall ports, then reboot. For full instructions, see [Set up external compute](/hybrid-cloud/setup).


'machine' vs 'compute'

audryhsu · 2026-10-15T15:39:30Z

+
+- An [organization](/organizations/orgs-overview) with external compute enabled. During alpha, the Runpod team enables this for you.
+- An organization role that allows you to add compute. See [Roles](/organizations/org-roles).
+- A single machine with at least one GPU. Multi-node machines connected by InfiniBand or a similar fabric aren't supported yet.


@maltmanRP you good with this language? thinking we could leave it more open ended like "talk to runpod" if they need multinode usecase.

I like this phrasing. Customer feedback on this will help with prioritization.

audryhsu · 2026-10-15T15:44:09Z

+2. Check that the machine can make outbound connections to the internet.
+3. Confirm that you rebooted the machine after you configured networking.
+
+## Machine stuck in verification in progress


fyi @prestwick it will timeout after 15 min and retry once, then if that fails again, will end in Verification failed state. don't know if we need to expose all the nitty gritty but we have sweepers and retries that will make sure these land in some terminal state after ~30 minutes.

Good to know. Maybe we state here that verification should complete within 30 minutes. Otherwise contact support.

audryhsu · 2026-10-15T15:45:06Z

+- At least one machine with the **Online** status. See [Set up external compute](/hybrid-cloud/setup).
+- Membership in the organization that owns the machine, with permission to deploy Pods. See [Roles](/organizations/org-roles).
+
+## Deploy a Pod


also supported in serverless

The completeness of the setup workflows for serverless are mixed at the moment. For example the quick deploy and deploy from hub options currently lack the External compute option.

prestwick · 2026-10-20T14:05:39Z

+| Docker disk | A dedicated disk of at least 600 GB. |
+| Disk throughput | At least 150 MB/s. |
+| Outbound network | All TCP, UDP 4242 (Runpod control plane), UDP 53 (DNS), UDP 123 (time sync), and ICMP echo. |
+| Inbound network | TCP 10000–60000. |


prestwick · 2026-10-20T14:07:32Z

+2. Check that the machine can make outbound connections to the internet.
+3. Confirm that you rebooted the machine after you configured networking.
+
+## Machine stuck in verification in progress


Good to know. Maybe we state here that verification should complete within 30 minutes. Otherwise contact support.

prestwick · 2026-10-20T14:11:34Z

+- At least one machine with the **Online** status. See [Set up external compute](/hybrid-cloud/setup).
+- Membership in the organization that owns the machine, with permission to deploy Pods. See [Roles](/organizations/org-roles).
+
+## Deploy a Pod


The completeness of the setup workflows for serverless are mixed at the moment. For example the quick deploy and deploy from hub options currently lack the External compute option.

jiayi-runpod · 2026-10-20T21:00:30Z

+
+## Get started
+
+Runpod Hybrid Cloud is available to early customers, and the Runpod team works with you directly to set up your machines. [Request a demo](https://www.runpod.io/hybrid-cloud) to get started.


Maybe nitpick, I feel this "early customers" reads a little bit wierd.

How about "Runpod Hybrid Cloud is in alpha and available to select customers, ..."?

Create overview.mdx

2f8e2a2

mintlify Bot deployed to staging September 28, 2026 17:51

View deployment

lavanya-gunreddi added 2 commits September 28, 2026 14:10

Create setup.mdx

40851fd

Create deploy.mdx

7f62029

mintlify Bot deployed to staging September 28, 2026 18:11

View deployment

Create troubleshooting.mdx

a9c8829

mintlify Bot deployed to staging September 28, 2026 18:11

View deployment

Update docs.json

20c43ac

mintlify Bot deployed to staging September 28, 2026 18:13

View deployment

prestwick requested changes Oct 9, 2026

View reviewed changes

Merge branch 'main' into lg-hybrid-cloud

42e12d5

mintlify Bot deployed to staging October 19, 2026 17:03

View deployment

Update overview.mdx

973c7e3

mintlify Bot deployed to staging October 19, 2026 18:36

View deployment

Update setup.mdx

9c2d4ab

mintlify Bot deployed to staging October 19, 2026 18:39

View deployment

Update troubleshooting.mdx

0129f46

mintlify Bot deployed to staging October 19, 2026 18:46

View deployment

Update deploy.mdx

79f6ef7

mintlify Bot deployed to staging October 19, 2026 18:48

View deployment

Merge branch 'main' into lg-hybrid-cloud

80bdc38

mintlify Bot deployed to staging October 19, 2026 19:07

View deployment

audryhsu reviewed Oct 19, 2026

View reviewed changes

prestwick approved these changes Oct 20, 2026

View reviewed changes

jiayi-runpod reviewed Oct 20, 2026

View reviewed changes


		## How placement works

		When you deploy on external compute, Runpod places the Pod on one of your organization's online machines that matches the GPU you selected. Pods deployed on your machines stay within your organization. Other Runpod customers can't deploy on them.


		This page covers the most common problems when you connect and use external compute, and what to do about each.

		## Verification failed


		## Requirements

		Runpod Hybrid Cloud is available to organizations only. The Runpod team must enable External Compute for your org account before the feature appears in your console. [Contact us](https://www.runpod.io/everywhere) to get set up.

	\| Inbound network \| TCP 10000–60000. \|
	\| Inbound network \| TCP 10000 and 20000. \|


		## Get started

		Runpod Hybrid Cloud is available to early customers, and the Runpod team works with you directly to set up your machines. [Request a demo](https://www.runpod.io/hybrid-cloud) to get started.

Conversation

lavanya-gunreddi commented Sep 28, 2026

Uh oh!

mintlify Bot commented Sep 28, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

prestwick left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

This branch was successfully deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

mintlify Bot commented Sep 28, 2026 •

edited

Loading