Cannot create pods with runpodctl for specific GPUs but works on GUI

[hrdkbhatnagar]

I am trying to create a pod with a specific GPU type (example: NVIDIA H100 NVL) from the command line like this:

runpodctl create pod --gpuType "NVIDIA H100 NVL" --imageName "libeanim/standard-eval:runpod_121"
But I am getting an error
Error: There are no longer any instances available with the requested specifications. Please refresh and try again.

But if I do the same from the runpod website for the exact GPU, it works completely fine without any issues.

This issue doesnt arise, when i do this for other GPUs (example A30)

runpodctl create pod --gpuType "NVIDIA A30" --imageName "libeanim/standard-eval:runpod_121"
This works fine. Seems to be a bug

[JJMN22]

Could this be related to availability? I also run into this same problem with the MI300x GPU, the NVIDIA L4, and H100 PCIe, all of which are listed as low availability on runpod.

[hrdkbhatnagar]

I tried to debug this, somehow the Python SDK for this works (exact same GPU). I am not sure why this is case that runpodctl doesnt work but the Python API does.

For example. if I do this, it works:

runpod.create_pod(
            name=...,
            image_name=...
            gpu_type_id="NVIDIA H100 NVL",
            docker_args=docker_command,
        )...

[e-p-armstrong]

@hrdkbhatnagar Not experienced with the language, but I was doing some global searches for GPU types and found this list in tomlBuilder.go, maybe this has to do with why some gpu types work and others don't? Because the others aren't defined?

uuid = "%s"
base_image = "runpod/base:0.6.1-cuda%s"
gpu_types = [
    "NVIDIA GeForce RTX 4080",  # 16GB
    "NVIDIA RTX A4000",         # 16GB
    "NVIDIA RTX A4500",         # 20GB
    "NVIDIA RTX A5000",         # 24GB
    "NVIDIA GeForce RTX 3090",  # 24GB
    "NVIDIA GeForce RTX 4090",  # 24GB
    "NVIDIA RTX A6000",         # 48GB
    "NVIDIA A100 80GB PCIe",    # 80GB
]
gpu_count = 1
volume_mount_path = "/runpod-volume"
ports = "4040/http, 7270/http, 22/tcp" # FileBrowser, FastAPI, SSH
container_disk_size_gb = 100