RHAIIS: Running nvidia-smi command using podman command is failing with error.

Solution Verified - Updated -

Issue

  • nvidia-smi command failing when running using podman command.
# podman run --rm -it --security-opt=label=disable --device nvidia.com/gpu=all nvcr.io/nvidia/cuda:12.4.1-base-ubi9 nvidia-smi
Trying to pull nvcr.io/nvidia/cuda:12.4.1-base-ubi9...
Getting image source signatures
Copying blob 9d63f91420d1 done   | 
Copying blob 179428f5acc5 done   | 
Copying blob 1153e061da4e done   | 
Copying blob 0c5b8a057cc7 done   | 
Copying blob 8f6600363965 done   | 
Copying blob 39150e63d9d9 done   | 
Copying config 3c259000df done   | 
Writing manifest to image destination
Error: setting up CDI devices: failed to inject devices: failed to stat CDI host device "/dev/nvidia-uvm": no such file or directory

Environment

  • RHEL AI Inference Server 3.x

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content