CUDA installation not working

Hello,

I did
sudo dnf config-manager --add-repo http://developer.download.nvidia.com/compute/cuda/repos/rhel8/x86_64/cuda-rhel8.repo

and
sudo dnf install cuda

to install NVIDIA Cuda

this gave me nvcc in /usr/bin but no libs & includes in /usr/local/cuda-11.

So, I also did
sudo dnf install cuda-toolkit-11-1

after that, I could compile Cuda code but when I run it I get the error:

forward compatibility was attempted on non supported HW

I have an RTX-4000 GPU (which I can see in nvidia-settings) and the same code runs fine on other computers .. what is wrong with my CUDA setup on RHEL?