Repository fails: rhel-7-server-rpms

Keep trying to get satellite installed, and it just keeps eventually failing. Even with retries=0 set in yum.conf which should just keep retrying forever. (According to the man)

I watch as yum tries to download things from the rhel-7-server-rpms repo, and it just gets slower and slow until I get Errno 14 curl#56 - "TCP connection reset by peer"

EDIT: Eventually it just gives up completely and says one of the configured repositories (The RHEL-7-Server on) failed, and tells me to disable it. I kinda need that to setup my Satellite though so....

What the heck is going on with the rhel-7-server-rpms repo?