Can I remove pixman and libXfont?

I just ran Retina on my RHEL 6 servers and in the results, they pointed to vulnerabilities with pixman 0.26.2 and libXfont 1.4.5. The report says that I should upgrade to pixman 0.32.0 or higher, and libXfont 1.4.7 or higher. Actually, it's the same thing for OpenSSH (5.3 to 6.2 or newer). I have the latest that Red Hat has. Since I have no GUI on my servers, just plain text on the console, do I need pixman and libXfont? Can I remove those two packages?

Thanks!