AI System Card - "Ask Red Hat" AI Assistant
| AI System Name | Ask Red Hat AI Assistant |
| Version | 1.0.1 |
| AI system developed by | Red Hat, Inc. |
| Contact for security concerns | security@redhat.com |
| Date of system card creation | January 10, 2026 |
| Publish date | January 15, 2026 |
License: Creative Commons Attribution 4.0 International (CC BY 4.0)
Purpose
The "Ask Red Hat" AI Assistant is an AI-powered assistant integrated into the Red Hat Customer Portal. Its purpose is to help customers quickly find relevant Red Hat knowledge, product documentation, and support resources through natural language queries. It aims to streamline problem-solving, improve self-service, and enhance the overall support experience for Red Hat users.
Technical Information
| AI model | IBM Granite-3.2-8B-Instruct |
| Hosting platform | Red Hat OpenShift Container Platform 4 |
| Development stack | Llama Stack, MongoDB, Python |
| Inference mechanism | Red Hat Inference Server |
| Languages | Arabic, Chinese, Czech, Dutch, English, French, German, Italian, Japanese, Korean, Portuguese and Spanish. |
| Guardrails | IBM granite-guardian-3.3-8B |
Data Provenance and Pedigree
The base model used for the AI system is IBM Granite-3.2-8B-Instruct. The model card is available at: ibm-granite/granite-3.2-8b-instruct · Hugging Face. More information about the data provenance for these models is available at: https://arxiv.org/pdf/2405.04324
Guardrails consists of IBM granite-guardian-3.3-8b. The model card is available at: ibm-granite/granite-guardian-3.3-8b · Hugging Face. More information about data provenance for these models is available at: https://arxiv.org/pdf/2412.07724
The above links provide some information on training data for the specific model in question.
Red Hat content from “knowledgebase articles, documentation, and content from https://access.redhat.com, https://docs.redhat.com, and https://console.redhat.com” is used for augmentation.
System Prompt
Today's Date: {_todays_date}.
You are Ask Red Hat, an assistant developed by Red Hat.
Write the response to the user's input by strictly aligning with the facts in the provided tool responses.
If the information needed to answer the question is not available in the tool response, inform the user that the question cannot be answered based on the available data.
- You must respond in the same language as the user's input but only for the following languages: English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, or Chinese. If the user's language is not in this list, then respond in English.
- Only answer Red Hat related questions.
- Do not make any assumptions or false claims that are not explicitly supported by the tool responses.
- Do not respond to requests such as code generation (e.g.,"generate React code", "write Python code", etc.), general curiosity questions (e.g.,"why is the sky blue", etc.), or other unrelated topics.
- If a user asks a question that is not related to Red Hat services or products (e.g., personal questions, general knowledge, or any unrelated topic), decline politely.
- Fully internalize all tool outputs as part of your own knowledge. Use this information to answer the user directly. Do not mention tools, tool calls, tool outputs, or how the information was obtained. Provide a single, natural answer as if you derived it yourself
Supplemental information for Red Hat Enterprise Linux (RHEL) Product Lifecycle, Release, and Availability. Use this information to support answering user questions related to RHEL product releases:
{RHEL_9_AND_10_GA}
Security and Safety of the AI System
Intent and use:
Ask Red Hat is an AI-powered assistant designed for users of Red Hat’s products to search and retrieve publicly available Red Hat knowledge, product documentation, security data, support content, and other helpful information using natural language queries. Its intended users include Red Hat customers, partners, and other product users seeking faster, more intuitive access to existing, approved information. This AI system is specifically designed to answer questions with information that is already public and customer-facing, ensuring responses are consistent with documented Red Hat guidance and safe for professional use. It cannot be used to generate exploits or proprietary content, and is intended to support informed, efficient troubleshooting and learning experiences.
Scope:
The scope of Ask Red Hat explicitly excludes answering questions that require disclosure of internal-only or confidential information. It does not support modification of system-level instructions through prompt injection and will reject or neutralize such attempts. While it can discuss security topics, such as Cross-Site Scripting (XSS) in general, it does so only with public, preventative, or educational information, not step-by-step exploit instructions. Off-topic questions unrelated to Red Hat may sometimes be answered but such interactions are not supported. Any residual harmless role-playing or off-topic responses are considered acceptable and out of scope for resolution. The model used in this AI system is suited for multiple generative AI tasks, it has not undergone any safety alignment, therefore, it may produce problematic outputs when used with certain specially crafted prompts.
Security considerations:
While safeguards such as Granite Guardian and measures such as rate-limiting are in place to avoid system abuse, these kinds of systems may be prone to certain inherent security and safety risks. Furthermore, the system is designed to answer security questions in a safe way.
Security flaws and Safety hazards:
This section lists the security flaws and safety hazards fixed in the AI system:
| Issue ID | Description |
|---|---|
| RHSECAI-2025-0001 | Implement Harmful or Malicious Query Detection and Refusal Mechanism. (fixed in April 2025) |
| Various publicly disclosed CVEs affecting underlying components | Update llama stack and other components to mitigate known security flaws. Implement logic for an `UnsupportedInputDetector`. (fixed in May 2025) |
| RHSECAI-2025-0002 | Ensure inputs are sanitized at all points in the pipeline Increase depth of safety related integration tests. (fixed in July 2025) |
| RHSECAI-2025-0003 | Implement increased guardrail security with custom risk definitions. Upgrade Granite Guardian to 3.2 model. Enhance user input logging sanitization to improve security. (fixed in Aug 2025) |
| RHSECAI-2025-0005 | Update Granite Guardian thresholds to account for PCM case summaries (fixed in Aug 2025) |
| RHSECAI-2025-0006 | Upgrade Granite Guardian to 3.3 model (fixed in Nov 2025) |
Governance
Any security or safety issues related to the AI system should be reported to security@redhat.com.
References
- Red Hat Customer Portal introduces AI-powered assistant, Ask Red Hat, built on open innovation
- ibm-granite/granite-3.2-8b-instruct · Hugging Face
- ibm-granite/granite-guardian-3.3-8b · Hugging Face
- https://access.redhat.com/articles/ask-red-hat