Instructlab: Python module llama-cpp-python installation is failing

Solution Verified - Updated -

Issue

  • Instructlab: Python module llama-cpp-python installation is failing with error.
# pip install llama-cpp-python

Building wheels for collected packages: llama-cpp-python
  Building wheel for llama-cpp-python (pyproject.toml) ... error
  error: subprocess-exited-with-error

  × Building wheel for llama-cpp-python (pyproject.toml) did not run successfully.
  │ exit code: 1
  ╰─> [16 lines of output]
      *** scikit-build-core 0.10.7 using CMake 3.31.1 (wheel)
      *** Configuring CMake...
      loading initial cache file /tmp/tmpkiw1idv4/build/CMakeInit.txt
      CMake Error at /tmp/pip-build-env-ymjsa7w9/normal/lib64/python3.11/site-packages/cmake/data/share/cmake-3.31/Modules/CMakeDetermineCCompiler.cmake:49 (message):
        Could not find compiler set in environment variable CC:

        gcc.
      Call Stack (most recent call first):
        CMakeLists.txt:3 (project)


      CMake Error: CMAKE_C_COMPILER not set, after EnableLanguage
      CMake Error: CMAKE_CXX_COMPILER not set, after EnableLanguage
      -- Configuring incomplete, errors occurred!

      *** CMake configuration failed
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for llama-cpp-python
Failed to build llama-cpp-python
ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (llama-cpp-python)

Environment

  • Instructlab
  • pip

Subscriber exclusive content

A Red Hat subscription provides unlimited access to our knowledgebase, tools, and much more.

Current Customers and Partners

Log in for full access

Log In

New to Red Hat?

Learn more about Red Hat subscriptions

Using a Red Hat product through a public cloud?

How to access this content