Not 100% sure what you've tried, but perhaps your docker image only has CUDA runtime installed and not CUDA development files? You could try adding a build step using one of Nvidia's "devel" docker ...
Hey guys I'm trying to install PrivateGPT on WSL but I'm getting this errors. Any ideas? Command used: CMAKE_ARGS='-DLLAMA_CUBLAS=on' poetry run pip install --force-reinstall --no-cache-dir ...
A critical security flaw has been disclosed in the llama_cpp_python Python package that could be exploited by threat actors to achieve arbitrary code execution. Tracked as CVE-2024-34359 (CVSS score: ...