Commit graph

17 commits

Author SHA1 Message Date
Pradyumna Singh Rathore
d010ea70d2
Fixed Cuda Dockerfile
Previously models produced garbage output when running on GPU with layers offloaded.

Similar to related fix on another repo: 331326a0e3
2023-08-10 20:41:34 +05:30
Ihsan Soydemir
3e77eea7ec
Fix OpenBLAS Docker build
Current build produces the following:
`RuntimeError: Failed to load shared library '/usr/local/lib/python3.11/site-packages/llama_cpp/libllama.so': /usr/local/lib/python3.11/site-packages/llama_cpp/libllama.so: undefined symbol: cblas_sgemm`
2023-07-27 19:44:15 +02:00
Andrei Betlen
99f064e681 docker: Add libopenblas to simple image 2023-07-09 01:36:39 -04:00
Andrei Betlen
52753b77f5 Upgrade fastapi to 0.100.0 and pydantic v2 2023-07-07 21:38:46 -04:00
Andrei Betlen
ca11673061 Add universal docker image 2023-07-07 03:38:51 -04:00
Gary Mulder
30d32e996b More README.md corrections and cleanup 2023-06-02 11:08:59 +00:00
Gary Mulder
d4eef735d9 Fixed .gitignore to ignore any downloaded model .bin files. Cleaned up README.md again 2023-06-02 11:03:19 +00:00
Gary Mulder
f24e7a7e52 Updated instructions 2023-06-02 10:44:52 +00:00
Gary Mulder
cf4931a400 Working Open Llama 3B in a box 2023-06-02 08:48:54 +00:00
Gary Mulder
217d78320f Added paramterised search and d/l for Hugging Face. Updated README.md 2023-05-31 16:00:31 +00:00
Gary Mulder
483b6ba53a Updated README.md instructions on how to use *_simple/Dockerfiles 2023-05-31 15:16:32 +00:00
Gary Mulder
0e0c9bb978 Merge branch 'auto-docker' of github.com:gjmulder/llama-cpp-python-gary into auto-docker 2023-05-25 11:50:34 +00:00
Gary Mulder
0d2cc21202 Fixed repeated imports 2023-05-25 11:50:02 +00:00
Gary Mulder
ec44bdad61
Update README.md 2023-05-23 20:50:39 +01:00
Gary Mulder
ed19071ef8 Renamed and moved old Dockerfiles 2023-05-23 19:38:37 +00:00
Gary Mulder
70f629a72f
Update README.md 2023-05-23 20:36:21 +01:00
Gary Mulder
eaff7a8678 Initial commit of auto docker 2023-05-23 19:26:40 +00:00