Commit graph

23 commits

Author SHA1 Message Date
Andrei Betlen
ac47d55577 Merge branch 'main' into v0.2-wip 2023-08-25 15:45:22 -04:00
Andrei Betlen
cf405f6764 Merge branch 'main' into v0.2-wip 2023-08-24 00:30:51 -04:00
Andrei
876f39d751
Merge pull request #564 from Isydmr/main
Docker improvements
2023-08-17 23:21:27 -04:00
Pradyumna Singh Rathore
d010ea70d2
Fixed Cuda Dockerfile
Previously models produced garbage output when running on GPU with layers offloaded.

Similar to related fix on another repo: 331326a0e3
2023-08-10 20:41:34 +05:30
Ihsan Soydemir
a5bc57e279
Update README.md 2023-08-03 16:49:45 +02:00
Ihsan Soydemir
cdab73536b
Docker improvements 2023-08-03 16:36:50 +02:00
Ihsan Soydemir
3e77eea7ec
Fix OpenBLAS Docker build
Current build produces the following:
`RuntimeError: Failed to load shared library '/usr/local/lib/python3.11/site-packages/llama_cpp/libllama.so': /usr/local/lib/python3.11/site-packages/llama_cpp/libllama.so: undefined symbol: cblas_sgemm`
2023-07-27 19:44:15 +02:00
Andrei Betlen
6cb77a20c6 Migrate to scikit-build-core. Closes #489 2023-07-18 18:52:29 -04:00
Andrei Betlen
99f064e681 docker: Add libopenblas to simple image 2023-07-09 01:36:39 -04:00
Andrei Betlen
52753b77f5 Upgrade fastapi to 0.100.0 and pydantic v2 2023-07-07 21:38:46 -04:00
Andrei Betlen
ca11673061 Add universal docker image 2023-07-07 03:38:51 -04:00
Gary Mulder
30d32e996b More README.md corrections and cleanup 2023-06-02 11:08:59 +00:00
Gary Mulder
d4eef735d9 Fixed .gitignore to ignore any downloaded model .bin files. Cleaned up README.md again 2023-06-02 11:03:19 +00:00
Gary Mulder
f24e7a7e52 Updated instructions 2023-06-02 10:44:52 +00:00
Gary Mulder
cf4931a400 Working Open Llama 3B in a box 2023-06-02 08:48:54 +00:00
Gary Mulder
217d78320f Added paramterised search and d/l for Hugging Face. Updated README.md 2023-05-31 16:00:31 +00:00
Gary Mulder
483b6ba53a Updated README.md instructions on how to use *_simple/Dockerfiles 2023-05-31 15:16:32 +00:00
Gary Mulder
0e0c9bb978 Merge branch 'auto-docker' of github.com:gjmulder/llama-cpp-python-gary into auto-docker 2023-05-25 11:50:34 +00:00
Gary Mulder
0d2cc21202 Fixed repeated imports 2023-05-25 11:50:02 +00:00
Gary Mulder
ec44bdad61
Update README.md 2023-05-23 20:50:39 +01:00
Gary Mulder
ed19071ef8 Renamed and moved old Dockerfiles 2023-05-23 19:38:37 +00:00
Gary Mulder
70f629a72f
Update README.md 2023-05-23 20:36:21 +01:00
Gary Mulder
eaff7a8678 Initial commit of auto docker 2023-05-23 19:26:40 +00:00