baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
1089 commits 1 branch 0 tags 2.1 MiB
Commit graph

69 commits

Author SHA1 Message Date
Jason Cox
40b22909dc
Update examples from ggml to gguf and add hw-accel note for Web Server (#688) 
* Examples from ggml to gguf

* Use gguf file extension

Update examples to use filenames with gguf extension (e.g. llama-model.gguf).

---------

Co-authored-by: Andrei <abetlen@gmail.com>
 2023-09-14 14:48:21 -04:00
Andrei Betlen
f4090a0bb2 Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs. 2023-09-13 23:00:43 -04:00
Andrei Betlen
8ddf63b9c7 Remove reference to FORCE_CMAKE from docs 2023-09-12 23:56:10 -04:00
Andrei Betlen
bcef9ab2d9 Update title 2023-09-12 19:02:30 -04:00
Andrei Betlen
89ae347585 Remove references to force_cmake 2023-09-12 19:02:20 -04:00
Andrei Betlen
1dd3f473c0 Remove references to FORCE_CMAKE 2023-09-12 19:01:16 -04:00
Andrei Betlen
1910793f56 Merge branch 'main' into v0.2-wip 2023-09-12 16:43:32 -04:00
Juarez Bochi
20ac434d0f
Fix low level api examples 2023-09-07 17:50:47 -04:00
Andrei Betlen
895f84f8fa Add ROCm / AMD instructions to docs 2023-08-25 17:19:23 -04:00
Andrei Betlen
ac47d55577 Merge branch 'main' into v0.2-wip 2023-08-25 15:45:22 -04:00
Andrei
915bbeacc5
Merge pull request #633 from abetlen/gguf 
GGUF (Breaking Change to Model Files)
 2023-08-25 15:13:12 -04:00
Andrei Betlen
ac37ea562b Add temporary docs for GGUF model conversion 2023-08-25 15:11:08 -04:00
Andrei Betlen
80389f71da Update README 2023-08-25 05:02:48 -04:00
Andrei Betlen
cf405f6764 Merge branch 'main' into v0.2-wip 2023-08-24 00:30:51 -04:00
Andrei
2a0844b190
Merge pull request #556 from Huge/patch-1 
Fix dev setup in README.md so that everyone can run it
 2023-08-17 23:21:45 -04:00
Mike Zeng
097fba25e5
Fixed spelling error "lowe-level API" to "low-level API" 2023-08-05 02:00:04 -05:00
Huge
60e85cbe46
Fix dev setup in README.md so that everyone can run it 2023-08-02 12:27:08 +02:00
Ihsan Soydemir
0687a3092b
Fix typo in 70B path 2023-07-25 20:49:44 +02:00
Andrei Betlen
343480364f Merge branch 'main' into v0.2-wip 2023-07-24 15:26:08 -04:00
bretello
0f09f10e8c
add support for llama2 70b 2023-07-24 19:38:24 +02:00
Andrei Betlen
0538ba1dab Merge branch 'main' into v0.2-wip 2023-07-20 19:06:26 -04:00
Andrew Duffy
b6b2071180
Update install instructions for Linux OpenBLAS 
The instructions are different than they used to be.

Source: https://github.com/ggerganov/llama.cpp#openblas
 2023-07-18 22:22:33 -04:00
Andrei Betlen
57db1f9570 Update development docs for scikit-build-core. Closes #490 2023-07-18 20:26:25 -04:00
Andrei
5eab1db0d0
Merge branch 'main' into v0.2-wip 2023-07-18 18:54:27 -04:00
Andrei Betlen
6cb77a20c6 Migrate to scikit-build-core. Closes #489 2023-07-18 18:52:29 -04:00
Carlos Tejada
b24b10effd Added info to set ENV variables in PowerShell 
- Added an example on how to set the variables `CMAKE_ARGS`
  and `FORCE_CMAKE`.
- Added a subtitle for the `Windows remarks` and `MacOS` remarks.
 2023-07-18 17:14:42 -04:00
Andrei
15e0e0a937
Merge pull request #390 from SubhranshuSharma/main 
added termux with root instructions
 2023-07-14 16:53:23 -04:00
AgentJ-WR
ea4fbadab3
Show how to adjust context window in README.md 2023-07-07 23:24:57 -04:00
Mike
c8d0647caa
Update README.md 
prevent not found errors
 2023-06-30 16:42:13 +08:00
vladkens
485eee7bef
Update README.md 
Fix installation link in readme
 2023-06-30 00:48:21 +03:00
Andrei Betlen
452929404f Updated docs link 2023-06-26 16:35:38 -04:00
SubhranshuSharma
036548365f added termux with root instructions 2023-06-17 14:50:07 +05:30
Andrei Betlen
54e2e4ffde Move metal docs to metal section of README. 2023-06-14 22:15:22 -04:00
Andrei
abf6d4a0a1
Merge pull request #367 from ianscrivener/ianscrivener-macos-install-md-docs 
Ianscrivener macos install md docs
 2023-06-14 21:48:04 -04:00
Matt Dennewitz
613dd70c8a
Update README.md 
Fixes typo in README
 2023-06-13 00:56:05 -05:00
Ian Scrivener
7ca50a3e45
Update README.md 
add link to main README>md
 2023-06-13 09:52:22 +10:00
Matt Hoffner
4eb245afd8
Update README.md 2023-06-10 15:59:26 -07:00
Andrei Betlen
447a3d249e Merge branch 'main' into setup 2023-05-26 17:53:58 -04:00
Andrei Betlen
f0812c4d8c Add upgrade instructions to the README 2023-05-19 02:20:41 -04:00
Andrei Betlen
70695c430b Move docs link up 2023-05-17 11:40:12 -04:00
Xiyou Zhou
408dd14e5b
Update README.md 
Fix typo.
 2023-05-15 14:52:25 -07:00
Anchen
3718799b37
chore: add note for Mac m1 installation 2023-05-15 20:46:59 +10:00
Andrei Betlen
684d7c8c17 Fix docker command 2023-05-11 22:12:35 -04:00
Lucas Doyle
bebe7712f7 README: better setup instructions for developers for pip and poetry 
Give folks options + explicit instructions for installing with poetry or pip.
 2023-05-09 16:04:15 -07:00
Joel Kurian
17dc51a7d2 Updated installation instructions for BLAS backends 2023-05-09 21:34:46 +05:30
Andrei Betlen
4f8cf52a38 Update README 2023-05-07 05:20:04 -04:00
Andrei Betlen
3adc8fb3ae Update README to use cli options for server 2023-05-07 05:10:52 -04:00
Andrei Betlen
397ae97f64 Update README 2023-05-07 01:41:19 -04:00
Thomas Neu
22c3056b2a
Update README.md 
added MacOS
 2023-05-05 18:40:00 +02:00
Thomas Neu
eb54e30f34
Update README.md 2023-05-05 14:22:41 +02:00