baalajimaestro/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
1610 commits 1 branch 0 tags 2.1 MiB
Commit graph

127 commits

Author SHA1 Message Date
Andrei Betlen
602ea64ddd docs: Fix whitespace 2023-11-22 18:09:31 -05:00
Andrei Betlen
f336eebb2f docs: fix 404 to macos installation guide. Closes #861 2023-11-22 18:07:30 -05:00
Andrei Betlen
1ff2c92720 docs: minor indentation fix 2023-11-22 18:04:18 -05:00
Andrei Betlen
68238b7883 docs: setting n_gqa is no longer required 2023-11-22 18:01:54 -05:00
Andrei Betlen
198178225c docs: Remove stale warning 2023-11-22 17:59:16 -05:00
Juraj Bednar
5a9770a56b
Improve documentation for server chat formats (#934) 2023-11-22 06:10:03 -05:00
James Braza
23a221999f
Documenting server usage (#768) 2023-11-21 00:24:22 -05:00
Sujeendran Menon
7b136bb5b1
Fix for shared library not found and compile issues in Windows (#848) 
* fix windows library dll name issue

* Updated README.md Windows instructions

* Update llama_cpp.py to handle different windows dll file versions
 2023-11-01 18:55:57 -04:00
Jason Cox
40b22909dc
Update examples from ggml to gguf and add hw-accel note for Web Server (#688) 
* Examples from ggml to gguf

* Use gguf file extension

Update examples to use filenames with gguf extension (e.g. llama-model.gguf).

---------

Co-authored-by: Andrei <abetlen@gmail.com>
 2023-09-14 14:48:21 -04:00
Andrei Betlen
f4090a0bb2 Add numa support, low level api users must now explicitly call llama_backend_init at the start of their programs. 2023-09-13 23:00:43 -04:00
Andrei Betlen
8ddf63b9c7 Remove reference to FORCE_CMAKE from docs 2023-09-12 23:56:10 -04:00
Andrei Betlen
bcef9ab2d9 Update title 2023-09-12 19:02:30 -04:00
Andrei Betlen
89ae347585 Remove references to force_cmake 2023-09-12 19:02:20 -04:00
Andrei Betlen
1dd3f473c0 Remove references to FORCE_CMAKE 2023-09-12 19:01:16 -04:00
Andrei Betlen
1910793f56 Merge branch 'main' into v0.2-wip 2023-09-12 16:43:32 -04:00
Juarez Bochi
20ac434d0f
Fix low level api examples 2023-09-07 17:50:47 -04:00
Andrei Betlen
895f84f8fa Add ROCm / AMD instructions to docs 2023-08-25 17:19:23 -04:00
Andrei Betlen
ac47d55577 Merge branch 'main' into v0.2-wip 2023-08-25 15:45:22 -04:00
Andrei
915bbeacc5
Merge pull request #633 from abetlen/gguf 
GGUF (Breaking Change to Model Files)
 2023-08-25 15:13:12 -04:00
Andrei Betlen
ac37ea562b Add temporary docs for GGUF model conversion 2023-08-25 15:11:08 -04:00
Andrei Betlen
80389f71da Update README 2023-08-25 05:02:48 -04:00
Andrei Betlen
cf405f6764 Merge branch 'main' into v0.2-wip 2023-08-24 00:30:51 -04:00
Andrei
2a0844b190
Merge pull request #556 from Huge/patch-1 
Fix dev setup in README.md so that everyone can run it
 2023-08-17 23:21:45 -04:00
Mike Zeng
097fba25e5
Fixed spelling error "lowe-level API" to "low-level API" 2023-08-05 02:00:04 -05:00
Huge
60e85cbe46
Fix dev setup in README.md so that everyone can run it 2023-08-02 12:27:08 +02:00
Ihsan Soydemir
0687a3092b
Fix typo in 70B path 2023-07-25 20:49:44 +02:00
Andrei Betlen
343480364f Merge branch 'main' into v0.2-wip 2023-07-24 15:26:08 -04:00
bretello
0f09f10e8c
add support for llama2 70b 2023-07-24 19:38:24 +02:00
Andrei Betlen
0538ba1dab Merge branch 'main' into v0.2-wip 2023-07-20 19:06:26 -04:00
Andrew Duffy
b6b2071180
Update install instructions for Linux OpenBLAS 
The instructions are different than they used to be.

Source: https://github.com/ggerganov/llama.cpp#openblas
 2023-07-18 22:22:33 -04:00
Andrei Betlen
57db1f9570 Update development docs for scikit-build-core. Closes #490 2023-07-18 20:26:25 -04:00
Andrei
5eab1db0d0
Merge branch 'main' into v0.2-wip 2023-07-18 18:54:27 -04:00
Andrei Betlen
6cb77a20c6 Migrate to scikit-build-core. Closes #489 2023-07-18 18:52:29 -04:00
Carlos Tejada
b24b10effd Added info to set ENV variables in PowerShell 
- Added an example on how to set the variables `CMAKE_ARGS`
  and `FORCE_CMAKE`.
- Added a subtitle for the `Windows remarks` and `MacOS` remarks.
 2023-07-18 17:14:42 -04:00
Andrei
15e0e0a937
Merge pull request #390 from SubhranshuSharma/main 
added termux with root instructions
 2023-07-14 16:53:23 -04:00
AgentJ-WR
ea4fbadab3
Show how to adjust context window in README.md 2023-07-07 23:24:57 -04:00
Mike
c8d0647caa
Update README.md 
prevent not found errors
 2023-06-30 16:42:13 +08:00
vladkens
485eee7bef
Update README.md 
Fix installation link in readme
 2023-06-30 00:48:21 +03:00
Andrei Betlen
452929404f Updated docs link 2023-06-26 16:35:38 -04:00
SubhranshuSharma
036548365f added termux with root instructions 2023-06-17 14:50:07 +05:30
Andrei Betlen
54e2e4ffde Move metal docs to metal section of README. 2023-06-14 22:15:22 -04:00
Andrei
abf6d4a0a1
Merge pull request #367 from ianscrivener/ianscrivener-macos-install-md-docs 
Ianscrivener macos install md docs
 2023-06-14 21:48:04 -04:00
Matt Dennewitz
613dd70c8a
Update README.md 
Fixes typo in README
 2023-06-13 00:56:05 -05:00
Ian Scrivener
7ca50a3e45
Update README.md 
add link to main README>md
 2023-06-13 09:52:22 +10:00
Matt Hoffner
4eb245afd8
Update README.md 2023-06-10 15:59:26 -07:00
Andrei Betlen
447a3d249e Merge branch 'main' into setup 2023-05-26 17:53:58 -04:00
Andrei Betlen
f0812c4d8c Add upgrade instructions to the README 2023-05-19 02:20:41 -04:00
Andrei Betlen
70695c430b Move docs link up 2023-05-17 11:40:12 -04:00
Xiyou Zhou
408dd14e5b
Update README.md 
Fix typo.
 2023-05-15 14:52:25 -07:00
Anchen
3718799b37
chore: add note for Mac m1 installation 2023-05-15 20:46:59 +10:00
Andrei Betlen
684d7c8c17 Fix docker command 2023-05-11 22:12:35 -04:00
Lucas Doyle
bebe7712f7 README: better setup instructions for developers for pip and poetry 
Give folks options + explicit instructions for installing with poetry or pip.
 2023-05-09 16:04:15 -07:00
Joel Kurian
17dc51a7d2 Updated installation instructions for BLAS backends 2023-05-09 21:34:46 +05:30
Andrei Betlen
4f8cf52a38 Update README 2023-05-07 05:20:04 -04:00
Andrei Betlen
3adc8fb3ae Update README to use cli options for server 2023-05-07 05:10:52 -04:00
Andrei Betlen
397ae97f64 Update README 2023-05-07 01:41:19 -04:00
Thomas Neu
22c3056b2a
Update README.md 
added MacOS
 2023-05-05 18:40:00 +02:00
Thomas Neu
eb54e30f34
Update README.md 2023-05-05 14:22:41 +02:00
Thomas Neu
952ba9ecaf
Update README.md 
add windows server commad
 2023-05-05 14:21:57 +02:00
Andrei
25062cecd3
Merge pull request #140 from abetlen/Niek/main 
Add Dockerfile
 2023-05-02 01:06:00 -04:00
Andrei Betlen
9d60ae56f2 Fix whitespace 2023-05-01 18:07:45 -04:00
Andrei Betlen
53c0129eb6 Update submoduele clone instructions 2023-05-01 18:07:15 -04:00
Andrei Betlen
523825e91d Update README 2023-04-28 17:12:03 -04:00
Andrei Betlen
e00beb13b5 Update README 2023-04-28 17:08:18 -04:00
Niek van der Maas
9ce8146231 More generic model name 2023-04-12 11:56:16 +02:00
Niek van der Maas
c14201dc0f Add Dockerfile + build workflow 2023-04-12 11:53:39 +02:00
Andrei Betlen
196650ccb2 Update model paths to be more clear they should point to file 2023-04-09 22:45:55 -04:00
Andrei Betlen
38f7dea6ca Update README and docs 2023-04-05 17:44:25 -04:00
Andrei Betlen
17fdd1547c Update workflow name and add badge to README 2023-04-05 04:41:24 -04:00
Andrei Betlen
248b0566fa Update README 2023-04-04 10:57:22 -04:00
Andrei Betlen
b9a4513363 Update README 2023-04-02 21:03:39 -04:00
Andrei Betlen
6dbff7679c Add docs link 2023-03-27 18:30:12 -04:00
Andrei Betlen
281b5cfa6b Update README.md 2023-03-24 00:06:24 -04:00
Andrei Betlen
27a5649cde Update README.md 2023-03-23 23:55:42 -04:00
Andrei Betlen
6c596f4f5a Update README 2023-03-23 16:00:10 -04:00
Andrei Betlen
e34edfa7c7 Update pip instructions in readme 2023-03-23 14:24:34 -04:00
Andrei Betlen
79b304c9d4 Initial commit 2023-03-23 05:33:06 -04:00