Michael Yang
5685c16d4e
Merge pull request #211 from jmorganca/update-llama-cpp
...
update llama.cpp
2023-07-27 16:57:03 -07:00
Michael Yang
db77dfe01f
Merge pull request #102 from jmorganca/session-id
...
Session
2023-07-27 16:46:29 -07:00
Michael Yang
ad3a7d0e2c
add NumGQA
2023-07-27 14:05:11 -07:00
Michael Yang
18ffeeec45
update llama.cpp
2023-07-27 14:05:11 -07:00
Jeffrey Morgan
688661ab9b
increase default batch size to 1024
2023-07-27 16:51:01 -04:00
Michael Chiang
36ad90e8e3
Merge pull request #231 from jmorganca/mchiang0610-discord
...
Update discord invite link
2023-07-27 15:43:52 -04:00
Michael Chiang
6fff59c637
Update discord invite link
...
Update discord invite link
2023-07-27 15:43:15 -04:00
Bruce MacDonald
fee7687cf3
Update modelfile.md
2023-07-27 15:15:10 -04:00
Bruce MacDonald
d3bfb4889c
Update README.md
2023-07-27 15:13:50 -04:00
Bruce MacDonald
1ac38ec89c
improve modelfile docs
2023-07-27 15:13:04 -04:00
Michael Yang
1ad8266473
Merge pull request #226 from jmorganca/fix-modelfile-quotes
...
refactor scan multiline for reuse
2023-07-27 11:45:41 -07:00
Michael Yang
f5ac8ddfb4
refactor scan multiline for reuse
2023-07-27 11:30:51 -07:00
Michael Yang
cca61181cb
sample metrics
2023-07-27 09:31:44 -07:00
Michael Yang
c490416189
lock on llm.lock(); decrease batch size
2023-07-27 09:31:44 -07:00
Michael Yang
f62a882760
add session expiration
2023-07-27 09:31:44 -07:00
Michael Yang
3003fc03fc
update predict code
2023-07-27 09:31:44 -07:00
Michael Yang
32aec66e6a
add load duration
2023-07-27 09:31:44 -07:00
Michael Yang
35af37a2cb
session id
2023-07-27 09:31:44 -07:00
Jeffrey Morgan
dbb3174cbc
app: fix #218 and keep dock open on install
2023-07-27 10:53:38 -04:00
Jeffrey Morgan
31673d26d0
app: quit other instance when starting
2023-07-27 00:57:25 -04:00
Jeffrey Morgan
8ba0f328af
clobber release artifacts
2023-07-26 18:58:28 -04:00
Jeffrey Morgan
d0e934b497
app: tray cleanup
2023-07-26 14:24:56 -04:00
Jeffrey Morgan
e751e47d70
app: remove dialog, icons for updates
2023-07-26 14:04:36 -04:00
Jeffrey Morgan
19d0f2b4cc
publish as pre-release first
2023-07-26 10:48:49 -04:00
Jeffrey Morgan
c48f07f821
app: dont advance on error
2023-07-26 10:46:43 -04:00
Jeffrey Morgan
dc642aa07d
web: skip pre-releases
2023-07-25 17:11:57 -04:00
Bruce MacDonald
f1ff892fdd
pull model on make if not present locally
2023-07-25 16:53:01 -04:00
Jeffrey Morgan
3f2a100465
app: log app errors to console
2023-07-25 15:42:04 -04:00
Michael Yang
95397416f3
Merge pull request #212 from jmorganca/fix-multiline-parsing
...
fix multiline string
2023-07-25 11:53:51 -07:00
Michael Yang
8a86aae019
Merge pull request #209 from jmorganca/k-quants
...
enable k quants
2023-07-25 11:53:29 -07:00
Michael Yang
24c2c77057
fix multiline string
...
the data needs to remove the multiline quotes but include the command:
e.g.
TEMPLATE """
my template values
"""
should be
TEMPLATE
my template values
after scanning
2023-07-25 11:51:43 -07:00
Michael Yang
5614984f06
Merge pull request #189 from Mohit-Gaur/main
...
Improve command parsing and multiline string handling
2023-07-25 11:28:10 -07:00
Bruce MacDonald
4c1caa3733
download models when creating from modelfile
2023-07-25 14:25:13 -04:00
Bruce MacDonald
12ab8f8f5f
Revert "pull model on make if not present locally"
...
This reverts commit 360a10ace391a674de60aa7b9b8cb65e8074027c.
2023-07-25 14:18:46 -04:00
Bruce MacDonald
8ebbd12f21
pull model on make if not present locally
2023-07-25 14:18:46 -04:00
Eva Ho
07971759fa
fix typo
2023-07-25 13:30:52 -04:00
Mohit Gaur
f5f79049c2
Incorporate code review improvements
2023-07-25 22:52:23 +05:30
Michael Yang
726bc647b2
enable k quants
2023-07-25 08:39:58 -07:00
Bruce MacDonald
af9039a167
better error message when model not found on pull
2023-07-25 10:30:48 -04:00
Bruce MacDonald
07ed69bc37
remove reduandant err var
2023-07-25 10:30:14 -04:00
Michael Yang
0deb3767fc
Merge pull request #205 from jmorganca/accelerate
...
enable accelerate
2023-07-24 20:06:05 -07:00
Michael Yang
cb55fa9270
enable accelerate
2023-07-24 17:14:45 -07:00
Michael Yang
93bc9f17a1
Merge pull request #192 from jmorganca/update-development.md
...
update development.md
2023-07-24 16:13:22 -07:00
Bruce MacDonald
536028c35a
better error message when model not found on pull
2023-07-24 17:48:17 -04:00
Michael Chiang
aedf3d1f38
Merge pull request #196 from isbkch/main
...
add devops-engineer example
2023-07-24 17:10:22 -04:00
iLyas Bakouch
91d927abc5
Update Modelfile
2023-07-24 16:43:11 -04:00
iLyas Bakouch
ba8df10a43
Update examples/devops-engineer/Modelfile
...
Co-authored-by: Jeffrey Morgan <251292+jmorganca@users.noreply.github.com>
2023-07-24 16:42:08 -04:00
Bruce MacDonald
abf614804b
remove file on digest mismatch
2023-07-24 21:59:12 +02:00
Bruce MacDonald
a0dbbb23c4
truncate file size on resume
2023-07-24 21:58:32 +02:00
Bruce MacDonald
0fd6278446
do not panic server if file cannot be opened
2023-07-24 15:24:34 -04:00
