baalajimaestro/ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
ollama/server
History
Daniel Hiltgen cd5c8f6471
Optimize container images for startup (#6547) 
* Optimize container images for startup

This change adjusts how to handle runner payloads to support
container builds where we keep them extracted in the filesystem.
This makes it easier to optimize the cpu/cuda vs cpu/rocm images for
size, and should result in faster startup times for container images.

* Refactor payload logic and add buildx support for faster builds

* Move payloads around

* Review comments

* Converge to buildx based helper scripts

* Use docker buildx action for release
2024-09-12 12:10:30 -07:00
..
testdata/tools server: collect nested tool call objects when parsing (#5824) 2024-07-22 12:38:03 -04:00
auth.go fix nil deref in auth.go 2024-07-26 14:14:48 -07:00
download.go server: fix blob download when receiving a 200 response (#6656) 2024-09-05 10:48:26 -07:00
fixblobs.go server: replace blob prefix separator from ':' to '-' (#3146) 2024-03-14 20:18:06 -07:00
fixblobs_test.go server: replace blob prefix separator from ':' to '-' (#3146) 2024-03-14 20:18:06 -07:00
images.go Revert "Detect running in a container (#6495)" (#6662) 2024-09-05 14:26:00 -07:00
layer.go fix: chmod new layer to 0o644 when creating it 2024-08-16 11:43:19 +08:00
manifest.go only skip invalid json manifests 2024-08-15 10:29:14 -07:00
manifest_test.go lint 2024-08-01 17:06:06 -07:00
model.go convert safetensor adapters into GGUF (#6327) 2024-08-23 11:29:56 -07:00
model_test.go fix(test): do not clobber models directory 2024-08-28 14:07:48 -07:00
modelpath.go validate model path 2024-08-28 09:32:57 -07:00
modelpath_test.go validate model path 2024-08-28 09:32:57 -07:00
prompt.go tools 2024-07-15 15:26:16 -07:00
prompt_test.go lint 2024-08-01 17:06:06 -07:00
routes.go Optimize container images for startup (#6547) 2024-09-12 12:10:30 -07:00
routes_create_test.go Merge pull request #6534 from ollama/mxyng/messages 2024-08-30 09:39:59 -07:00
routes_delete_test.go server: clean up route names for consistency (#6524) 2024-08-26 19:36:11 -07:00
routes_generate_test.go server: clean up route names for consistency (#6524) 2024-08-26 19:36:11 -07:00
routes_list_test.go server: clean up route names for consistency (#6524) 2024-08-26 19:36:11 -07:00
routes_test.go server: clean up route names for consistency (#6524) 2024-08-26 19:36:11 -07:00
sched.go add "stop" command (#6739) 2024-09-11 16:36:21 -07:00
sched_test.go add "stop" command (#6739) 2024-09-11 16:36:21 -07:00
sparse_common.go Don't hard fail on sparse setup error 2024-08-09 12:16:19 -07:00
sparse_windows.go Don't hard fail on sparse setup error 2024-08-09 12:16:19 -07:00
upload.go server: limit upload parts to 16 (#6411) 2024-08-19 09:20:52 -07:00