Daniel Hiltgen
794a916a72
Add env var so podman will map cuda GPUs
...
Without this env var, podman's GPU logic doesn't map the GPU through
2024-02-29 08:43:08 -08:00
Daniel Hiltgen
75c44aa319
Add back ROCm container support
...
This adds ROCm support back as a discrete image.
2024-01-26 09:24:29 -08:00
Daniel Hiltgen
a34e1ad3cf
Switch back to ubuntu base
...
The size increase for rocm support in the standard image is problematic
We'll revisit multiple tags for rocm support in a follow up PR.
2024-01-25 16:46:01 -08:00
Daniel Hiltgen
df54c723ae
Make CPU builds parallel and customizable AMD GPUs
...
The linux build now support parallel CPU builds to speed things up.
This also exposes AMD GPU targets as an optional setting for advaced
users who want to alter our default set.
2024-01-21 15:12:21 -08:00
Daniel Hiltgen
da72235ebf
Combine the 2 Dockerfiles and add ROCm
...
This renames Dockerfile.build to Dockerfile, and adds some new stages
to support 2 modes of building - the build_linux.sh script uses
intermediate stages to extract the artifacts for ./dist, and the default
build generates a container image usable by both cuda and rocm cards.
This required transitioniing the x86 base to the rocm image to avoid
layer bloat.
2024-01-21 11:37:11 -08:00
Michael Yang
0409c1fa59
docker: set PATH, LD_LIBRARY_PATH, and capabilities ( #1336 )
...
* docker: set PATH, LD_LIBRARY_PATH, and capabilities
* example: update k8s gpu manifest
2023-11-30 21:16:56 -08:00
Jeffrey Morgan
89ba19feca
use Go 1.21.3 in Dockerfile
2023-10-12 23:23:12 -04:00
Jeffrey Morgan
dc87e9c9ae
update Dockerfile to pass GOFLAGS
2023-10-03 07:05:15 -07:00
Michael Yang
0a4f21c0a7
fix docker build ( #659 )
2023-09-30 13:34:01 -07:00
Jeffrey Morgan
9abb66254a
docker: fix volume permission errors
2023-09-30 12:32:15 -07:00
Michael Yang
92d454ec5f
update build_darwin.sh
2023-09-29 11:29:23 -07:00
Jeffrey Morgan
2ded8ab206
use 11.8.0 nvidia dockerfile base image for now
2023-09-26 21:48:41 -07:00
Michael Yang
93d3a2568d
replace dockerfile
2023-09-22 11:57:38 -07:00
Michael Yang
9aa192c812
update cuda docker image
2023-09-14 11:25:20 -07:00
Michael Yang
9795b43d93
update dockerfile
2023-09-06 15:31:25 -07:00
Jeffrey Morgan
7c71c10d4f
fix compilation issue in Dockerfile, remove from README.md until ready
2023-07-11 19:51:08 -07:00
Jeffrey Morgan
ea809df196
update Dockerfile to use OLLAMA_HOST
2023-07-07 23:43:50 -04:00
Jeffrey Morgan
fdb93ef2aa
fix dockerfile
2023-07-06 16:34:44 -04:00
Jeffrey Morgan
6292f4b64c
update Dockerfile
2023-07-06 16:34:44 -04:00
Jeffrey Morgan
48920c873b
add basic Dockerfile
2023-06-30 12:19:04 -04:00
Jeffrey Morgan
54a94566f1
add Dockerfile
2023-06-30 10:47:55 -04:00
