ollama/Dockerfile

FROM intel/oneapi-basekit:2024.2.0-devel-rockylinux9 as build

RUN wget $(echo "https://pkgs.dyn.su/el9/base/x86_64/raven-release.el9.noarch.rpm" | sed "s/el9/el$(rpm -q --queryformat '%{RELEASE}' rpm | grep -oP 'el\K[0-9]+')/g") && \
    rpm -ivh raven-release*.rpm && \
    rm -rf raven-release*.rpm && \
    dnf update -y && \
    dnf -y --enablerepo=raven-extras install golang && \
    dnf -y install epel-release && \
    dnf -y update && \
    dnf -y install supervisor

WORKDIR /app

ARG GIN_MODE=release

ADD . .

RUN OLLAMA_CUSTOM_CPU_DEFS="-DGGML_BLAS=ON -DGGML_BLAS_VENDOR=Intel10_64lp -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx -DGGML_NATIVE=ON" go generate ./... && \
    go build -ldflags="-s -w"

ENV MODEL_NAME="llama"
ENV OLLAMA_HOST="0.0.0.0:8080"

EXPOSE 8080

CMD ["supervisord", "-c", "/app/supervisord.conf"]
Merge https://github.com/ollama/ollama Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-16 16:20:57 +00:00			`FROM intel/oneapi-basekit:2024.2.0-devel-rockylinux9 as build`
replace dockerfile 2023-09-22 18:57:31 +00:00
Merge https://github.com/ollama/ollama Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-16 16:20:57 +00:00			`RUN wget $(echo "https://pkgs.dyn.su/el9/base/x86_64/raven-release.el9.noarch.rpm" \| sed "s/el9/el$(rpm -q --queryformat '%{RELEASE}' rpm \| grep -oP 'el\K[0-9]+')/g") && \`
			`rpm -ivh raven-release*.rpm && \`
			`rm -rf raven-release*.rpm && \`
			`dnf update -y && \`
Ditch the runner container entirely and use build environment as the runner environment Running the binary outside the build environment crashes with signal 127 and i am unable to debug why Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-16 17:12:01 +00:00			`dnf -y --enablerepo=raven-extras install golang && \`
			`dnf -y install epel-release && \`
			`dnf -y update && \`
			`dnf -y install supervisor`
update cuda docker image 2023-09-08 20:41:49 +00:00
Add building on oneapi Also handle model names easily for docker Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-01 11:14:31 +00:00			`WORKDIR /app`
Combine the 2 Dockerfiles and add ROCm This renames Dockerfile.build to Dockerfile, and adds some new stages to support 2 modes of building - the build_linux.sh script uses intermediate stages to extract the artifacts for ./dist, and the default build generates a container image usable by both cuda and rocm cards. This required transitioniing the x86 base to the rocm image to avoid layer bloat. 2024-01-21 19:37:11 +00:00
Use alpine and remove blas Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-07 16:19:35 +00:00			`ARG GIN_MODE=release`

Merge https://github.com/ollama/ollama Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-16 16:20:57 +00:00			`ADD . .`
Combine the 2 Dockerfiles and add ROCm This renames Dockerfile.build to Dockerfile, and adds some new stages to support 2 modes of building - the build_linux.sh script uses intermediate stages to extract the artifacts for ./dist, and the default build generates a container image usable by both cuda and rocm cards. This required transitioniing the x86 base to the rocm image to avoid layer bloat. 2024-01-21 19:37:11 +00:00
Ditch the runner container entirely and use build environment as the runner environment Running the binary outside the build environment crashes with signal 127 and i am unable to debug why Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-16 17:12:01 +00:00			`RUN OLLAMA_CUSTOM_CPU_DEFS="-DGGML_BLAS=ON -DGGML_BLAS_VENDOR=Intel10_64lp -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx -DGGML_NATIVE=ON" go generate ./... && \`
Add building on oneapi Also handle model names easily for docker Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-01 11:14:31 +00:00			`go build -ldflags="-s -w"`
Combine the 2 Dockerfiles and add ROCm This renames Dockerfile.build to Dockerfile, and adds some new stages to support 2 modes of building - the build_linux.sh script uses intermediate stages to extract the artifacts for ./dist, and the default build generates a container image usable by both cuda and rocm cards. This required transitioniing the x86 base to the rocm image to avoid layer bloat. 2024-01-21 19:37:11 +00:00
Add building on oneapi Also handle model names easily for docker Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-01 11:14:31 +00:00			`ENV MODEL_NAME="llama"`
			`ENV OLLAMA_HOST="0.0.0.0:8080"`
Switch back to subprocessing for llama.cpp This should resolve a number of memory leak and stability defects by allowing us to isolate llama.cpp in a separate process and shutdown when idle, and gracefully restart if it has problems. This also serves as a first step to be able to run multiple copies to support multiple models concurrently. 2024-03-14 17:24:13 +00:00
Add building on oneapi Also handle model names easily for docker Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-01 11:14:31 +00:00			`EXPOSE 8080`
update dockerfile 2023-09-06 21:14:20 +00:00
Ditch the runner container entirely and use build environment as the runner environment Running the binary outside the build environment crashes with signal 127 and i am unable to debug why Signed-off-by: baalajimaestro <me@baalajimaestro.me> 2024-07-16 17:12:01 +00:00			`CMD ["supervisord", "-c", "/app/supervisord.conf"]`