ollama/llm/llm_linux.go

package llm

import "embed"

//go:embed build/linux/*/*/bin/*
var libEmbed embed.FS
Switch back to subprocessing for llama.cpp This should resolve a number of memory leak and stability defects by allowing us to isolate llama.cpp in a separate process and shutdown when idle, and gracefully restart if it has problems. This also serves as a first step to be able to run multiple copies to support multiple models concurrently. 2024-03-14 17:24:13 +00:00			`package llm`

			`import "embed"`

			`//go:embed build/linux///bin/*`
			`var libEmbed embed.FS`