ollama/llm/generate/generate_windows.go

package generate

//go:generate powershell -ExecutionPolicy Bypass -File ./gen_windows.ps1
Code shuffle to clean up the llm dir 2024-01-04 17:40:15 +00:00			`package generate`
subprocess llama.cpp server (#401) * remove c code * pack llama.cpp * use request context for llama_cpp * let llama_cpp decide the number of threads to use * stop llama runner when app stops * remove sample count and duration metrics * use go generate to get libraries * tmp dir for running llm 2023-08-30 20:35:03 +00:00
Add cgo implementation for llama.cpp Run the server.cpp directly inside the Go runtime via cgo while retaining the LLM Go abstractions. 2023-11-14 01:20:34 +00:00			`//go:generate powershell -ExecutionPolicy Bypass -File ./gen_windows.ps1`