5 commits

Author	SHA1	Message	Date
Bruce MacDonald	66003e1d05	subprocess improvements (#524) ... * subprocess improvements - increase start-up timeout - when runner fails to start fail rather than timing out - try runners in order rather than choosing 1 runner - embed metal runner in metal dir rather than gpu - refactor logging and error messages * Update llama.go * Update llama.go * simplify by using glob	2023-09-18 15:16:32 -04:00
Bruce MacDonald	2540c9181c	support for packaging in multiple cuda runners (#509) ... * enable packaging multiple cuda versions * use nvcc cuda version if available --------- Co-authored-by: Michael Yang <mxyng@pm.me>	2023-09-14 15:08:13 -04:00
Michael Yang	0c5a454361	fix model type for 70b	2023-09-12 15:12:59 -07:00
Michael Yang	7dee25a07f	fix falcon decode ... get model and file type from bin file	2023-09-12 12:34:53 -07:00
Bruce MacDonald	09dd2aeff9	GGUF support (#441)	2023-09-07 13:55:37 -04:00