ollama/llama/patches
Jesse Gross c826e57475 runner.go: Better abstract vision model integration
-Update mllama to take the cross attention state as embeddings in
a batch, more similar to how Llava handles it. This improves
integration with the input cache.
-Pass locations in a prompt for embeddings using tags similar to Llava.
-Abstract interface to vision models so the main runner accesses Clip
and Mllama similarly

Co-authored-by: Michael Yang <mxyng@pm.me>
2024-10-30 14:53:43 -07:00
..
0001-cuda.patch llama: Decouple patching script from submodule (#7139) 2024-10-17 15:03:09 -07:00
0002-pretokenizer.patch llama: Decouple patching script from submodule (#7139) 2024-10-17 15:03:09 -07:00
0003-metal.patch llama: Decouple patching script from submodule (#7139) 2024-10-17 15:03:09 -07:00
0004-ggml-metal.patch llama: Decouple patching script from submodule (#7139) 2024-10-17 15:03:09 -07:00
0005-embeddings.patch llama: Decouple patching script from submodule (#7139) 2024-10-17 15:03:09 -07:00
0006-clip-unicode.patch llama: Decouple patching script from submodule (#7139) 2024-10-17 15:03:09 -07:00
0007-solar-pro.patch llama: Decouple patching script from submodule (#7139) 2024-10-17 15:03:09 -07:00
0008-conditional-fattn.patch llama: Decouple patching script from submodule (#7139) 2024-10-17 15:03:09 -07:00
0009-blas.patch llama: Decouple patching script from submodule (#7139) 2024-10-17 15:03:09 -07:00
0010-add-mllama-support.patch runner.go: Better abstract vision model integration 2024-10-30 14:53:43 -07:00
0011-add-unpad-operator.patch image processing for llama3.2 (#6963) 2024-10-18 16:12:35 -07:00
0012-fix-deepseek-deseret-regex.patch Fix deepseek deseret regex (#7369) 2024-10-26 14:58:54 -07:00