baalajimaestro/ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
ollama/integration
History
Daniel Hiltgen 6fd04ca922 Improve multi-gpu handling at the limit 
Still not complete, needs some refinement to our prediction to understand the
discrete GPUs available space so we can see how many layers fit in each one
since we can't split one layer across multiple GPUs we can't treat free space
as one logical block
2024-06-14 14:51:40 -07:00
..
basic_test.go Local unicode test case 2024-04-22 19:29:12 -07:00
concurrency_test.go Improve multi-gpu handling at the limit 2024-06-14 14:51:40 -07:00
context_test.go Improve multi-gpu handling at the limit 2024-06-14 14:51:40 -07:00
llm_image_test.go Request and model concurrency 2024-04-22 19:29:12 -07:00
llm_test.go Request and model concurrency 2024-04-22 19:29:12 -07:00
max_queue_test.go Skip max queue test on remote 2024-05-16 16:24:18 -07:00
README.md Revamp go based integration tests 2024-03-23 14:24:18 +01:00
utils_test.go Improve multi-gpu handling at the limit 2024-06-14 14:51:40 -07:00

README.md

Integration Tests

This directory contains integration tests to exercise Ollama end-to-end to verify behavior

By default, these tests are disabled so go test ./... will exercise only unit tests. To run integration tests you must pass the integration tag. go test -tags=integration ./...

The integration tests have 2 modes of operating.

  1. By default, they will start the server on a random port, run the tests, and then shutdown the server.
  2. If OLLAMA_TEST_EXISTING is set to a non-empty string, the tests will run against an existing running server, which can be remote