This requires an upstream change to support graceful termination, carried as a patch.
* Fix clearing kv cache between requests with the same prompt * fix powershell script