Leaving the cudart library loaded kept ~30m of memory pinned in the GPU in the main process. This change ensures we don't hold GPU resources when idle.
"cudart init failure: 35" isn't particularly helpful in the logs.