1ab9d60dd2
Single-threaded HTTPServer blocked readiness probes during long NIM API calls (~30s), causing Kubernetes to flip the pod unhealthy until the request completed. ThreadingHTTPServer handles each request in its own thread so probes are never starved. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>