How to allow only HTTP Probes for Routes?

17 views
Skip to first unread message

Viacheslav

unread,
Jan 12, 2023, 8:12:30 AM1/12/23
to Knative Users
Hi all,
I am trying to expose an access to pytorch model hosted with KServe/Kubeflow, but InferenceServing is not ready because of issue on Route.
I already able to predict on model using https://<MYMODEL>.<MYDOMAIN>.com/v1/models/<MODELNAME>:predict endpoint and it works great for me.
But KNative's net-istio-controller shows me this error:

{"severity":"ERROR","timestamp":"2023-01-12T12:59:51.631654666Z","logger":"net-istio-controller.istio-ingress-controller","caller":"status/status.go:403","message":"Probing of https://<MYMODEL>.<MYDOMAIN>.com:443 failed, IP: 10.1.0.67:8443, ready: false, error: error roundtripping https://<MYMODEL>.<MYDOMAIN>.com:443/healthz: EOF (depth: 0)","commit":"dc8f82e","knative.dev/controller":"istio-ingress-controller","knative.dev/controller":"knative.dev.net-istio.pkg.reconciler.ingress.Reconciler","knative.dev/kind":"networking.internal.knative.dev.Ingress","knative.dev/traceid":"1cd44c14-4c54-490a-a5a0-2141807ee948","knative.dev/key":"data-models/corener-exposed-predictor-default","stacktrace":"knative.dev/networking/pkg/status.(*Prober).processWorkItem\n\tknative.dev/netwo...@v0.0.0-20220120043934-ec785540a732/pkg/status/status.go:403\nknative.dev/networking/pkg/status.(*Prober).Start.func1\n\tknative.dev/netwo...@v0.0.0-20220120043934-ec785540a732/pkg/status/status.go:288"}

My Gateway allows only HTTP access, and I don't want to issue a certificate because I am using Istio-ingressgateway with Azure Internal Load Balancer which is visible only from the same network.

Is it possible to turn off HTTPS probes for Routes of my InferenceService? I want use HTTP Probes only (which already passed). Maybe you can suggest something else how to make my InferenceService deployed?
Reply all
Reply to author
Forward
0 new messages