Local to Charlotte, NC / Cloud GenAI Governance & Observability Consultant

[Sid K]

Hi Folks

We have a Cloud Gen AI position, please share suitable profiles.

Position: Cloud GenAI Governance & Observability Consultant

Location:  Charlotte, NC (Onsite)

Duration: 12 Month Contract

Key Responsibilities

Enterprise AI Security: Act as the primary owner of AI security guardrails. Implement and manage Model Armor to handle prompt filtering, data leakage prevention, request/response inspection, and enterprise-safe inference.

Advanced API Ecosystem Debugging: Manage complex API lifecycle tracing rather than simple API integration. Troubleshoot endpoint bottlenecks, container orchestration failure analysis, and trace the exact origin of 429 errors across ingress, gateway, load balancing, and GPU saturation.

AI Observability & Telemetry: Utilize Arize AI for runtime monitoring, inference tracing, and model behavior analysis.

Traffic & Gateway Operations: Manage distributed inference debugging, token queueing, and upstream/downstream API flows.

Cloud Infrastructure: Maintain GCP/Azure landing zones, Terraform deployments, and Kubernetes clusters to support these governance pipelines.

 

Required Qualifications

8+ years experience in API lifecycle tracing, rate limiting, and token throughput management.

8+ years hands-on expertise with AI security tools, specifically Model Armor.

Deep understanding of enterprise AI observability platforms, particularly Arize AI.

Strong background in cloud networking (GCP/Azure) and Kubernetes infrastructure.

Note: This role is focused entirely on generative LLMs; traditional predictive ML or data science backgrounds are not a fit.

Thanks 
Sid