Hello,
Hope you are doing good.
This is Bhavesh from Key2Source Inc. . Please find the job description below and send me the updated resume.
Job Title: LLM Platform Engineer
Location: Charlotte, NC (Onsite)
Required Skills:
On-premise requirements: (Arize AI, Claude Cowork, GCP, Terraform), Nvidia GPU Environment
Primary Skills
· OpenShift Functions
· OpenShift AI
· Kubernetes
· LLM Deployment & Serving
· GCP
· Terraform
· Arize AI
· Claude Cowork
Key Responsibilities
· Deploy, configure, and manage LLM workloads in on-premise OpenShift environments.
· Design scalable AI/ML infrastructure using OpenShift Functions and Kubernetes.
· Build and optimize enterprise-grade GenAI platforms for inference workloads.
· Implement model deployment, scaling, and monitoring strategies for LLMs.
· Integrate observability and AI monitoring using Arize AI.
· Automate infrastructure provisioning and platform management using Terraform.
· Collaborate with AI/ML engineering teams to operationalize LLM solutions.
· Support hybrid cloud integrations with GCP-based services where applicable.
· Troubleshoot performance bottlenecks in GPU-enabled environments.
Required Qualifications
· Strong hands-on experience with OpenShift/OCP and Kubernetes.
· Experience deploying and managing LLMs in enterprise environments.
· Understanding of AI/ML serving architectures and inference optimization.
· Experience with Terraform and infrastructure automation.
· Knowledge of AI observability and monitoring platforms.
· Familiarity with GenAI ecosystems and enterprise AI workflows.
· Experience with GPU orchestration and NVIDIA-based AI infrastructure.
Bhavesh Choudhary
Senior Talent Scout – Information Technology Key2Source INC
P:+1-302-213-1574
E: bha...@key2source.com | www.key2source.com
5941 81st, PL N, Pinellas Park, FL | 33781, USA