ML Ops Engineer
Salary not listed
MSH · Charlotte, NC · Hybrid · Contract
Maintain · Found · listed 20 days ago
Opens this job on LinkedIn in a new tab, where MSH posted it.
Experience asked for: at least 5 years
Read from the required qualifications, not the preferred ones. We show the largest stated requirement. The employer may accept equivalent experience; read the qualifications below.
Title: MLOps Engineer
Location: Charlotte, NC | Texas | Arizona | New Jersey
Employment Type: Contract
Experience: 5+ Years
About the Role
We are seeking an experienced MLOps Engineer to lead the infrastructure supporting enterprise-scale Generative AI and Predictive AI platforms. This role focuses on designing, deploying, and operating high-performance, GPU-accelerated environments, with an emphasis on OpenShift, Kubernetes, automation, and observability.
The ideal candidate will bring strong infrastructure engineering expertise and hands-on experience supporting production AI/ML workloads in complex, highly regulated enterprise environments.
Key Responsibilities
• Lead infrastructure initiatives supporting Generative AI and Predictive AI platforms from design through production operations.
• Design, deploy, and manage OpenShift-based container platforms optimized for GPU-accelerated workloads.
• Support AI/ML model training, inference, and batch processing environments.
• Build and operate scalable GPU infrastructure, including multi-node GPU clusters and GPU SuperPod architectures.
• Develop and maintain monitoring, alerting, and observability solutions using Grafana, Splunk, and enterprise telemetry tools.
• Define and implement SLIs/SLOs to proactively identify performance, capacity, and reliability risks.
• Develop AI-driven and agent-based automation for self-healing, scaling, diagnostics, and incident remediation.
• Apply AIOps practices to reduce alert fatigue and improve platform reliability.
• Lead production incident investigations, root-cause analysis, and preventive remediation initiatives.
• Collaborate with cross-functional and geographically distributed engineering teams while mentoring other engineers.
• Ensure platform stability, availability, resiliency, and compliance with enterprise operational controls.
Required Qualifications
• 5+ years of infrastructure engineering experience.
• 5+ years of experience troubleshooting complex end-to-end architectures, including CI/CD pipelines.
• 5+ years of hands-on Linux systems administration and troubleshooting experience.
• 4+ years of experience supporting AI/ML platforms.
• 4+ years of experience with Kubernetes and container platforms, including production operations.
• Strong experience with infrastructure automation, production support, and incident management.
Preferred Qualifications
• Experience supporting Generative AI and Predictive AI platforms.
• Hands-on experience operating GPU infrastructure, including scheduling, quotas, resource allocation, and performance tuning.
• Experience with OpenShift in GPU-enabled, multi-tenant environments.
• Experience designing, deploying, or operating GPU SuperPods and large-scale GPU clusters.
• Strong observability experience with Grafana, Splunk, and custom telemetry pipelines.
• Experience developing AI-driven automation, autonomous agents, or AIOps solutions.
• Experience supporting AI/ML workloads on Google Cloud Platform (GCP) and Microsoft Azure, including GPU-backed services and managed AI infrastructure.
• Experience managing hybrid-cloud or multi-cloud AI platforms, including networking, identity, cloud-native services, and cost optimization.
• Knowledge of AI/ML operational metrics, including inference latency, GPU utilization, and workload performance.
• Experience with Business Continuity Planning (BCP), Disaster Recovery (DR), high availability, and resilient architecture design.
Job Expectations
• Participate in a 24x7 on-call rotation.
• Take ownership of production stability, platform health, and service reliability.
• Operate effectively in a highly regulated enterprise environment with strong risk management and compliance requirements.
Interested?
If you have strong experience in MLOps, Kubernetes, OpenShift, GPU infrastructure, and production AI/ML platforms, we'd love to hear from you!