Note: The job is a remote job and is open to candidates in USA. OVA.Work is seeking an AI DevOps Engineer to build, automate, and manage infrastructure and deployment pipelines that support AI and machine learning applications. This role bridges DevOps, MLOps, and cloud engineering to ensure reliable, secure, and scalable delivery of AI solutions. The engineer will be responsible for designing CI/CD pipelines, managing containerized AI workloads, provisioning infrastructure as code, and collaborating with cross-functional teams to optimize AI delivery.
Responsibilities
- Design, implement, and maintain CI/CD pipelines for AI and machine learning applications
- Automate the deployment, scaling, and lifecycle management of AI services across cloud and hybrid environments
- Build and manage containerized AI workloads using Docker and Kubernetes
- Provision and manage infrastructure using Infrastructure as Code (Terraform, Pulumi, or CloudFormation)
- Deploy and support AI/ML models in production using model serving frameworks and MLOps tools
- Monitor application health, infrastructure performance, model availability, and operational metrics
- Implement logging, tracing, and observability solutions for AI platforms
- Optimize cloud resources, GPU utilization, and infrastructure costs
- Integrate security best practices, secrets management, identity management, and compliance controls into AI deployment pipelines
- Collaborate with AI engineers, ML engineers, data engineers, platform engineers, and software development teams to streamline AI delivery
- Support automated testing, release management, rollback strategies, and disaster recovery for AI systems
- Troubleshoot production issues related to AI infrastructure, deployments, networking, and performance
- Continuously improve deployment automation, reliability, scalability, and operational efficiency
Skills
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field
- 4+ years of experience in DevOps, Cloud Engineering, Platform Engineering, or Site Reliability Engineering (SRE)
- Experience supporting AI, machine learning, or data platforms in production environments
- Strong programming and scripting skills in Python and Bash; Go is a plus
- Hands-on experience with Docker and Kubernetes
- Experience with AWS, Microsoft Azure, or Google Cloud Platform
- Experience building CI/CD pipelines using GitHub Actions, GitLab CI, Azure DevOps, or Jenkins
- Experience with Infrastructure as Code tools such as Terraform or Pulumi
- Strong understanding of Linux administration, networking, and cloud security
- Experience with monitoring and observability tools such as Prometheus, Grafana, OpenTelemetry, ELK Stack, or Splunk
- Experience with MLOps platforms such as MLflow, Kubeflow, SageMaker, Vertex AI, or Azure Machine Learning
- Experience deploying Large Language Models (LLMs) and Generative AI applications
- Knowledge of model serving frameworks such as KServe, NVIDIA Triton Inference Server, Ray Serve, or BentoML
- Experience with vector databases and Retrieval-Augmented Generation (RAG) architectures
- Familiarity with Apache Airflow, Kafka, Ray, or Apache Spark
- Experience with GPU-enabled infrastructure and NVIDIA CUDA environments
- Understanding of AI governance, Responsible AI, and model monitoring practices
- Experience with LLMOps and Generative AI deployment pipelines
- Experience implementing GitOps using Argo CD or Flux
- Knowledge of service mesh technologies such as Istio or Linkerd
- Experience with FinOps and cloud cost optimization
- Cloud, Kubernetes, or DevOps certifications (AWS, Azure, GCP, CKA, CKAD, Terraform)
Company Overview