AI Platform Engineer (Gen AI)
Veltris · United States · posted today ago
Listing supplied by Himalayas. 101 Careers did not originate this post and applications are handled by the employer.
About this role
This is a remote position.
Job Title: AI Platform Engineer (Gen AI)
Experience: 8 YearsLocation: US
Job Summary
We are looking for an experienced Platform Engineer specializing in Generative AI to design, build, and operate scalable AI platforms that support advanced AI capabilities such as AI Agents, Retrieval-Augmented Generation (RAG), and Knowledge Graph systems.
The ideal candidate will combine strong software engineering skills with cloud-native platform development and DevOps practices to deliver reliable, production-grade AI solutions.
Key Responsibilities
- Design, build, and maintain platform infrastructure for Generative AI applications.
- Develop scalable backend services using Python or Java.
- Build and operate production-grade AI systems, including:
- AI Agents
- Retrieval-Augmented Generation (RAG)
- Knowledge Graph based systems
- Implement end-to-end DevOps practices, owning the lifecycle from development through deployment and monitoring.
- Design and manage CI/CD pipelines using tools such as GitHub Actions or Jenkins.
- Implement Infrastructure as Code (IaC) using Terraform.
- Deploy and manage applications on cloud platforms using both:
- Cloud-native services
- Containerized, cloud-agnostic environments
- Work closely with data scientists, ML engineers, and platform teams to deliver scalable AI infrastructure.
Requirements
Required Skills & Qualifications
- 8+ years of professional experience in software engineering or platform engineering.
- Experience from internships, prototypes, or personal projects will not be considered toward the required years.Strong understanding of system integration and API design with CRM related toolsets
- Strong development experience in Python or Java.
- Hands-on experience building production-grade Generative AI systems
- Experience with AI Agents & Retrieval-Augmented Generation (RAG)
- Experience building Knowledge Graph platforms
- Expertise in Graph databases, Metadata ontology, Graph-based RAG architectures
- Strong experience in DevOps culture and practices
·Hands-on experience with:
- CI/CD pipelines (GitHub Actions or Jenkins)
- Infrastructure as Code (Terraform)
- Experience deploying and operating systems in cloud environments: Cloud Native(AWS S3, Lambda, AWS batch, AWS ECS) and Kubernetes-based services.
Preferred / Nice-to-Have Skills
- Experience building AI platforms or ML platforms at scale
- Experience with LLM orchestration frameworks (LangChain, LlamaIndex, etc.)
- Familiarity with vector databases and embedding systems
- Experience in distributed systems and microservices architecture
Originally posted on Himalayas
