ML Platform and Inference Engineer - Content Developer

Jala University is an innovative initiative designed to bridge the gap between academia and industry by delivering practical education tailored to industry needs, with a unique educational model integrating experts from both academia and industry.

Our goal is to transform the economies of underserved regions through the software industry, creating professional opportunities that impact individuals, communities, and regions, while leaving a lasting legacy for future generations.

Requirements

We're looking for a content developers for its Master in AI Systems Engineering. You'll design module content, labs, a reference implementation, an evaluation harness, and an instructor guide.

Requirements

• 5+ years shipping production software, including 2+ in production AI/ML
• Able to personally build the course artifact to production standard
• Public evidence of technical writing (docs, technical blog, open-source project)
• Reproducibility discipline (pinned dependencies, containers, seeded runs)
• Professional written English
• Willing to hand over developed material to the program (course will be taught by others)
• Track record fine-tuning classical ML / small foundation models
• Experience shipping containerized inference services to production
• Experience with multi-tenant serving in production (routing, queueing, isolation)
• Track record in quantization and caching, with demonstrable serving cost reduction

Tech Stack
Docker, Modal (CPU/T4/A10 and H100/A100), Hugging Face Hub, scikit-learn, PyTorch, vLLM, Prometheus, Grafana, Locust or k6

Benefits

• Remote work modality (home office).
• Joining a dynamic and growing organization with international reach.

Originally posted on Himalayas