AI Engineer/ Data Scientist

This is a remote position.

We're looking for an exceptionally sharp AI Engineer or Senior Data Scientist to join and help us build the next generation of intelligent, data-driven products. You'll architect and ship production-grade LLM applications, design RAG pipelines that actually work at scale, and bring rigorous ML thinking to everything from prompt design to system evaluation. This is a high-autonomy, high-impact role — you'll work closely with product and engineering to own problems end-to-end.

• Design, build, and deploy AI models, tools, and agents to automate intelligence-heavy workflows in investment research, portfolio management, operations, and client reporting.
• Partner with the Head of Data & AI to define the technical architecture for AI use cases, integrating with Snowflake, Databricks, internal APIs, and event streams in a secure and governed way.
• Implement retrieval augmented generation (RAG) pipelines and prompt conditioning patterns that ground LLMs on Marathon’s proprietary data, documents, and knowledge assets.
• Design and implement Model Context Protocol (MCP)–based integrations so AI assistants and agents can securely discover and connect to internal systems, databases, and services through standardized MCP servers and clients.
• Build and maintain MCP servers that wrap key enterprise services (data warehouses, document stores, workflow systems) and expose tools, resources, and prompts to AI clients in a standardized way.
• Establish patterns for MCP host/client configuration, access control, and observability to ensure reliable, auditable AI interactions with enterprise systems.
• Implement MLOps and LLMOps practices for both model and MCP-based integration lifecycles, including deployment automation, monitoring, logging, and rollback strategies.
• Collaborate with data engineers and platform teams to ensure clean, secure, and well-structured data access for AI consumption, including governance of which systems are exposed via MCP.

Requirements

Core skills we need Python (expert) LLMs & GenAI RAG systems Prompt engineering AWS ML / MLOps Vector DBs Model versioning REST APIs Docker / containers Requirements

• 6+ years of hands-on Python — you write production code, build packages, and care about performance and readability.
• Proven experience building and shipping LLM-powered applications (not just wrappers — you understand what's happening under the hood).
• Deep understanding of RAG: dense retrieval, sparse retrieval, hybrid, re-ranking, context window management, and evaluation.
• Strong prompt engineering skills: you know when to use CoT, how to design structured outputs, and how to debug hallucinations systematically.
• Hands-on AWS experience — SageMaker, S3, Lambda, CloudWatch, and ideally Bedrock or SageMaker JumpStart.
• Solid ML fundamentals: model training, evaluation, bias/variance, feature engineering, and experimental design.
• Comfortable with embedding models, tokenization internals, KV-cache, quantization trade-offs, and latency optimization.

Nice to have

• Experience with agentic frameworks (LangChain, LlamaIndex, CrewAI, or custom tool-use implementations).
• Fine-tuning experience — LoRA, QLoRA, instruction tuning, RLHF familiarity.
• Familiarity with evaluation frameworks: RAGAS, DeepEval, or building custom eval harnesses.
• MLOps tooling: MLflow, DVC, Weights & Biases, or SageMaker Pipelines.
• Knowledge of streaming inference, async serving, and cost optimization for token-heavy workloads.
• Prior work in analytics, BI, or domain-specific NLP (finance, healthcare, e-commerce).

Originally posted on Himalayas