Lead Engineer, Big Data - Databricks - Remote

Provides lead level engineering support for information technology (IT) big data architecture activities on Microsoft Azure cloud infrastructure. Representing as a Forward Deployed Engineer, responsible for leading the collection, storage, processing, and analysis of large health care payor datasets supporting Medicare/Medicaid operations. Designs enterprise-scale data solutions on Azure Databricks, Azure Data Factory, and Azure Synapse with emphasis on performance, scalability, and high-reliability. Champions AI-first practices, mentors team members, and drives adoption of machine learning and advanced analytics to improve member health outcomes. Partners strategically with business leaders to identify data-driven opportunities and delivers end-to-end solutions.

Essential Job Duties

• Operates as a lead Forward Deployed Engineer, driving end-to-end ownership culture and mentoring team members on business problem-solving.
  • Provides subject matter expertise in Azure data platform architecture (Azure Databricks, Azure Synapse, Azure Data Factory, Azure Data Lake).
  • Champions AI-first development practices, implementing GitHub Copilot workflows and Azure Machine Learning solutions for predictive health care analytics.
  • Designs and implements business intelligence (BI) solutions using Power BI, Tableau integrated with Azure data platform.
  • Analyzes current business practices and identifies opportunities for leveraging Azure data and AI PaaS services to improve Medicare/Medicaid operations.
  • Builds reusable data quality frameworks and automated data validation using Azure DevOps and quality assurance automation tools.
  • Leads integration initiatives connecting Azure data platform with low-code platforms (Pega, Salesforce, Sitecore).
  • Converts business requirements into technical architecture, design and implementation for health care analytics use cases.
  • Designs analytical data models supporting self-service BI for clinical, financial, and operational stakeholders.
  • Implements batch and real-time data pipelines for claims processing, quality metrics, and population health analytics.
  • Partners with business leaders across the organization to identify high-value data opportunities and prioritize initiatives.
  • Leads technical issue resolution and collaborates with Azure support, infrastructure, and vendor teams.
  • Supports project planning, scheduling and execution using Agile methodologies.
  • Ensures HIPAA compliance and health care data governance standards are maintained.
  • Provides training, mentoring and support to new and existing big data team members on Azure data technologies and Forward Deployed Engineer principles.

Required Qualifications

• At least 6 years of data management experience on cloud data platforms, or equivalent combination of relevant education and experience.
  • Bachelor's degree in IT, computer science, statistics, business, health care, engineering, etc.
  • Experience with Microsoft Azure data services (Azure Databricks, Azure Data Factory, Azure Synapse, Azure Data Lake Storage, Azure Machine Learning).
  • Proven experience implementing AI-assisted development and machine learning solutions.
  • Proficiency in Python, PySpark, Scala, and SQL with quality assurance automation experience.
  • Experience with real-time streaming architectures (Kafka, Azure Event Hubs, Spark Streaming).
  • Experience integrating data platforms with low-code systems (Pega, Salesforce).
  • Health care payor industry experience with Medicare/Medicaid claims, quality metrics (HEDIS, Stars), and regulatory reporting.
  • Understanding of HIPAA requirements and health care data governance frameworks.
  • Ability to mentor and develop team members with Forward Deployed Engineer mindset.
  • Experience with Azure DevOps CI/CD pipelines and Infrastructure as Code (Terraform, ARM templates).
  • Critical-thinking and problem-solving skills with business outcome orientation.
  • Ability to collaborate cross-functionally in a highly matrixed health care organization.
  • Effective verbal and written communication skills, including ability to partner with executive stakeholders and translate business needs.
  • Experience with Microsoft O365, Power BI, and Azure DevOps.

Preferred Qualifications

• Experience in the health care industry.
  • Health care payor data experience including claims, eligibility, quality metrics, and regulatory reporting.

• Azure Data Engineer certification.

To all current Molina employees: If you are interested in applying for this position, please apply through the Internal Job Board.

Molina Healthcare offers a competitive benefits and compensation package. Molina Healthcare is an Equal Opportunity Employer (EOE) M/F/D/V

Originally posted on Himalayas