Transform healthcare with us.

At Qualified Health, we’re redefining what’s possible with Generative AI in healthcare. Our infrastructure provides the guardrails for safe AI governance, healthcare-specific agent creation, and real-time algorithm monitoring—working alongside leading health systems to drive real change.

This is more than just a job. It’s an opportunity to build the future of AI in healthcare, solve complex challenges, and make a lasting impact on patient care. If you’re ambitious, innovative, and ready to move fast, we’d love to have you on board.

Join us in shaping the future of healthcare.

Job Summary

We're looking for an ML Scientist to join our AI team to join in developing the scientific foundations for our healthcare AI platform. As a scientist at Qualified Health, you’ll be at the cutting edge of applied research on evaluating and improving generative AI applied in a healthcare setting, while also working closely with doctors and other healthcare professionals to ensure the system meets their needs.

In this role, you will develop methodologies to understand and measure the capabilities, limitations, and safety properties of agentic workflows and other generative AI system components. You'll design and implement evaluation frameworks that rigorously assess how well our systems perform a wide variety of healthcare-oriented tasks. And you will use these measures and frameworks to improve the performance of our system.

Key Responsibilities

Design and implement evaluation methodologies to measure the reliability, safety, and effectiveness of our AI platform
Develop novel benchmarks and metrics that capture the nuanced requirements of our adaptive care platform
Conduct empirical research on the capabilities and limitations of agentic AI workflows in healthcare settings
Collaborate with our care teams to ensure evaluations are clinically relevant and aligned with patient needs
Build monitoring systems to detect potential failures or risks in AI-assisted care workflows
Contribute to the scientific literature on AI evaluation in healthcare through publications and conference presentations
Work closely with our engineering and product teams to integrate evaluation insights into system development
Help establish best practices for the safe deployment of agentic systems within our full-stack healthcare system

Required Qualifications

PhD or equivalent research experience in machine learning, AI, computer science, or a related field
Expert-level background in machine learning research, particularly in areas related to language models, reinforcement learning, or AI alignment
Excellent programming skills, preferably in Python
Track record of high-quality research publications in venues like NeurIPS, ICML, ACL, ICLR, or similar
Interest in and enthusiasm for the responsible development of AI technology in healthcare

Desirable Skills

Experience working with large language models or foundation models
Experience designing and implementing evaluation methodologies for complex AI systems
Background in healthcare informatics, clinical decision support systems, or medical AI
Prior work on generative AI robustness and evaluation

What We Offer

Competitive startup salary and equity packages.
Health, dental, and vision insurance.
Flexible working hours and hybrid work options.
An opportunity to be at the forefront of AI in healthcare, making substantial impacts on patient care and outcomes.
A vibrant and inclusive work environment that fosters creativity and innovation.

Pay & Benefits: The pay range for this role is between $200,000 and $300,000, and will depend on your skills, qualifications, experience, and location. This role is also eligible for equity and benefits.

Join our mission to revolutionize healthcare with AI. To apply, please send your resume through the application below.

Qualified Health

Latest Jobs

Machine Learning Scientist