N
Norstellavia muse
Associate Life Sciences Analyst, AI Model Training
REMOTEPosted 3d ago
ML EngineerEntry LevelFull-time#remote
About the Role
**Description**
Associate Life Sciences Analyst, AI Model Training
Why Norstella? Norstella unites market\-leading companies that all have a shared goal of improving patient access. Each organization (Evaluate, Citeline, MMIT, Panalgo, The Dedham Group) delivers must\-have answers for critical strategic and commercial decision\-making.
Together, we help our clients:
* Assess the market need and competitive landscape
* Know precisely which drugs to prioritize in their portfolios
* Find out where the launch difficulties will be—before they’re difficulties
* Track and improve market access post\-launch
By combining the efforts of each organization under Norstella, we can offer an even wider breadth of expertise, cutting\-edge data solutions and expert advisory services alongside advanced technologies such as real\-world data, machine learning\-driven predictive analytics. At Norstella, we don’t just deliver information and insights. We deliver answers you can act on.
### **About the role:**
As an Associate Life Sciences Analyst for Model Training at Norstella, you will sit at the intersection of clinical and scientific domain expertise and applied AI development. This role will be embedded within a group of life science model trainers, and will interface across cross\-functional teams of data scientists, operations engineers and data engineers. Your work centers on the preference and judgment layer of model development — through scoring and ranking outputs, you will calibrate models on dimensions of quality, accuracy and clinical reasoning such that they are able to handshake with persona use cases. Your judgment becomes the signal that bridges a capable model and a genuinely useful one, and will play a critical role in our efforts to deliver predictive analytics and insights across clients.
### **Responsibilities:**
* Evaluate model outputs across clinical and life sciences tasks by rating individual responses and rewriting outputs to demonstrate the preferred response.
* Assist in maintaining evaluation rubrics, preference dimensions, and quality criteria (factual accuracy, clinical reasoning quality, etc) that govern model outputs and preference alignment.
* Advise and assist with interpretation of model behavior, bridging the desired behavior back to the dataflow inflection point, working with the relevant teams to adjust as needed.
* Partner with data scientists and MLEs to walk feedback into data collection pipelines.
* Conduct red\-team and adversarial evaluation of models, surfacing subtle failure modes — hallucinations, citation errors, unsupported clinical claims, regulatory missteps — that automated metrics cannot reliably catch.
* Contribute to Norstella’s knowledge graph and taxonomy work and help design new agentic workflows based on domain\-grounded language models.
### **The skills you bring to the table:**
* Bachelor’s degree in life sciences, medical sciences, computer science or equivalent professional experience (imminent degree combined with demonstrated project experience considered).
* Experience working with structured platforms and data tools; comfort with automation concepts
* Experience working with large and complex data sets, including data cleaning or preprocessing.
* Excellent problem\-solving skills and the ability to work independently.
* Excellent communication skills, especially between technical and non\-technical teams.
### **Bonus points if you have experience in:**
* Production\-grade life science datasets, including with AI\-enabled applications.
* Experience working with Generative AI, especially LLMs, including agents, throughout the software development lifecycle (SDLC).
* Experience working with MCPs and consuming them into Agentic workflows.
* Experience in fast\-paced, novel product development.
### **Our Guiding Principles for success at Norstella:**
* 01: Bold, Passionate, and Mission\-First
* 02: Integrity, Truth, and Reality
* 03: Kindness, Empathy, and Gra
Associate Life Sciences Analyst, AI Model Training
Why Norstella? Norstella unites market\-leading companies that all have a shared goal of improving patient access. Each organization (Evaluate, Citeline, MMIT, Panalgo, The Dedham Group) delivers must\-have answers for critical strategic and commercial decision\-making.
Together, we help our clients:
* Assess the market need and competitive landscape
* Know precisely which drugs to prioritize in their portfolios
* Find out where the launch difficulties will be—before they’re difficulties
* Track and improve market access post\-launch
By combining the efforts of each organization under Norstella, we can offer an even wider breadth of expertise, cutting\-edge data solutions and expert advisory services alongside advanced technologies such as real\-world data, machine learning\-driven predictive analytics. At Norstella, we don’t just deliver information and insights. We deliver answers you can act on.
### **About the role:**
As an Associate Life Sciences Analyst for Model Training at Norstella, you will sit at the intersection of clinical and scientific domain expertise and applied AI development. This role will be embedded within a group of life science model trainers, and will interface across cross\-functional teams of data scientists, operations engineers and data engineers. Your work centers on the preference and judgment layer of model development — through scoring and ranking outputs, you will calibrate models on dimensions of quality, accuracy and clinical reasoning such that they are able to handshake with persona use cases. Your judgment becomes the signal that bridges a capable model and a genuinely useful one, and will play a critical role in our efforts to deliver predictive analytics and insights across clients.
### **Responsibilities:**
* Evaluate model outputs across clinical and life sciences tasks by rating individual responses and rewriting outputs to demonstrate the preferred response.
* Assist in maintaining evaluation rubrics, preference dimensions, and quality criteria (factual accuracy, clinical reasoning quality, etc) that govern model outputs and preference alignment.
* Advise and assist with interpretation of model behavior, bridging the desired behavior back to the dataflow inflection point, working with the relevant teams to adjust as needed.
* Partner with data scientists and MLEs to walk feedback into data collection pipelines.
* Conduct red\-team and adversarial evaluation of models, surfacing subtle failure modes — hallucinations, citation errors, unsupported clinical claims, regulatory missteps — that automated metrics cannot reliably catch.
* Contribute to Norstella’s knowledge graph and taxonomy work and help design new agentic workflows based on domain\-grounded language models.
### **The skills you bring to the table:**
* Bachelor’s degree in life sciences, medical sciences, computer science or equivalent professional experience (imminent degree combined with demonstrated project experience considered).
* Experience working with structured platforms and data tools; comfort with automation concepts
* Experience working with large and complex data sets, including data cleaning or preprocessing.
* Excellent problem\-solving skills and the ability to work independently.
* Excellent communication skills, especially between technical and non\-technical teams.
### **Bonus points if you have experience in:**
* Production\-grade life science datasets, including with AI\-enabled applications.
* Experience working with Generative AI, especially LLMs, including agents, throughout the software development lifecycle (SDLC).
* Experience working with MCPs and consuming them into Agentic workflows.
* Experience in fast\-paced, novel product development.
### **Our Guiding Principles for success at Norstella:**
* 01: Bold, Passionate, and Mission\-First
* 02: Integrity, Truth, and Reality
* 03: Kindness, Empathy, and Gra
Similar Jobs
C
Capital One• 1mo ago
Machine Learning Engineer 4 (IC)
McLean, VAFull-time
W
Waystone• 6mo ago
AI Engineer
Leeds, West YorkshireFull-time
A
Aderant• 1mo ago
AI Engineer – Center of Excellence
Atlanta, GAFull-time
S
Signifyd• 1mo ago
Senior Machine Learning Engineer I // II
Chicago, ILFull-time