// THE HEADLINE RESULT
Built a fully interactive VR environment spanning a doctor's office and a working pathology lab, placing oncologists inside a real NSCLC patient case and walking them through the entire biomarker testing pathway, from ordering molecular tests to interpreting IHC slides and understanding novel computational scoring. The experience passed full MLR review for use in a regulated promotional context.
What It Achieved
The experience delivered a level of scientific depth and hands-on realism that no slide deck or video could replicate: HCPs physically handled patient files, operated lab equipment, and made clinical decisions as they moved through the environment.
2
FULLY NAVIGABLE
ENVIRONMENTS
Doctor's consulting room and pathology laboratory, each a complete, interactable 3D space
MLR
APPROVED FOR
PROMOTIONAL USE
Full Medical, Legal and Regulatory review passed, rare for a VR experience of this complexity
6+
INTERACTIVE MODULES
IN A SINGLE SESSION
Patient consult, test ordering, tissue scanning, IHC QC, biomarker scoring, and results interpretation
"The ability to physically pick up objects, walk into the lab and see the scanner process and slide details, made the testing pathway very engaging."
MEDICAL EDUCATION LEAD · GLOBAL PHARMA CLIENT
The Context
// WHAT WAS NEEDED
The client needed to train oncologists on a novel approach to biomarker scoring for NSCLC, a complex multi-step process involving molecular pathology requests, immunohistochemistry staining, digital slide scanning, and computational image analysis. Traditional medical education materials couldn't convey the interplay between clinical decision-making and laboratory workflow. The brief was to build something that put the HCP inside the process.
THE BUILD
I built a dual-environment VR experience in Unity for the PICO headset: a complete clinical simulation in which the user steps into the role of a treating physician and navigates through a full patient case from consultation to molecular pathology report.
- Doctor's consulting room with a fully realised patient avatar, interactable patient history clipboard, laptop, and desk props, all grabbable and readable in VR
- Molecular Pathology Request Form system: the user physically selects DNA/RNA and IHC tests including NGS panel, fusions panel, and novel biomarker assays
- Pathology laboratory environment with working digital slide scanner with animated staining, scanning, and image acquisition sequence
- Computational image analysis module: a real-time 'Analyzing Image' progress sequence followed by high-resolution IHC tissue viewer with annotated subcellular compartments (membrane, cytoplasm, nucleus)
- IHC acceptability QC exercise: the user acts as pathologist, accepting or rejecting tissue images based on evaluable cell criteria
- Novel biomarker NMR scoring walkthrough: an animated explanation of how the algorithm calculates the ratio of membrane expression relative to total protein expression per tumour cell
- Branching navigation: users can skip modules or explore all content at their own pace, with persistent progress tracking
- MLR-compliant content pipeline: all in-world text, references, and scientific claims fully footnoted and submitted through the regulatory review process
- Built-in analytics layer capturing module completion, interaction events, and dwell time in aggregate anonymised form
- Tested on the Meta Quest in Unity and then deployed finally to the business-ready PICO headset via the PICO business suite.