Machine Learning at Vector Institute | Machine Learning Researcher @ INSERM & BorealisAI | CS & Neuroscience Major | Google DSC Lead | Founder of GenAI Genesis Hackathon
🎉 Excited to share my first, first-author paper, "EHRMamba: Towards Generalizable and Scalable Foundation Models for Electronic Health Records," co-authored with my amazing colleagues Mahshid Alinoori, Arash Afkanpour, and Amrit Krishnan at the Vector Institute! 🚀 🏥 Electronic Health Records (EHR) capture detailed patient medical histories and hold immense potential for revolutionizing personalized medicine and clinical decision-making. However, deploying EHR models in real-world settings is challenging due to high computational demands and limited hospital resources. Traditional transformer models, with their quadratic computational costs, are impractical for processing extensive EHR sequences. Additionally, maintaining separate downstream models for each clinical task complicates deployability. 🐍 To overcome these limitations, we introduce EHRMamba, a robust foundation model built on the Mamba architecture. EHRMamba can process sequences up to four times longer than previous models due to its linear computational cost. We also introduce a novel approach to Multitask Prompted Finetuning (MPF) for EHR data, which enables EHRMamba to simultaneously learn multiple clinical tasks in a single finetuning phase, significantly enhancing deployment and cross-task generalization. Our evaluations on the MIMIC-IV dataset demonstrate that EHRMamba advances state-of-the-art performance across 6 major clinical tasks and excels in EHR forecasting, marking a significant leap forward in the field. 👨🍳 Alongside EHRMamba, we open-source Odyssey, a toolkit designed to support the development and deployment of EHR foundation models, with an emphasis on data standardization and interpretability. 🔥 Discover more about our work and explore EHRMamba and Odyssey: https://lnkd.in/eDYspsuA #EHRMamba #Odyssey #ElectronicHealthRecords #Healthcare #MachineLearning #AIInHealthcare #VectorInstitute
Harman Gill
1mo
This is amazing, Adib!🫡
Congratulations Adib, this sounds really cool !!
Congrats Adibvafa, great read!
Hashim Raja
1mo
Sounds amazing!!
Ryan Junejo
1mo
Congratulations on your first first-author paper!
Mamba made LLM 1000X cheaper and faster! Congrats Adib!
ML Fellow @ AI4Good, Bioinformatics @ Princess Margaret Cancer Research | Prev. Machine Learning @ Borealis, UHN | Honours CS & Comp Bio @ UofT | President @ HBSU
1moLet’s go Adib 🥳🥳