Suggestions
Vivek Natarajan
AI Researcher, Google
Vivek Natarajan is a Research Scientist at Google with a strong focus on large language models (LLMs) and biomedicine, leading groundbreaking AI research.
Vivek is renowned for developing Med-PaLM, Med-PaLM 2, Med-PaLM M, and AMIE, cutting-edge AI systems with exceptional performance in medical applications.
His work has been recognized in prestigious publications like Nature, Nature Medicine, and conferences such as CVPR, ICCV, and NeurIPS.
Vivek's contributions extend to regulated medical devices like Mammo Reader and DermAssist, revolutionizing breast cancer detection and skin condition classification.
Prior to Google, Vivek excelled at Facebook AI Research, accumulating patents, awards, and deploying AI models to serve millions of users.
With a strong academic background, Vivek pursued Masters in Computer Science at The University of Texas at Austin and B.Tech in Electronics and Communication Engineering at NIT Tiruchirappalli.
His experience spans various roles including Faculty at Harvard T.H. Chan School of Public Health, AI Researcher at Meta, Venture Fellow at Healthspan Capital, and Teaching Assistant at UT Austin.
Vivek's research interests include multimodal assistant systems, diagnostic dialogue, and AI applications in healthcare, showcasing a versatile skillset at the forefront of technological innovation.
Highlights
Incredibly delighted to introduce Med-Gemini, our latest family of multimodal models for medicine.
Building on Gemini’s core capabilities, Med-Gemini models are specialized for
- advanced reasoning with seamless web-search integration
- complex multimodal understanding spanning 1 million+ context tokens
The results are promising. We evaluate Med-Gemini on 14 medical benchmarks spanning text, images, surgical videos, EHRs, waveforms, genomics and more, establishing new SoTA on 10 of them, and surpassing the GPT-4 model family on every benchmark where a direct comparison is viable, often by a wide margin.
On the popular MedQA (USMLE) benchmark, Med-Gemini achieves SoTA performance of 91.1% accuracy. On 7 multimodal medical benchmarks, Med-Gemini improves over GPT-4V by an average relative margin of 44.5%.
Perhaps the most exciting advance is the biomedical applications unlocked by long-context capabilities of Med-Gemini (currently beyond the capabilities of other popular models)
In addition to SoTA results on long-context EHR and video tasks, we also include qualitative demonstrations of what such Med-Gemini capabilities might potentially enable including:
- supporting multimodal diagnostic conversations
- facilitating improved clinician-EHR interactions
- accelerating biomedical research with the ability to summarize and generate insights from dozens of full content research articles.
Our paper has more details including expert level performance on real-world relevant tasks such as medical summarization.
In due course, we expect the capabilities to be available via Google Cloud MedLM APIs.
Zooming out, its incredible to see how far we have come in less than a year.
We have gone from LLMs that were only doing single-turn medical QA (Med-PaLM 2) to large multimodal models (LMMs) that can natively understand and intelligently converse about biomedical data spanning millions+ tokens and perform complex tasks at expert level.
At the same time, capabilities advancements go hand-in-hand with reliability demonstrations for biomedicine. We are excited to keep pushing the frontiers.
Paper link - https://lnkd.in/geJWPd9X
A real privilege to work with incredible team mates and leads spanning Google Research Google DeepMind Google Health Google Cloud Verily including Alan Karthikesalingam MD PhD Tao Tu Khaled Saab Juraj Gottweis Wei-Hung Weng Ryutaro Tanno S. Sara Mahdavi David Stutz Ellery Wulczyn Yong Cheng Tomer Golany Mike Schäkermann Jimmy Hu Tim Strother Chunjong Park David Barrett Elahe Vedadi Fan Zhang Juan Manuel Zambrano Chaves Anil Palepu Daniel McDuff Luyang Liu Christopher Semturs Nenad Tomašev Aishwarya Kamath Natasha Latysheva Jean-Baptiste ALAYRAC Basil Mustafa Neil Houlsby Philip Mansfield Jonathan Krause Kavita Kulkarni Renée Wong Ehud Rivlin Yossi Matias Joëlle Barral Greg Corrado Dale Webster Ewa Dominowska Jonathon Shlens S. M. Ali Eslami Claire Cui Oriol Vinyals Koray Kavukcuoglu James Manyika Jeff Dean Demis Hassabis
Delighted to share our latest Google Research Google DeepMind Google Health preprint, Towards Accurate Differential Diagnosis with Large Language Models.
We introduced a new LLM optimized for diagnostic reasoning with conversational and collaborative capabilities (LLM for DDx) as well as an intuitive UX tool for clinicians to interact with it.
We then conducted a randomized study with 20 experienced board-certified internists using 302 clinicopathologic conferences (CPC) (published since 1924 by NEJM). The internists were randomized to either LLM or usual standard assistance (web use and other reference tools).
What we observed was that using the LLM led to significant assistive effect and improvements in diagnostic accuracy of the clinicians in solving these complex case challenges.
At the same time, we also saw that clinicians + LLM performance was below that of the LLM alone on this benchmark suggesting more work was needed with the AI as well as the UX tool to be as helpful as possible to our clinicians.
NEJM CPCs are not representative of everyday clinical practice. They are unusual case reports in only a few hundred individuals so offer limited scope for probing important issues like equity or fairness.
Nonetheless, zooming out, this study points to a future where the standard of care will no longer be a clinician alone but a clinician augmented and aided by an LLM specialized for the safety critical medical domain. More to come soon!
With a fantastic team including Daniel McDuff Mike Schäkermann Tao Tu Anil Palepu Amy Wang Jake Garrison Karan Singhal Shekoofeh Azizi Yun Liu Kavita Kulkarni S. Sara Mahdavi Christopher Semturs Dale Webster Sushant Prakash Juro Gottweis Joëlle Barral Greg Corrado Yossi Matias Jacob Sunshine Alan Karthikesalingam MD PhD
https://lnkd.in/gwsT6znb
