AI and Annotated Medical Images – OpenPath, PLIP, and “Medical Twitter”

By Michael Awood

September 1, 2023

The lack of available annotated medical images has historically hindered healthcare innovation. However, a solution is emerging as healthcare professionals start to share anonymised images and insights on public platforms – which includes the social media site previously known as Twitter (X). This has led to the creation of OpenPath, a comprehensive dataset of over 200,000 pathology images coupled with natural language descriptions, marking it as the largest public dataset of its kind.

Researchers have used OpenPath to develop Pathology Language–Image Pre-training (PLIP), a multimodal AI trained on this dataset. PLIP has demonstrated impressive results in zero-shot learning and transfer learning for classifying new pathology images across various tasks. Additionally, PLIP enables users to locate similar cases using either image or natural language search, encouraging knowledge sharing.

The researchers collected over 240,000 public pathology images using popular pathology-related hashtags and expanded the collection with data from other online sources. After thorough data quality checks, they assembled over 200,000 pathology image-text pairs named OpenPath, which they used to develop the versatile PLIP.

PLIP outperformed previous models in tasks such as zero-shot learning, linear probing, and text-to-image and image-to-image retrieval. Unlike other digital pathology machine learning methods, PLIP can adapt to new datasets and provide zero-shot predictions based on any text input, making it a flexible tool for potential new disease subtypes.

The study did note some limitations, including irrelevant data in the image-text pairs and challenges in accounting for varying magnification levels and staining styles. However, researchers are optimistic that PLIP can adjust to images with diverse magnification levels and staining protocols. They expect that OpenPath and PLIP will significantly contribute to advancing AI in pathology and encourage a data-focused approach in this area.

Reference url

Recent Posts

Cabotegravir HIV Prevention: First Injectable PrEP Recommended for High-Risk Groups

By HEOR Staff Writer

October 17, 2025

Cabotegravir HIV prevention is now officially recommended in the UK for adults and young people at high risk of HIV who cannot take daily oral PrEP. What makes this approval so significant? For those unable to adhere to daily medication, cabotegravir provides a bi-monthly injectable alternative w...
Social Media Policy Action: Protecting Youth from Cognitive Risks

By João L. Carapinha

October 16, 2025

A recent editorial published in JAMA emphasizes the urgent need for social media policy action due to the developmental impacts of social media on youth. The article discusses a pivotal study by Nagata et al., which examined a large cohort of adolescents. This study revealed that increas...
Johnson & Johnson Advances Solid Tumor Research at ESMO 2025 with Promising New Data
Johnson & Johnson has announced promising new data across multiple solid tumor types, which will be presented at the European Society for Medical Oncology (ESMO) 2025 Congress in Berlin, and the company describes this as "a new era" in their solid tumor research. The press release highlights ...