Malignant Mesothelioma subtyping via sampling driven multiple instance prediction on tissue image and cell morphology data
Article
Eastwood, M., Marc, S., Gao, X., Sailem, H., Offman, J., Karteris, E., Montero Fernandez, A., Jonigk, D., Cookson, W., Moffatt, M., Popat, S., Minhas, F. and Robertus, J. 2023. Malignant Mesothelioma subtyping via sampling driven multiple instance prediction on tissue image and cell morphology data. Artificial Intelligence in Medicine. 143. https://doi.org/10.1016/j.artmed.2023.102628
Type | Article |
---|---|
Title | Malignant Mesothelioma subtyping via sampling driven multiple instance prediction on tissue image and cell morphology data |
Authors | Eastwood, M., Marc, S., Gao, X., Sailem, H., Offman, J., Karteris, E., Montero Fernandez, A., Jonigk, D., Cookson, W., Moffatt, M., Popat, S., Minhas, F. and Robertus, J. |
Abstract | Malignant Mesothelioma is a difficult to diagnose and highly lethal cancer usually associated with asbestos exposure. It can be broadly classified into three subtypes: Epithelioid, Sarcomatoid, and a hybrid Biphasic subtype in which significant components of both of the previous subtypes are present. Early diagnosis and identification of the subtype informs treatment and can help improve patient outcome. However, the subtyping of malignant mesothelioma, and specifically the recognition of transitional features from routine histology slides has a high level of inter-observer variability. In this work, we propose an end-to-end multiple instance learning (MIL) approach for malignant mesothelioma subtyping. This uses an adaptive instance-based sampling scheme for training deep convolutional neural networks on bags of image patches that allows learning on a wider range of relevant instances compared to max or top-N based MIL approaches. We also investigate augmenting the instance representation to include aggregate cellular morphology features from cell segmentation. The proposed MIL approach enables identification of malignant mesothelial subtypes of specific tissue regions. From this a continuous characterisation of a sample according to predominance of sarcomatoid vs epithelioid regions is possible, thus avoiding the arbitrary and highly subjective categorisation by currently used subtypes. Instance scoring also enables studying tumor heterogeneity and identifying patterns associated with different subtypes. We have evaluated the proposed method on a dataset of 234 tissue micro-array cores with an AUROC of 0.89±0.05 for this task. The dataset and developed methodology is available for the community at: https://github.com/measty/PINS. |
Keywords | Malignant Mesothelioma; Multiple instance learning; Computational pathology; Deep learning; Cancer subtyping |
Sustainable Development Goals | 3 Good health and well-being |
Middlesex University Theme | Health & Wellbeing |
Research Group | Artificial Intelligence group |
Publisher | Elsevier |
Journal | Artificial Intelligence in Medicine |
ISSN | 0933-3657 |
Electronic | 1873-2860 |
Publication dates | |
Online | 17 Jul 2023 |
Sep 2023 | |
Publication process dates | |
Submitted | 26 Jan 2023 |
Accepted | 14 Jul 2023 |
Deposited | 22 Sep 2023 |
Output status | Published |
Publisher's version | License |
Copyright Statement | © 2023 The Authors. Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/) |
Digital Object Identifier (DOI) | https://doi.org/10.1016/j.artmed.2023.102628 |
Scopus EID | 2-s2.0-85166017188 |
Web of Science identifier | WOS:001051141600001 |
Language | English |
https://repository.mdx.ac.uk/item/92q7z
Download files
110
total views19
total downloads3
views this month2
downloads this month