TY - JOUR
T1 - Deep learning approach to assess damage mechanics of bone tissue
AU - Shen, Sabrina Chin yun
AU - Peña Fernández, Marta
AU - Tozzi, Gianluca
AU - Buehler, Markus J.
N1 - Funding Information:
We acknowledge funding from NSF GRFP, as well as the IBM-MIT Watson AI Lab, Army Research Office (W911NF1920098), the Office of Naval Research (N000141612333, N00014171-2320 and N000142012189), and AFOSR-MURI (FA9550-15-1-0514). Additional support from NIH is acknowledged (U01 EB014976). We further acknowledge Diamond Light Source (DLS) for time in the Diamond-Manchester Imaging Branchline I13-2 under proposal MG22575.
Funding Information:
We acknowledge funding from NSF GRFP , as well as the IBM-MIT Watson AI Lab , Army Research Office ( W911NF1920098 ), the Office of Naval Research ( N000141612333 , N00014171-2320 and N000142012189 ), and AFOSR-MURI ( FA9550-15-1-0514 ). Additional support from NIH is acknowledged ( U01 EB014976 ). We further acknowledge Diamond Light Source (DLS) for time in the Diamond-Manchester Imaging Branchline I13-2 under proposal MG22575.
Publisher Copyright:
© 2021 Elsevier Ltd
PY - 2021/11/1
Y1 - 2021/11/1
N2 - Machine learning methods have the potential to transform imaging techniques and analysis for healthcare applications with automation, making diagnostics and treatment more accurate and efficient, as well as to provide mechanistic insights into tissue deformation and fracture in physiological and pathological conditions. Here we report an exploratory investigation for the classification and prediction of mechanical states of cortical and trabecular bone tissue using convolutional neural networks (CNNs), residual neural networks (ResNet), and transfer learning applied to a novel dataset derived from high-resolution synchrotron-radiation micro-computed tomography (SR-microCT) images acquired in uniaxial continuous compression in situ. We present the systematic optimization of CNN architectures for classification of this dataset, visualization of class-defining features detected by the CNNs using gradient class activation maps (Grad-CAMs), comparison of CNN performance with ResNet and transfer learning models, and perhaps most critically, the challenges that arose from applying machine learning methods to an experimentally-derived dataset for the first time. With optimized CNN architectures, we obtained trained models that classified novel images between failed and pristine classes with over 98% accuracy for cortical bone and over 90% accuracy for trabecular bone. Harnessing a pre-trained ResNet with transfer learning, we further achieved over 98% accuracy on the cortical dataset, and 99% on the trabecular dataset. This demonstrates that powerful classifiers for high-resolution SR-microCT images can be developed even with few unique training samples and invites further development through the inclusion of more data and training methods to move towards novel, fundamental, and machine learning-driven insights into microstructural states and properties of bone.
AB - Machine learning methods have the potential to transform imaging techniques and analysis for healthcare applications with automation, making diagnostics and treatment more accurate and efficient, as well as to provide mechanistic insights into tissue deformation and fracture in physiological and pathological conditions. Here we report an exploratory investigation for the classification and prediction of mechanical states of cortical and trabecular bone tissue using convolutional neural networks (CNNs), residual neural networks (ResNet), and transfer learning applied to a novel dataset derived from high-resolution synchrotron-radiation micro-computed tomography (SR-microCT) images acquired in uniaxial continuous compression in situ. We present the systematic optimization of CNN architectures for classification of this dataset, visualization of class-defining features detected by the CNNs using gradient class activation maps (Grad-CAMs), comparison of CNN performance with ResNet and transfer learning models, and perhaps most critically, the challenges that arose from applying machine learning methods to an experimentally-derived dataset for the first time. With optimized CNN architectures, we obtained trained models that classified novel images between failed and pristine classes with over 98% accuracy for cortical bone and over 90% accuracy for trabecular bone. Harnessing a pre-trained ResNet with transfer learning, we further achieved over 98% accuracy on the cortical dataset, and 99% on the trabecular dataset. This demonstrates that powerful classifiers for high-resolution SR-microCT images can be developed even with few unique training samples and invites further development through the inclusion of more data and training methods to move towards novel, fundamental, and machine learning-driven insights into microstructural states and properties of bone.
KW - AI
KW - bone
KW - convolutional
KW - images
KW - microCT
KW - ML
KW - modeling
KW - neural network
UR - http://www.scopus.com/inward/record.url?scp=85113367817&partnerID=8YFLogxK
U2 - 10.1016/j.jmbbm.2021.104761
DO - 10.1016/j.jmbbm.2021.104761
M3 - Article
AN - SCOPUS:85113367817
SN - 1751-6161
VL - 123
JO - Journal of the Mechanical Behavior of Biomedical Materials
JF - Journal of the Mechanical Behavior of Biomedical Materials
M1 - 104761
ER -