Journal of Spectral Imaging,   Volume 11   Article ID a7   (2022)

Peer reviewed Letter

spectrai: a deep learning framework for spectral data

  • Conor C. Horgan  
  • Mads S. Bergholt  
 Corresponding Author
Centre for Craniofacial and Regenerative Biology, King’s College London, London SE1 9RT
[email protected]
 https://orcid.org/0000-0003-0495-1615
 Search for papers by this author
 Corresponding Author
Centre for Craniofacial and Regenerative Biology, King’s College London, London SE1 9RT
[email protected]
 https://orcid.org/0000-0003-3986-8942
 Search for papers by this author

Spectroscopy and spectral imaging have widespread applications in many scientific fields. Deep learning techniques have achieved many successes in recent years across numerous domains. However, the application of deep learning to spectral data remains a complex task due to the need for tailored augmentation routines, specific architectures for spectral data and significant memory requirements. Here we present spectrai, a comprehensive open-source deep learning framework and Python/MATLAB package designed to facilitate the training of neural networks on spectral data. spectrai provides numerous built-in spectral data pre-processing and augmentation methods, neural networks for spectral data including spectral (image) denoising, spectral (image) classification, spectral image segmentation and spectral image super-resolution. spectrai includes both command line and graphical user interface (GUI) tools designed to assist users with model and hyperparameter decisions for a wide range of applications. We demonstrate three case studies of spectral denoising, spectral segmentation and super-resolution. By providing baseline implementations of these functions, spectrai enables wider use of deep learning in spectroscopy and spectral imaging.

Keywords: deep learning, spectroscopy, spectral imaging

Metrics

Downloads:

715

Abstract Views:

2,766