Humpback Whale Detection and Classification in Salem Sound

Acoustic sensing is a fundamental modality of the DeepSeaVision-AI system, particularly given recent emphasis placed by NOAA on multi-modal approaches to monitoring as part of the offshore/aquaculture permitting process.

The DeepSeaVision-AI platform analyzes subaquatic acoustic patterns to detect marine mammals, and identify them by taxonomic group, genus, and species. Our approach utilizes spectrogram feature generation and recurrent neural networks (RNN) to classify acoustic patterns and the model is lightweight and highly accurate allowing, edge-deployment on low-cost processors.

This work is being conducted with support from Salem State University, NOAA, and Microsoft AI for Earth