About this episode
What is the Earth Species Project?Can we talk to animals, or at least understand what they are saying to each other? That’s a question that researchers hope to answer with the help of AI. Earth Species Project, a non-profit that develops sophisticated AI technologies, hopes its software can help. Specifically, they have developed Nature-LM audio which is an audio-language machine learning algorithm with the potential to decipher animal communications.How does it work?By gathering and evaluating huge amounts of audio information from different species, Nature-LM audio can identify “individuals in recordings”, and evaluate patterns. For software users, it does not require the user to have any programming skills. Specifically “analyzing animal sounds… [allows for] decoding complex communication and behaviors to monitor the health of entire ecosystems.”This AI model was trained on “bioacoustic archives like Xeno-canto, iNaturalist, the Watkins Marine Mammal Sound Database, and the Animal Sound Archive” along with “general audio, human speech, and music data” while connecting this ”audio encoder to a leading language model.”Benefits of this approachNatureLM “can classify or detect thousands of species across diverse taxa including birds, whales, and aurans–without the need to retrain the model for each task.”. It has other capabilities like “predicting life-stage and simple call-types of birds, and captioning bioacoustic audio” which are useful when trying to analyze the behavior of different species and their associated cues. The software enables evaluation of large amounts of animal sounds and allows evaluation of that data “freely via human language text”.According to a benchmark that they established, called the Beans-zero, which
