资讯
Google Research Blog
AI
Industry
Dataset
中文标题
基于鸟类训练的AI揭示水下神秘现象
English Title
How AI trained on birds is surfacing underwater mysteries
Google Research Blog
发布时间
2026/2/10 02:38:00
来源类型
blog
语言
en
摘要
中文对照

了解谷歌研究人员如何将原本用于识别鸟鸣的AI模型重新应用于检测鲸鱼叫声及监测海洋健康状况。探索生物声学监测的未来发展方向。

English Original

Discover how Google researchers repurposed AI models trained on bird songs to detect whale calls and track marine health. Explore the future of bioacoustic monitoring.

正文
中文全文

我们描述了Perch 2.0——Google DeepMind的生物声学基础模型——如何在训练于鸟类及其他陆地动物发声的基础上,以“卓越”的表现将能力迁移至水下声学挑战中的“虎鲸”识别任务。如果预训练分类模型(例如我们的多物种虎鲸模型)已具备所需标签,并且在研究者的数据集上表现良好,可直接用于生成其音频数据的得分与标签。然而,若需为新发现的声音创建自定义分类器,或提升在新数据上的准确率,则可采用迁移学习,而非从零开始构建新模型。该方法显著减少了创建新自定义分类器所需的计算量与实验次数。图中展示了各模型在DCLDE 2026生态型数据集上的嵌入向量tSNE可视化结果,该数据集包含虎鲸(orca)物种的五个生态型变种。图表使用sci-kit learn的PCA与tSNE库生成,嵌入向量在应用tSNE前先被投影至32维向量。

English Original

We describe how Perch 2.0, Google DeepMind's bioacoustics foundation model, trained on birds and other terrestrial animal vocalizations, transfers ‘whale’ to underwater acoustics challenges with ‘killer’ performance. If a pre-trained classification model, such as our multi-species whale model, already has the necessary labels and works well on a researcher’s dataset, it can be used directly to produce scores and labels for their audio data. However, to create a new custom classifier for newly discovered sounds or to improve accuracy on new data, we can leverage transfer learning instead of building a new model from scratch. This approach drastically reduces the amount of computation and experimentation needed to create a new custom classifier. tSNE plots of the embeddings from each model on the DCLDE 2026 Ecotype dataset, which contains five ecotype variants of the killer whale (orca) species. Plots were generated with sci-kit learn PCA and tSNE libraries, with embeddings first projected to 32 dimension vectors prior to tSNE being applied.

资源链接
About Googleabout.googleGoogle Productsabout.google/intl/en/productsAI for Non-Human Animal Communicationsaiforanimalcomms.orgGoogle Arts and Culture projectartsandculture.google.com/experiment/zgFx1tMqeIZyTwprior researcharxiv.org/abs/2001.08361ReefSetarxiv.org/abs/2404.16436agile modeling approacharxiv.org/abs/2505.03071Perch 2.0arxiv.org/abs/2508.04665Paperarxiv.org/abs/2512.03219SurfPerchblog.google...ew-ai-tool-to-help-monitor-coral-reef-healthCalling in Our Coralsblog.google...ives/arts-culture/how-to-protect-coral-reefsGoogle Cloudconsole.cloud.google.com...ails/noaa-public/passive_acoustic_monitoringGoogle DeepMinddeepmind.googlePerch foundational bioacoustics modeldeepmind.google...e-of-bioacoustics-to-save-endangered-speciesarea under the receiver-operating characteristic curvedevelopers.google.com...ning/crash-course/classification/roc-and-aucbaleen whaleen.wikipedia.org/wiki/Baleen_whaleecotypesen.wikipedia.org/wiki/Ecotypekiller whaleen.wikipedia.org/wiki/OrcatSNEen.wikipedia.org.../T-distributed_stochastic_neighbor_embeddingAVES-birdgithub.com/earthspecies/avesFollow us on githubgithub.com/google-researchPerch Hoplitegithub.com/google-research/perch-hopliteColab demogithub.com...ts/whale_demo/agile_modeling_noaa_demo.ipynbNeurIPS 2025neurips.ccour prior tutorialsneurips.cc/virtual/2023/76893Privacypolicies.google.com/privacyTermspolicies.google.com/termsmysterious “biotwang” soundpubs.aip.org.../A-complex-baleen-whale-call-recorded-in-theBlogresearch.google/blogoriginal research models to detect humpback whale classificationsresearch.google...-whales-using-a-convolutional-neural-networkreleaseresearch.google...angs-recognizing-whale-vocalizations-with-aiCareersresearch.google/careersLearn more about our Conferences & events Learn moreresearch.google/conferences-and-eventsLearn more about our People Learn moreresearch.google/peopleLearn more about our Philosophy Learn moreresearch.google/philosophyCollaborate with usresearch.google/programs-and-eventsLearn more about our Faculty programs Learn moreresearch.google/programs-and-events/faculty-engagementLearn more about our Student programs Learn moreresearch.google/programs-and-events/student-engagementLearn more about our Publications Learn moreresearch.google/pubsExplore all research areasresearch.google/research-areasAlgorithms & Theoryresearch.google/research-areas/algorithms-and-theoryClimate & Sustainabilityresearch.google/research-areas/climate-and-sustainabilityData Managementresearch.google/research-areas/data-managementData Mining & Modelingresearch.google/research-areas/data-mining-and-modelingDistributed Systems & Parallel Computingresearch.google...s/distributed-systems-and-parallel-computingEconomics & Electronic Commerceresearch.google...arch-areas/economics-and-electronic-commerceEducation Innovationresearch.google/research-areas/education-innovationGeneral Scienceresearch.google/research-areas/general-scienceHardware & Architectureresearch.google/research-areas/hardware-and-architectureHealth & Bioscienceresearch.google/research-areas/health-bioscienceHuman-Computer Interaction and Visualizationresearch.google...human-computer-interaction-and-visualizationInformation Retrieval & the Webresearch.google...arch-areas/information-retrieval-and-the-webMachine Intelligenceresearch.google/research-areas/machine-intelligenceMachine Perceptionresearch.google/research-areas/machine-perceptionMachine Translationresearch.google/research-areas/machine-translationMobile Systemsresearch.google/research-areas/mobile-systemsNatural Language Processingresearch.google/research-areas/natural-language-processingNetworkingresearch.google/research-areas/networkingQuantum Computingresearch.google/research-areas/quantum-computingResponsible AIresearch.google/research-areas/responsible-aiRoboticsresearch.google/research-areas/roboticsSecurity, Privacy, & Abuse Preventionresearch.google...-areas/security-privacy-and-abuse-preventionSoftware Engineeringresearch.google/research-areas/software-engineeringSoftware Systemsresearch.google/research-areas/software-systemsSpeech Processingresearch.google/research-areas/speech-processingLearn more about our Resources Learn moreresearch.google/resourcesLearn more about our Projects Learn moreresearch.google/resources/our-projectssci-kit learn PCAscikit-learn.org...les/generated/sklearn.decomposition.PCA.htmltSNEscikit-learn.org...modules/generated/sklearn.manifold.TSNE.htmlHelpsupport.google.comShare on Twittertwitter.com/intent/tweetK. Lisa Yang Center for Conservation Bioacousticswww.birds.cornell.edu/ccbCornell Lab of Ornithologywww.birds.cornell.edu/homeEarth Species Projectwww.earthspecies.orgShare on Facebookwww.facebook.com/sharer/sharer.phpthe elusive Bryde’s whaleswww.frontiersin.org...nce/articles/10.3389/fmars.2024.1394695/fullGooglewww.google.comPerch 1.0www.kaggle.com...ier/tensorFlow2/bird-vocalization-classifierPerch 2.0www.kaggle.com...calization-classifier/tensorFlow2/perch_v2/2multi-species whale modelwww.kaggle.com/models/google/multispecies-whaleSurfPerchwww.kaggle.com/models/google/surfperchShare on LinkedInwww.linkedin.com/shareArticleFollow us on linkedinwww.linkedin.com/showcase/googleresearchhave evolved similar means of sound productionwww.nature.com/articles/ncomms9978DCLDEwww.nature.com/articles/s41597-025-05281-5transfer learningwww.nature.com/articles/s41598-023-49989-zNOAA NCEI Passive Acoustic Data Archivewww.ncei.noaa.gov/products/passive-acoustic-dataNational Oceanic and Atmospheric Administrationwww.noaa.govFollow us on youtubewww.youtube.com/c/GoogleResearchFollow us on xx.com/GoogleResearch原始来源页面research.google...on-birds-is-surfacing-underwater-mysteries
元数据
来源Google Research Blog
类型资讯
抽取状态raw
关键词
Climate & Sustainability
Open Source Models & Datasets
Sound & Accoustics
AI
Industry
Dataset