# Analyzing audio for instrumental or voice

**URL:** <https://community.mp3tag.de/t/analyzing-audio-for-instrumental-or-voice/63097>\
**Category:** Off-Topic\
**Created:** [December 15, 2023, 10:30am UTC](https://community.mp3tag.de/t/analyzing-audio-for-instrumental-or-voice/63097 "2023-12-15T10:30:22Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![poster](https://community.mp3tag.de/user_avatar/community.mp3tag.de/poster/32/4881_2.png) [@poster](https://community.mp3tag.de/u/poster)\
**Post date:** [December 15, 2023, 10:30am UTC](https://community.mp3tag.de/t/analyzing-audio-for-instrumental-or-voice/63097/1 "2023-12-15T10:30:22Z")

</div>

I am interested in a program that can analyze audio tracks in batch mode to determine whether it is a purely instrumental track or a track with human voices. I did an internet search and came across a number of research reports and also a cloud-based AI web application. It's actually clear that there has to be something like this based on AI now that AI research is booming everywhere. There are already solutions that, among other things, differentiate between instruments, genres, moods and, in the process, also promise to produce an analysis result according to music with singing or spoken text or instrumental music.

However, a cloud-based AI web application where you upload your music and get an analysis result is less suitable for my project, which is intended for this special case. I'm thinking more about the possibility of being able to analyze tens of thousands of tracks locally in batch operation. Uploading individual songs to an AI and giving them for analysis is not a sensible undertaking, especially since it would certainly cause problems with music for which you do not have the rights yourself.

So is there something (perhaps not 100% perfect) that could accomplish this task locally in batch operation?

---

<div class="post-metadata">

**Author:** ![LyricsLover](https://community.mp3tag.de/letter_avatar_proxy/v4/letter/l/c6cbf5/32.png) [@LyricsLover](https://community.mp3tag.de/u/LyricsLover)\
**Post date:** [December 15, 2023, 1:00pm UTC](https://community.mp3tag.de/t/analyzing-audio-for-instrumental-or-voice/63097/2 "2023-12-15T13:00:17Z")

</div>

Maybe you can find something suitable if you search for "[VAD / Voice activity detection](https://en.wikipedia.org/wiki/Voice_activity_detection)"  
(auf deutsch etwas irreführend "[Sprechpausenerkennung](https://de.wikipedia.org/wiki/Sprechpausenerkennung)")

Two examples:

> **[GitHub - snakers4/silero-vad: Silero VAD: pre-trained enterprise-grade Voice...](https://github.com/snakers4/silero-vad)**
>
> Silero VAD: pre-trained enterprise-grade Voice Activity Detector - GitHub - snakers4/silero-vad: Silero VAD: pre-trained enterprise-grade Voice Activity Detector

or

> **[GitHub - jtkim-kaist/VAD: Voice activity detection (VAD) toolkit including...](https://github.com/jtkim-kaist/VAD)**
>
> Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset. - GitHub - jtkim-kaist/VAD: Voice activity detection (VAD) toolki...

---

<div class="post-metadata">

**Author:** ![AreDigg](https://community.mp3tag.de/letter_avatar_proxy/v4/letter/a/bbe5ce/32.png) [@AreDigg](https://community.mp3tag.de/u/AreDigg)\
**Post date:** [December 15, 2023, 1:11pm UTC](https://community.mp3tag.de/t/analyzing-audio-for-instrumental-or-voice/63097/3 "2023-12-15T13:11:40Z")

</div>

Google YAM-net (from Tensorflow) can be run locally using Python, and it seem to do the classification you ask. I have no idea of the quality and requirements.

Otherwise I would go through huggingface and see if you find some models and programs there.

---

<div class="post-metadata">

**Author:** ![poster](https://community.mp3tag.de/user_avatar/community.mp3tag.de/poster/32/4881_2.png) [@poster](https://community.mp3tag.de/u/poster)\
**Post date:** [December 27, 2023, 9:49am UTC](https://community.mp3tag.de/t/analyzing-audio-for-instrumental-or-voice/63097/4 "2023-12-27T09:49:12Z")

</div>

Many thanks for the suggestions.

It seems to me that there is currently no halfway finished or ready to use product that takes my project further. I don't want to tackle a solution in, for example, a Python environment or deal with APIs and code snippets. The employment hurdle for my task goal is a bit too high for me.