# Large file set access slow on NAS

**URL:** https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534
**Category:** Support
**Created:** [April 27, 2024, 4:24pm UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534 "2024-04-27T16:24:43Z")
**Posts on this page:** 11
**Page:** 1

<div class="post-metadata">

### Author: ![curiousMonkey](https://community.mp3tag.de/letter_avatar_proxy/v4/letter/c/bbce88/32.png) [@curiousMonkey](https://community.mp3tag.de/u/curiousMonkey)
#### Post date: [April 27, 2024, 4:24pm UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/1 "2024-04-27T16:24:43Z")

</div>

I have been using MP3Tag for many years and think it works very well in most situations. However I recently trying to review my entire collection (almost 30,000 files) and noticed that the program took an exceptionally long time to load all of the data (around 30 minutes). CPU utilization was around 10% and network utililization was around 200 Mbps.

s there anyway to improve the network performance so that it can saturate the available bandwidth? My network has connections of up to 10 Gbps so there is a lot of potential for improvement. I tried a similar test using files on a local hard drive and I think that is 5-6 times faster.

---

<div class="post-metadata">

### Author: ![LyricsLover](https://community.mp3tag.de/letter_avatar_proxy/v4/letter/l/c6cbf5/32.png) [@LyricsLover](https://community.mp3tag.de/u/LyricsLover)
#### Post date: [April 27, 2024, 5:22pm UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/2 "2024-04-27T17:22:43Z")

</div>

What kind of files are these 30'000 tracks? MP3? FLAC? Other format?

---

<div class="post-metadata">

### Author: ![ohrenkino](https://community.mp3tag.de/user_avatar/community.mp3tag.de/ohrenkino/32/4843_2.png) [@ohrenkino](https://community.mp3tag.de/u/ohrenkino)
#### Post date: [April 27, 2024, 5:43pm UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/3 "2024-04-27T17:43:52Z")

</div>

> [@curiousMonkey](#):
>
> network utililization was around 200 Mbps

There you have the bottleneck.  
MP3tag uses OS calls to access files. So you would have to tune your OS to access the NAS faster.

---

<div class="post-metadata">

### Author: ![curiousMonkey](https://community.mp3tag.de/letter_avatar_proxy/v4/letter/c/bbce88/32.png) [@curiousMonkey](https://community.mp3tag.de/u/curiousMonkey)
#### Post date: [April 27, 2024, 5:49pm UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/4 "2024-04-27T17:49:21Z")

</div>

I have MP3 files in my test directory.

---

<div class="post-metadata">

### Author: ![curiousMonkey](https://community.mp3tag.de/letter_avatar_proxy/v4/letter/c/bbce88/32.png) [@curiousMonkey](https://community.mp3tag.de/u/curiousMonkey)
#### Post date: [April 27, 2024, 5:52pm UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/5 "2024-04-27T17:52:34Z")

</div>

If I just drag the local file directory (170GB) and copy it to the NAS I see throughput around 1 Gbps.

---

<div class="post-metadata">

### Author: ![LyricsLover](https://community.mp3tag.de/letter_avatar_proxy/v4/letter/l/c6cbf5/32.png) [@LyricsLover](https://community.mp3tag.de/u/LyricsLover)
#### Post date: [April 27, 2024, 6:04pm UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/6 "2024-04-27T18:04:41Z")

</div>

> [@curiousMonkey](#):
>
> My network has connections of up to 10 Gbps so there is a lot of potential for improvement.

Do you really have a 10Gbit/s Network adapter inside your PC, a 10Gbit/s capable LAN cable to your switch, a Switch that support 10 Gbit/s on the used ports, a 10Gbit/s capable LAN cable to your NAS and a 10 Gbit/s LAN-Adapter inside your NAS?

Then your NAS needs a very powerful CPU to manage this speed and extremely fast HDDs or SSDs to save the amount of data.

---

<div class="post-metadata">

### Author: ![curiousMonkey](https://community.mp3tag.de/letter_avatar_proxy/v4/letter/c/bbce88/32.png) [@curiousMonkey](https://community.mp3tag.de/u/curiousMonkey)
#### Post date: [April 27, 2024, 7:10pm UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/7 "2024-04-27T19:10:56Z")

</div>

Yes, I do have all of those components. I don't expect 10Gbps from HDD in my NAS but it can approach that with a fast SSD. I do expect comparable performance to a local HDD from the NAS.

---

<div class="post-metadata">

### Author: ![ohrenkino](https://community.mp3tag.de/user_avatar/community.mp3tag.de/ohrenkino/32/4843_2.png) [@ohrenkino](https://community.mp3tag.de/u/ohrenkino)
#### Post date: [April 27, 2024, 8:15pm UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/8 "2024-04-27T20:15:11Z")

</div>

You could still optimize your system for best performance:  
MP3tag on local SSD  
MP3tag configuration folder on local SSD  
Activated library.  
Files for treatment on local SSD.

Each part of that setup on the NAS will slow down access.  
There is no switch in MP3tag to speed up or slow down network access.

See also here:

> [@Tips to prevent rereading entire library on a NAS with 'Library' enabled](https://community.mp3tag.de/t/tips-to-prevent-rereading-entire-library-on-a-nas-with-library-enabled/59097):
>
> Are there any NAS users out there who have managed to get the 'Library' feature to work? I have looked through previous posts about this, dated a few years ago, so I have tried: Adding Mp3tag.exe as an exception in Windows defender Adding my media folder on my NAS and %AppData%\Roaming\Mp3tag as exceptions in my Sophos Home settings. On launch, however, the 'reading directory' process is not expedited in any way, taking ~30mins to read ~2Tb. I have checked, and Mp3tag has created and is upda…

---

<div class="post-metadata">

### Author: ![Casual\_Tea](https://community.mp3tag.de/user_avatar/community.mp3tag.de/casual_tea/32/18886_2.png) [@Casual\_Tea](https://community.mp3tag.de/u/Casual_Tea)
#### Post date: [April 28, 2024, 4:35am UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/9 "2024-04-28T04:35:17Z")

</div>

> [@LyricsLover](#):
>
> Do you really have a 10Gbit/s Network adapter inside your PC, a 10Gbit/s capable LAN cable to your switch, a Switch that support 10 Gbit/s on the used ports, a 10Gbit/s capable LAN cable to your NAS and a 10 Gbit/s LAN-Adapter inside your NAS?

You don't need all that to achieve a 10gbit/s connection. I have an ethernet cable running from my workstation straight into the nas using a different subnet than the normal 1gbit/s network (because 10g switches are expensive). These days not even crossover cables are needed for that and 10gbit/s ethernet cards can be bought used for ~50€ each. SFP+ cards can be bought even cheaper than that.

> [@LyricsLover](#):
>
> Then your NAS needs a very powerful CPU to manage this speed and extremely fast HDDs or SSDs to save the amount of data.

With an 8 hdd wide pool I get 700MByte/s sequential writes when copying hundreds of gigabytes (until the ram cache of the server is full it starts off at the full 10GBit/s).  
The CPU in the server is a low clocking xeon from 2017 (I think around 2,5GHz boost clock).

However loading music files into mp3tag is still pretty slow over the network (even after creating a windows defender exception for mp3tag).

When loading ~100GB of music from a network share into mp3tag the network load is only around 80-100MBit/s initially.  
And even when opening the same music again (the majority of it is read from the ram cache of the server in this case) it only manages around 200MBit/s.

When copying the same movie file from the nas multiple times in comparison, the initial copy runs at around 700MByte/s and the 2nd time it maxes out the 10GBit/s as it's read from the ram cache.

So a hardware bottleneck on the server side can be pretty much ruled out as a limiting factor since the files are read from ram and the cpu load is minimal.

I'm not sure what bottlenecks it but opening or editing music on network shares in mp3tag is slow.

---

<div class="post-metadata">

### Author: ![AreDigg](https://community.mp3tag.de/letter_avatar_proxy/v4/letter/a/bbe5ce/32.png) [@AreDigg](https://community.mp3tag.de/u/AreDigg)
#### Post date: [April 28, 2024, 10:01am UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/10 "2024-04-28T10:01:54Z")

</div>

This type of network activity is not very dependent on network throughput, but latency. File headers are read, then metadata. Small but many reads over the network will never be even close to an Ethernet network’s throughput.

---

<div class="post-metadata">

### Author: ![system](https://community.mp3tag.de/uploads/default/original/2X/c/ce7035d426cb755a7916793326d23b465222a407.png) [@system](https://community.mp3tag.de/u/system)
#### Post date: [May 28, 2024, 10:02am UTC](https://community.mp3tag.de/t/large-file-set-access-slow-on-nas/64534/11 "2024-05-28T10:02:32Z")

</div>

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.
