This is already the case: if nothing is defined in "Sort by" then the plain value from the "Value" is taken as sort criterion.
The problem of files not being in the order that may be expected has also been discussed in the context of external storages inserted in car stereos, see, e.g. here:
It still boils down to: you have to sort again if the data in the already loaded files has changed or further files have been added.
There is no unexpected change of sorting order.