The changelog says for 3.21: [2023-04-30] FIX: previous installation folder was not remembered in some cases (since v3.20a). (#60821)
I have to admit, that I experienced the folder amnesia prior to the fix but ever since then I had no problems.