I don't plan to add a dedicated configuration setting for that, but I've also tried with a French (Canadian) and French (France) keyboard layout and it still works (using Windows 11, though).
Can you try again with Mp3tag v3.37-beta.3 (I've slightly changed Ctrl key press detection), also make sure to check Options → Field Values to confirm a field value was successfully added/removed.