Of course, you can't disqualify someone from the tournament. But as an alternative, I suggest giving the organizer the option to mark 2 and 3 participants with specific slots (if he wants to).
There's no need to change anything, and it's not allowed. What kind of nonsense is this? Since when do you swap the places of newcomers? The bracket has been drawn. That's it.