Is it possible to spawn players based on joystick button placement?

I want to spawn player 1~4 based on X, Y, A, B (X being player 1, Y being player 2, A being player 3, B being player 4)

However, while all my values via debugging shows correct values, it's not spawning correctly - or doesn't spawn at all. It looks like controllers - xbox controllers - are overriding player index. On attachment, you may see #1 and #3 slots for xbox home button are lit on controllers. Can they somehow interfere with what I'm trying to do? Say, if player presses A on controller #1, he'd spawn as player 3. But player 3 slot is taken by controller #3. Thus nothing happens.

Is such thing possible to occur?

Is there way to still make this happen?