Rigidbody gets stuck in wall after falling

Hello,

I'm making a game where player is able to jump on the walls. however when there is 2 walls overlapping each other and the player jumps on the upper wall and tries to fall down to the lower one the player might get stuck in the wall. See the picture for illustration. Player has continuous collision enabled and player and walls have both box colliders 2D with defaults. Help. Thanks.