Ui layout elements keep reverting after taken outside of grid element

I created some UI buttons that were aligned in grid layout.

Then I took the buttons outside the grid layout and resized the buttons and realigned them. Saved the prefab and project. On playing it worked fine but when I go back to scene all my buttons are reverted (resized and realigned) like they are inside a grid.

I even made a new grid, placed each button under separate grid element and the same thing happens.

This is driving me crazy, any way around it?