EditorGUI elements require minimum size of 24px?

Nearly all of the GUI and EditorGUI elements require a minimum size of 24px, otherwise they don't work or won't show without warning.

For Example, the Toggle element, when given sizes below 24px will only (if at all) be clickable in the top left corner, while the element itself is 12px big, excluding the usual 2px padding.

Another Example is the LabelField, which will just disappear from the GUI when the size is smaller than 24px horizontally. Vertically might work fine.

Why is this and how could i work around this without having to waste any more space?