HDRP Point Light shadows issue

I have a camera with very low FoW 7.5, I made this because I wanted to make an isometric game but also wanted to use all the shader tricks, like depth fade and etc. So I decided to just create a small FoW map and put it really far. When the camera is far away, shadows became very blurred, because of cascades and distance to the camera. This can be fixed, buy increasing the Near Clipping Plane parameter of the camera. But it works only for shadows from Direct Light, but not for shadows from Point Light for some reason. For Point Lights shadows becoming sharp only when a camera is close.

Is this a bug or I'm doing something wrong?