Inconsistent Particle Collision detection

I have been having problems with particle collisions in Unity.
I have a project where I have objects made of many cubes and a particle system that is supposed to collide with the cubes and change their state on collision.
I have uploaded two videos to demonstrate the problem I have with inconsistent collision behaviour (one video is in editor mode, and the second in build).

I have all the right settings. I have tried many 'optimizations' that I found online: Setting the cubs as static, adding or removing rigidbodies, lowering the projectile speed, lowering the number of projectiles, creating physics layers and setting it so the projectiles only collide with the cubes and walls, and the cubes only collide with the particles. But still sometimes the collisions work fine, then suddenly the projectiles pass through them.
Frame rate is fine (especially in build version, so that is not the issue). Sometimes the editor has worse performance than the build version, but even that is inconsistent.
When I captured the video it happened that the build version had worse collision detection. I am using Unity 2019.3.3 but I also tried the project on Unity 2019.4.15 and the behaviour was the same.
Any ideas what might be going wrong? and how to fix it?

Videos: 1. Editor mode 2.Build version