How to use the same tilemaps among multiple scenes (e.g. making it a prefab)?

Hi, I’m making a 2D platformer and don’t really want to have to recreate my tilemaps for each scene. I have one for collidable objects, one for non-collidable objects, and one for doors that transfer to the next scene. If I have to I’ll just recreate them for every scene, but I’d rather not.

I’ve tried making the three tilemaps into prefabs, but that also brings in all of the tiles placed into the scene where I made them into a prefab. So it seems like that isn’t the right thing to do. Does anyone know what I should do? I’ve searched everywhere online and can’t find anyone saying anything about keeping tilemaps between different scenes. Thanks!