Infinite Terrain Noise

Hello! So I have created a noise map with a size of the render distance of the player and update the chunks when the player moves. The problem is when I create the noise map it works but this game is going to have ‘infinite’ terrain and generating an almost infinite noise map would take WAY too long. So what I did was create a new noise map with the offset of the players position and also kept it the same size as the render distance. That obviously didn’t work because I needed to do that everytime the player generated new chunks and it just crashes the game because its doing that too many times. What I need help with is making this ‘infinite’ without constantly generating a new noise map with an offset everytime a new chunk is generated. I thought of just creating a HUGE noise map and zooming in based on the render distance but I’m not sure if its the best way to go because since I want the illusion of infinite this noise map would need to be HUGE. Thanks !

is your noise map something like this? Hex Map 4 The grayscale picture of blobs?
I once used two noise maps to randomize a shader. It works by scrolling two noise map with different speed and use their total value

I guess this video can help PERLIN NOISE in Unity - Procedural Generation Tutorial - YouTube