Dependency on IMU readings for panorama-like Image capture ?

I'm developing an AR app that has a requirement of capturing 3 images from Phone's back camera at about 50 degrees away from each other. The obvious first choice is to use the gyroscope readings from the phone sensor and capture images as the reading hits 50 deg or a multiple of 50 deg. This approach works 80 % of the time except for the cases when there is a a big IMU drift( which is more frequent in places having tall buildings, mostly downtowns). My requirement is similar to what any phone's panoramic feature of the camera app has with the only difference that instead of capturing multiple images and then stitching it at the end, I only need to capture 3 images without any stitching involved. From my tests, phone's panorama app has worked 100 % of the time but my app has failed on the occasions when there was a huge IMU drift. This clearly indicates that the panorama app is either not completely dependent on phone's gyroscope sensor or it is altogether having a different approach which does not involve using phone sensors.

In any case, I would like to know how the panorama feature on phone is developed so that I can incorporate the same in app.