I'm getting these annoying micro-stutters during fast movement in Silksong on my Zotac 5060 Ti. Why is this happening?

When navigating complex side-scrolling backgrounds, I noticed these micro-second jumps that are absolutely killing the flow for a hardcore player. Despite the 16GB buffer on the Zotac RTX 5060 Ti, the memory controller was hitting a 14-22ms addressing latency between the L2 cache and VRAM when handling 2D vector assets. I initially tried enabling Low Latency Mode in the NVIDIA Control Panel, but that was a disaster—input lag dropped, but the stuttering frequency actually spiked by 15%. I eventually used a third-party tool to force a fixed memory allocation mode and disabled Windows Hardware-Accelerated GPU Scheduling. Monitoring via RTSS showed the frame time variance collapse from a wild 8-25ms swing down to a steady 6-11ms range. I did hit a snag early on where locking the core clock pushed idle power to 45W, but a quick voltage offset of -0.05V in BIOS brought it back to sanity. Temps stayed between 58-64℃ with fans at 1400 RPM. After running benchmarks, the address mapping is rock steady with frame times locked at 6.1-10.4ms.