I tried to recreate what you've described and am not seeing anything similar - both Timeline and Xsheet orientation seem well behaved in clicking on numbers. Is that where you're having this issue?
Having said that, I'm running latest Nightly Tahoma2D (Linux) and OpenToonz also on Linux. Which OS are you on, and is it possible you have something like a ScrollLock key on, or something like that?