Dunno if this will help but I've had this issue recently and I've realized it's because my AI (Colony Manager mod) had its tasks set to check things too often. (Such as checking forestry and hunting among other things)
I had it set to check every hour IGT which was too much for my game to handle, so I cranked it back to every 8 hours and daily and it solved my issue. Hope this helps.
Edited to mention the specific mod, since I noticed it on your mods list and the symptoms seemed to match up with mine, since the faster the game runs the more often it can check tasks. I know it's a bit late but I hope it can help you.
I had it set to check every hour IGT which was too much for my game to handle, so I cranked it back to every 8 hours and daily and it solved my issue. Hope this helps.
Edited to mention the specific mod, since I noticed it on your mods list and the symptoms seemed to match up with mine, since the faster the game runs the more often it can check tasks. I know it's a bit late but I hope it can help you.