I went ahead and cloned the repo, fixed the problem and then compiled and deployed it, only to find out the version on github takes MUCH longer to scan...
I found the issue was the MediaMetaData identifier function, so I commented that out and tried again and now it's back to being fast(er) and doesn't have the interactive scan issues.
I'm not sure if there's any settings related to the mediametadata, but I couldn't find any....
DownloadIdentifiersController seems to call it from MediaMetaData.cs, which doesn't have any settings-based if statements, so I assume I'd have to add a setting in the interface and an if statement to check for it.. which isn't worth it for me personally, since I doubt I'll ever use it...