Plug-ins won't affect startup time, but would affect how long it takes for Maya to become responsive once it's started up. First thing it does once the GUI has become visible is to load that list of plug-ins in the manager. So the less you have there, the quicker you'll be able to dive in.
Other things that can affect startup time.
1. Hard drive, SSD or NVMe drives widens that bottleneck
2. OS, Linux will get you faster filesystem performance
3. ~~Memory~~ (won't matter once you've got 8+ GB)
At worst, you can expect 1-5 minutes for Maya to be in a responsive booted up state. At best, I'd wager somewhere around 5-10 seconds under ideal circumstances. I just clocked my own system here at home just now, Maya 2023 takes 12 seconds to become responsive. No network traffic, NVMe drive, plenty of CPU etc.