I can certainly empathize with the fatigue factor, however, overtime
it begins to decrease the more consistent you are with training for an
allotted time.
Personally, I remember a time where I was heavily fatigued just after
20min of regular dual-n-back. I have now reached a point where I can
consistently train for 2+ hours (on various modes) each day without
suffering too much fatigue or compromising my ability when performing
other mentally strenuous exercises.
I am currently studying more than a full-time load (Medical science -
6 subjects/units per semester) at uni & I generally don't have any
problems keeping up with training. So, to reiterate, I think the
average person will have no difficulties in achieving this if they
build up their efforts overtime.