The latter.
But please note that I, for one, have not heard of any popular filesystem
on a platform Go runs on which would support regexp matching when traversing
its entries, and fs.Glob is largely modelled after what Unix shells implement.
Hence basically if something like fs.Regexp were introduced, it would anyway
need to walk the hierarchy and apply the supplied regexp to each pathname it
visits.
Please also note that using a regexp for what you're after looks like an
overkill to me: a simple
strings.EqualFold(filepath.Ext(fname), "mp4")
in the callback function to fs.WalkDir wold convey the intent better, IMO.
In any case, such a callback function to find a bunch of files matching their
extensions in a case-insensitive manner would clock at 10-15 lines, I'd say.