My understanding is that adding a go.mod file is a good idea even for
low-level libraries, in that it gives you a way to set a version
number for your library that your users will be able to use. You can
then increment the version number as appropriate to indicate patches,
minor updates, or even major version updates. See
https://blog.golang.org/migrating-to-go-modules for more background on
turning your library into a module.
Of course, if you plan to never change your library again, or if the
library has no users, then this doesn't matter.
Ian