Funny, I just came here to ask the same question.
I know one approach is to configure Jenkins to use the Unix user/group database for authentication, and then configure your system to use LDAP to authenticate. For example, you can use sssd if you're running CentOS/RHEL.
However, I'd prefer not to allow everyone to log into my Jenkins box. Wondering if there's another solution.