I just had this exact problem. Hopefully this is helpful to anyone else who comes across this thread.
An empty list is falsey, so
mylist|selectattr('list')
should get what you're looking for, and
mylist|rejectattr('list')
would return elements that have an empty list.