3 thoughts on this.
1. Rather than putting this directly into /etc/nsm/rules/bpf.conf, you should put this into one of the symlinked files instead, such as /etc/nsm/<interface>/bpf-ids.conf
2. Presuming you have other entries in your filter network, they should all end in && except the last item. e.g.
!(host 10.1.1.11)&&
!(dst host 10.1.1.12 && src port 53)&&
!(src host 10.1.1.13 && dst port 22)
3. On the chance you are copy/pasting from a windows device, End of Line formatting must use the Unix/Posix format. Mac and Linux use only Line Feed to signify eol, Windows uses CR/LF, which adds extra whitespace to the end of the line. If you are editing this directly in Nono, Vi, or another Linux editor you should be fine. If you need to include windows in the mix, something like notepadd++ has an option to choose which eol format you wish to use.