You just need to keep using the tensor() function, but with 4 entries. You need to write something like
Nopt1 = 8
Nopt2 = 8
Nmech1 = 4
Nmech2 = 4
a1 = tensor(destroy(Nopt1), qeye(Nopt2), qeye(Nmech1), qeye(Nmech2 ))
a2 = tensor(qeye(Nopt1),destroy(Nopt2), qeye(Nmech1), qeye(Nmech2 ))
b1 = tensor(qeye(Nopt1), qeye(Nopt2), destroy(Nmech1),qeye(Nmech2 ))
b2 = tensor(qeye(Nopt1), qeye(Nopt2),qeye(Nmech1), destroy(Nmech2))