Maybe you've got debug information.
Compare the output of:
$ readelf -S "some_module.ko"
On the modules of the Debian kernel and your kernel.
The debug information may add quite a few .debug_* sections with
significant size.
If there's no debug info, these sections shouldn't be present, and
the .text section should be the largest one.
Debug symbols should be stripped with:
$ make INSTALL_MOD_STRIP=1 modules_install
Or you may strip .ko modules on the live file system.
--
André Gillibert