No, the problem is not the way you're building the keymap, but how
keymaps are searched.
From (info "(elisp) Searching Keymaps")
> (or (cond
> (overriding-terminal-local-map
> (FIND-IN overriding-terminal-local-map))
> (overriding-local-map
> (FIND-IN overriding-local-map))
> ((or (FIND-IN (get-char-property (point) 'keymap))
> (FIND-IN TEMP-MAP)
> (FIND-IN-ANY emulation-mode-map-alists)
> (FIND-IN-ANY minor-mode-overriding-map-alist)
> (FIND-IN-ANY minor-mode-map-alist)
> (if (get-text-property (point) 'local-map)
> (FIND-IN (get-char-property (point) 'local-map))
> (FIND-IN (current-local-map))))))
> (FIND-IN (current-global-map)))
It searches through `minor-mode-map-alist' _before_ looking at
`current-local-map'.
I could use `overriding-local-map' instead of `current-local-map' if it
was a buffer local variable. But it's not, and I'm afraid that making it
buffer local might break things in a weird way.
>>
>> I've looked at the documentation and it seems that changing the order in
>> `minor-mode-map-alist' is the only way to manage priorities between
>> keymap, because they shouldn't conflict in there first place.
--
Daimrod/Greg