Try:
view.on("mousedown", function(event, item) { if(event.button == 3){ ... } })
For example, in the Vega online example "shiftclick-select" at
try changing the line
"streams": [{"type": "click", "expr": "event.shiftKey"}]
to:
"streams": [{"type": "mousedown", "expr": "event.button == 3"}]
Notes:
1. event.button == 3 works on my computer (Windows 7, IE11 / Google Chrome 53.0.2785.116 m)
(event.button == 2 did not work for me but may work on other computers).
See:
2. The browser also shows it's own context pop-up menu with right click.