The existing I420ToARGB code should easily adapt to J420ToARGB, given the new matrix values.
Mainly need to work out the coefficients.
We're really trying for jpeg compatible color space, hence the J, so the math is derived from jccolor.c
row_common.cc has comments about the J420 math:
// JPeg uses a variation on BT.601-1 full range
// y = 0.29900 * r + 0.58700 * g + 0.11400 * b
// u = -0.16874 * r - 0.33126 * g + 0.50000 * b + center
// v = 0.50000 * r - 0.41869 * g - 0.08131 * b + center
So the opposite would be in jdcolor.c