Here is a new paper coauthored with Michael Richter and Aron Tobias: Differentiable Preferences:
https://arielrubinstein.tau.ac.il/papers/differentiable_preferences.pdf
and the NotebookLM Video: https://arielrubinstein.org/papers/Diff_Without_Derivatives.mp4
