Aligning Language Models with General Preferences: An Empirical Study of Direct Nash Optimization

Direct Nash Optimization (DNO) aligns a language model to a general preference function by approximating the Nash equilibrium of a two-player preferen…

Continue in Briflio to read, react, comment, and share.