ORPO: Monolithic Preference Optimization without Reference Model (Paper Explained)

Description

hello there today we're looking at orpo monolithic preference optimization without reference model this is a paper by researchers of kaist AI and largely deals with alignment aligning language models and instruction tuned models in some way we'll dive into what that means also I…