2026-10-11T11:39:22Z https://www.scidb.cn/oai

10.57760/sciencedb.27832 2026-02-27T09:34:55Z

2026-02-27 TVA: A Triadic Gradient Preference Dataset for Value Alignment in Large Language Models doi:10.57760/sciencedb.27832 en The TVA dataset contains 7689 values aligned ternary gradient preference data, with a size of 21.6MB, stored in JSON format. Each sample has four attributes: instruction, outputted as good, outputted as medium, and outputted as bad, corresponding to instruction, superior response, intermediate response, and inferior response, respectively. According to the rating verification of the large model, each triplet can be divided into three sets of binary preference data, totaling 23067 pieces of data, to facilitate model training. All samples have been cleaned and desensitized. As the dataset contains negative and inferior samples used for violations, it is recommended to strictly follow the guidelines for academic research and safety alignment training only.  Large Language Model; Value Alignment; Triadic Gradient; Preference Learning Wang Youqi Wu Wenshe Li Yingjie Ma Ning PUBLIC https://creativecommons.org/licenses/by-nc/4.0/ dataset Science Data Bank