Gaussian Processes with Monotonicity Constraints for Preference Learning from Pairwise Comparisons

In preference learning, it is beneficial to incorporate monotonicity constraints for learning utility functions when there is prior knowledge of monotonicity. We present a novel method for learning utility functions with monotonicity constraints using Gaussian process regression. Data is provided in the form of pairwise comparisons between items. Using conditions on monotonicity for the predictive function, an algorithm is proposed which uses the weighted average between prior linear and maximum a posteriori (MAP) utility estimates. This algorithm is formally shown to guarantee monotonicity of the learned utility function in the dimensions desired. The algorithm is tested in a Monte Carlo simulation case study, in which the results suggest that the learned utility by the proposed algorithm performs better in prediction than the standalone linear estimate, and enforces monotonicity unlike the MAP estimate.