Extending choice assessments to choice functions: An algorithm for computing the natural extension

Read original: arXiv:2407.21164 - Published 8/1/2024 by Arne Decadt, Alexander Erreygers, Jasper De Bock
Total Score

0

🔍

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Researchers study how to infer new choices from prior choices using the framework of choice functions
  • Choice functions provide a unified mathematical framework for decision-making based on sets of preference orders
  • The paper defines the natural (most conservative) extension of a given choice assessment to a coherent choice function, and uses this to make new choices
  • A practical algorithm is provided for computing this natural extension, with ways to improve scalability
  • The algorithms are tested on different types of choice assessments

Plain English Explanation

In this research, the authors explore how to use past choices to infer new choices. They do this using a mathematical framework called choice functions, which provides a unified way to model decision-making based on preferences.

The key idea is to define the "natural" or most conservative way to extend a given set of choices to a coherent choice function. This natural extension is then used to make new choices that are consistent with the original preferences.

The paper provides an algorithm for computing this natural extension, and discusses ways to make the process more scalable and efficient. Finally, the researchers test their approach on different types of choice assessments to see how well it works.

The goal is to develop a systematic way to leverage past decisions to make new ones, using a principled mathematical framework. This could have applications in areas like recommender systems and AI decision-making.

Technical Explanation

The researchers present a framework for choice function inference, which allows inferring new choices from prior choices. Choice functions provide a general mathematical model for decision-making based on sets of preference orders.

The key contribution is defining the "natural" or most conservative extension of a given choice assessment to a coherent choice function. This natural extension is then used to make new choices that are consistent with the original preferences.

The paper provides a practical algorithm for computing this natural extension, as well as techniques to improve the scalability of the approach. Experimental results are presented for different types of choice assessments.

Critical Analysis

The paper provides a principled framework for leveraging past choices to make new decisions. By defining the "natural" extension of a choice assessment, the approach aims to make new choices that are maximally consistent with the original preferences.

One potential limitation is the reliance on the concept of a "coherent" choice function, which may not always match real-world decision-making. There could be cases where inconsistent or context-dependent preferences are important.

Additionally, the computational challenges of this approach, especially for large-scale problems, are not fully addressed. The scalability techniques mentioned may help, but the overall complexity could still be a practical concern.

Further research could explore relaxing some of the assumptions, such as the requirement for coherence, and investigating more efficient algorithms. Validation on real-world datasets would also help assess the practical applicability of this framework.

Overall, the paper presents an interesting theoretical framework with potential applications in recommender systems and AI decision-making. Continued research and refinement could lead to more robust and practical choice inference techniques.

Conclusion

This research explores a framework for inferring new choices from prior choices using the mathematical concept of choice functions. By defining the "natural" extension of a given choice assessment to a coherent choice function, the authors provide a principled way to make new decisions that are consistent with past preferences.

The practical algorithms and scalability techniques presented in the paper could have applications in areas like recommender systems and AI decision-making. However, some limitations related to the coherence assumption and computational complexity may need further investigation.

Overall, this research contributes to the broader effort of developing systematic and principled methods for decision-making based on past choices, with potential implications for both theoretical and applied domains.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔍

Total Score

0

Extending choice assessments to choice functions: An algorithm for computing the natural extension

Arne Decadt, Alexander Erreygers, Jasper De Bock

We study how to infer new choices from prior choices using the framework of choice functions, a unifying mathematical framework for decision-making based on sets of preference orders. In particular, we define the natural (most conservative) extension of a given choice assessment to a coherent choice function -- whenever possible -- and use this natural extension to make new choices. We provide a practical algorithm for computing this natural extension and various ways to improve scalability. Finally, we test these algorithms for different types of choice assessments.

Read more

8/1/2024

An incremental preference elicitation-based approach to learning potentially non-monotonic preferences in multi-criteria sorting
Total Score

0

An incremental preference elicitation-based approach to learning potentially non-monotonic preferences in multi-criteria sorting

Zhuolin Li, Zhen Zhang, Witold Pedrycz

This paper introduces a novel incremental preference elicitation-based approach to learning potentially non-monotonic preferences in multi-criteria sorting (MCS) problems, enabling decision makers to progressively provide assignment example preference information. Specifically, we first construct a max-margin optimization-based model to model potentially non-monotonic preferences and inconsistent assignment example preference information in each iteration of the incremental preference elicitation process. Using the optimal objective function value of the max-margin optimization-based model, we devise information amount measurement methods and question selection strategies to pinpoint the most informative alternative in each iteration within the framework of uncertainty sampling in active learning. Once the termination criterion is satisfied, the sorting result for non-reference alternatives can be determined through the use of two optimization models, i.e., the max-margin optimization-based model and the complexity controlling optimization model. Subsequently, two incremental preference elicitation-based algorithms are developed to learn potentially non-monotonic preferences, considering different termination criteria. Ultimately, we apply the proposed approach to a credit rating problem to elucidate the detailed implementation steps, and perform computational experiments on both artificial and real-world data sets to compare the proposed question selection strategies with several benchmark strategies.

Read more

9/5/2024

Social Choice for AI Alignment: Dealing with Diverse Human Feedback
Total Score

0

Social Choice for AI Alignment: Dealing with Diverse Human Feedback

Vincent Conitzer, Rachel Freedman, Jobst Heitzig, Wesley H. Holliday, Bob M. Jacobs, Nathan Lambert, Milan Moss'e, Eric Pacuit, Stuart Russell, Hailey Schoelkopf, Emanuel Tewolde, William S. Zwicker

Foundation models such as GPT-4 are fine-tuned to avoid unsafe or otherwise problematic behavior, such as helping to commit crimes or producing racist text. One approach to fine-tuning, called reinforcement learning from human feedback, learns from humans' expressed preferences over multiple outputs. Another approach is constitutional AI, in which the input from humans is a list of high-level principles. But how do we deal with potentially diverging input from humans? How can we aggregate the input into consistent data about collective preferences or otherwise use it to make collective choices about model behavior? In this paper, we argue that the field of social choice is well positioned to address these questions, and we discuss ways forward for this agenda, drawing on discussions in a recent workshop on Social Choice for AI Ethics and Safety held in Berkeley, CA, USA in December 2023.

Read more

6/5/2024

🔗

Total Score

0

Operator-based semantics for choice programs: is choosing losing? (full version)

Jesse Heyninck

Choice constructs are an important part of the language of logic programming, yet the study of their semantics has been a challenging task. So far, only two-valued semantics have been studied, and the different proposals for such semantics have not been compared in a principled way. In this paper, an operator-based framework allow for the definition and comparison of different semantics in a principled way is proposed.

Read more

8/1/2024