LinSATNet: The Positive Linear Satisfiability Neural Networks

Read original: arXiv:2407.13917 - Published 7/22/2024 by Runzhong Wang, Yunhao Zhang, Ziao Guo, Tianyi Chen, Xiaokang Yang, Junchi Yan
Total Score

0

LinSATNet: The Positive Linear Satisfiability Neural Networks

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper introduces LinSATNet, a novel neural network architecture for solving the Boolean satisfiability (SAT) problem.
  • LinSATNet utilizes a linear activation function instead of the typical nonlinear activation functions used in neural networks.
  • The authors demonstrate that LinSATNet outperforms state-of-the-art SAT solvers on a range of benchmark tasks.

Plain English Explanation

The Boolean satisfiability (SAT) problem is a fundamental problem in computer science that involves determining whether a given set of logical statements can be satisfied by assigning values to the variables in those statements. This problem has many important applications, such as in software verification, circuit design, and artificial intelligence.

The authors of this paper have developed a new type of neural network called LinSATNet that is specifically designed to solve the SAT problem. Traditional neural networks use nonlinear activation functions, such as the sigmoid or ReLU functions, to transform the inputs and propagate information through the network. In contrast, LinSATNet uses a linear activation function, which means that the outputs of the network are simply a linear combination of the inputs.

The key insight behind LinSATNet is that the SAT problem can be formulated as a system of linear inequalities, and that a linear activation function is well-suited to solving this type of problem. By using a linear activation function, the authors were able to design a neural network architecture that is more efficient and effective at solving SAT problems than traditional approaches, such as GRASS and G4SAT-Bench.

Technical Explanation

The core of the LinSATNet architecture is a set of linear layers that are designed to capture the structure of the SAT problem. The input to the network is a set of Boolean variables and the corresponding logical clauses that define the SAT problem. The network then learns a set of weights that map these inputs to a set of output variables that represent the satisfying assignment, if one exists.

To train the network, the authors use a specialized loss function that encourages the network to output a satisfying assignment, or to indicate that no such assignment exists. This loss function is designed to be compatible with the linear activation function used in LinSATNet, and the authors show that it is more effective than traditional loss functions for SAT problems.

The authors evaluate LinSATNet on a range of benchmark SAT problems, including hard combinatorial problems and industrial-scale SAT instances. They show that LinSATNet outperforms state-of-the-art SAT solvers, including TLINet and GRASS, in terms of both runtime and solution quality.

Critical Analysis

The authors acknowledge several limitations of their approach. First, LinSATNet is designed to solve only positive SAT problems, where all the logical clauses are positive (i.e., they do not contain negations). While this is a common class of SAT problems, it is not a general solution to the SAT problem.

Additionally, the authors note that LinSATNet may not be as effective on highly structured or symmetric SAT problems, where the underlying structure is not well-captured by the linear layers used in the network. In such cases, other approaches, such as G4SAT-Bench, may be more effective.

Finally, the authors note that the performance of LinSATNet is highly dependent on the choice of hyperparameters, such as the learning rate and the number of layers in the network. Tuning these hyperparameters can be a complex and time-consuming process, which may limit the practical applicability of the approach.

Conclusion

Overall, the LinSATNet architecture represents an interesting and promising approach to solving the SAT problem using neural networks. By leveraging the linear structure of the problem, the authors have developed a highly efficient and effective solver that outperforms state-of-the-art approaches on a range of benchmark tasks.

While the current limitations of the approach may prevent it from being a general solution to the SAT problem, the underlying ideas behind LinSATNet could be more broadly applicable to other optimization and decision-making problems that can be formulated as systems of linear inequalities. As such, this work represents an important contribution to the field of neural network-based optimization and decision-making.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

LinSATNet: The Positive Linear Satisfiability Neural Networks
Total Score

0

LinSATNet: The Positive Linear Satisfiability Neural Networks

Runzhong Wang, Yunhao Zhang, Ziao Guo, Tianyi Chen, Xiaokang Yang, Junchi Yan

Encoding constraints into neural networks is attractive. This paper studies how to introduce the popular positive linear satisfiability to neural networks. We propose the first differentiable satisfiability layer based on an extension of the classic Sinkhorn algorithm for jointly encoding multiple sets of marginal distributions. We further theoretically characterize the convergence property of the Sinkhorn algorithm for multiple marginals. In contrast to the sequential decision e.g. reinforcement learning-based solvers, we showcase our technique in solving constrained (specifically satisfiability) problems by one-shot neural networks, including i) a neural routing solver learned without supervision of optimal solutions; ii) a partial graph matching network handling graphs with unmatchable outliers on both sides; iii) a predictive network for financial portfolios with continuous constraints. To our knowledge, there exists no one-shot neural solver for these scenarios when they are formulated as satisfiability problems. Source code is available at https://github.com/Thinklab-SJTU/LinSATNet

Read more

7/22/2024

Learning Better Representations From Less Data For Propositional Satisfiability
Total Score

0

Learning Better Representations From Less Data For Propositional Satisfiability

Mohamed Ghanem, Frederik Schmitt, Julian Siber, Bernd Finkbeiner

Training neural networks on NP-complete problems typically demands very large amounts of training data and often needs to be coupled with computationally expensive symbolic verifiers to ensure output correctness. In this paper, we present NeuRes, a neuro-symbolic approach to address both challenges for propositional satisfiability, being the quintessential NP-complete problem. By combining certificate-driven training and expert iteration, our model learns better representations than models trained for classification only, with a much higher data efficiency -- requiring orders of magnitude less training data. NeuRes employs propositional resolution as a proof system to generate proofs of unsatisfiability and to accelerate the process of finding satisfying truth assignments, exploring both possibilities in parallel. To realize this, we propose an attention-based architecture that autoregressively selects pairs of clauses from a dynamic formula embedding to derive new clauses. Furthermore, we employ expert iteration whereby model-generated proofs progressively replace longer teacher proofs as the new ground truth. This enables our model to reduce a dataset of proofs generated by an advanced solver by ~32% after training on it with no extra guidance. This shows that NeuRes is not limited by the optimality of the teacher algorithm owing to its self-improving workflow. We show that our model achieves far better performance than NeuroSAT in terms of both correctly classified and proven instances.

Read more

5/30/2024

GraSS: Combining Graph Neural Networks with Expert Knowledge for SAT Solver Selection
Total Score

0

GraSS: Combining Graph Neural Networks with Expert Knowledge for SAT Solver Selection

Zhanguang Zhang, Didier Chetelat, Joseph Cotnareanu, Amur Ghose, Wenyi Xiao, Hui-Ling Zhen, Yingxue Zhang, Jianye Hao, Mark Coates, Mingxuan Yuan

Boolean satisfiability (SAT) problems are routinely solved by SAT solvers in real-life applications, yet solving time can vary drastically between solvers for the same instance. This has motivated research into machine learning models that can predict, for a given SAT instance, which solver to select among several options. Existing SAT solver selection methods all rely on some hand-picked instance features, which are costly to compute and ignore the structural information in SAT graphs. In this paper we present GraSS, a novel approach for automatic SAT solver selection based on tripartite graph representations of instances and a heterogeneous graph neural network (GNN) model. While GNNs have been previously adopted in other SAT-related tasks, they do not incorporate any domain-specific knowledge and ignore the runtime variation introduced by different clause orders. We enrich the graph representation with domain-specific decisions, such as novel node feature design, positional encodings for clauses in the graph, a GNN architecture tailored to our tripartite graphs and a runtime-sensitive loss function. Through extensive experiments, we demonstrate that this combination of raw representations and domain-specific choices leads to improvements in runtime for a pool of seven state-of-the-art solvers on both an industrial circuit design benchmark, and on instances from the 20-year Anniversary Track of the 2022 SAT Competition.

Read more

5/21/2024

Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networks
Total Score

0

Learning to Solve Combinatorial Optimization under Positive Linear Constraints via Non-Autoregressive Neural Networks

Runzhong Wang, Yang Li, Junchi Yan, Xiaokang Yang

Combinatorial optimization (CO) is the fundamental problem at the intersection of computer science, applied mathematics, etc. The inherent hardness in CO problems brings up challenge for solving CO exactly, making deep-neural-network-based solvers a research frontier. In this paper, we design a family of non-autoregressive neural networks to solve CO problems under positive linear constraints with the following merits. First, the positive linear constraint covers a wide range of CO problems, indicating that our approach breaks the generality bottleneck of existing non-autoregressive networks. Second, compared to existing autoregressive neural network solvers, our non-autoregressive networks have the advantages of higher efficiency and preserving permutation invariance. Third, our offline unsupervised learning has lower demand on high-quality labels, getting rid of the demand of optimal labels in supervised learning. Fourth, our online differentiable search method significantly improves the generalizability of our neural network solver to unseen problems. We validate the effectiveness of this framework in solving representative CO problems including facility location, max-set covering, and traveling salesman problem. Our non-autoregressive neural solvers are competitive to and can be even superior to state-of-the-art solvers such as SCIP and Gurobi, especially when both efficiency and efficacy are considered. Code is available at https://github.com/Thinklab-SJTU/NAR-CO-Solver

Read more

9/10/2024