diff options
| author | ericmarin <maarin.eric@gmail.com> | 2026-06-07 18:43:30 +0200 |
|---|---|---|
| committer | ericmarin <maarin.eric@gmail.com> | 2026-06-26 09:57:03 +0200 |
| commit | 8eb2ce59ae307984a5b40a05cefec1f7e112fb02 (patch) | |
| tree | a5883bf6a66f9cdb4e4ab71e49a6d1983a5faf1d /chapters/01-introduction.tex | |
| parent | c7e9856b051eda98ca2102549d4f03ad518d0d90 (diff) | |
| download | vein-8eb2ce59ae307984a5b40a05cefec1f7e112fb02.tar.gz vein-8eb2ce59ae307984a5b40a05cefec1f7e112fb02.zip | |
core
Diffstat (limited to 'chapters/01-introduction.tex')
| -rw-r--r-- | chapters/01-introduction.tex | 15 |
1 files changed, 7 insertions, 8 deletions
diff --git a/chapters/01-introduction.tex b/chapters/01-introduction.tex index 8b912db..fc4017a 100644 --- a/chapters/01-introduction.tex +++ b/chapters/01-introduction.tex @@ -18,20 +18,19 @@ either hold or are violated. The kind of properties that can be verified are two \item \textbf{Multi-Network}: we check if multiple neural networks satisfy a given relation. \end{itemize} An example of a Multi-Network property is equivalence between different neural networks; this -verification is crucial if we want to replace a neural network with a smaller, equivalent one. -Techniques based on specialized \textit{Satisfiability Modulo Theories} (SMT) solvers may be used in -the verification algorithm, however, as networks grow in depth and width, the number of non-linear -components, most notably the \textit{Rectified Linear Unit}\footnote{Defined as $f(x)=\max(0, x)$, where $x$ is -the input to the neuron.} (ReLU) activation function, creates an exponential search space for the -solver. Because of this issue, running a solver against a raw, unoptimized network is often -computationally prohibitive. +verification is crucial when replacing a neural network with a smaller, equivalent one. Techniques +based on specialized \textit{Satisfiability Modulo Theories} (SMT) solvers may be used in the verification +algorithm, however, as networks grow in depth and width, the number of non-linear components, most +notably the \textit{Rectified Linear Unit}\footnote{Defined as $f(x)=\max(0, x)$, where $x$ is the input to the +neuron.} (ReLU) activation function, creates an exponential search space for the solver. Because of +this issue, running a solver against a raw, unoptimized network is often computationally prohibitive. Furthermore, we lack a formal intermediate representation. Since we are not able to directly feed a neural network to a SMT solver, a sound and deterministic model of representation is needed to bridge this gap. % Solution -To address the computational bottleneck, we can perform symbolic simplification on the neural +To address the computational bottleneck, symbolic simplification is performed on the neural network as a pre-processing step to reduce the burden on the SMT solver. Considering that we can easily map the layers and neurons of neural networks to graph nodes and that the input of a SMT solver is a mathematical formula that can be represented by an \textit{Abstract Syntax Tree} (AST), we can |
