Birthday problem

From formulasearchengine
Revision as of 13:43, 27 January 2014 by 130.233.153.169 (talk)
Jump to navigation Jump to search

In Boolean logic, a formula is in conjunctive normal form (CNF) or clausal normal form if it is a conjunction of clauses, where a clause is a disjunction of literals; otherwise put, it is an AND of ORs. As a normal form, it is useful in automated theorem proving. It is similar to the product of sums form used in circuit theory.

All conjunctions of literals and all disjunctions of literals are in CNF, as they can be seen as conjunctions of one-literal clauses and conjunctions of a single clause, respectively. As in the disjunctive normal form (DNF), the only propositional connectives a formula in CNF can contain are and, or, and not. The not operator can only be used as part of a literal, which means that it can only precede a propositional variable or a predicate symbol.

In automated theorem proving, the notion "clausal normal form" is often used in a narrower sense, meaning a particular representation of a CNF formula as a set of sets of literals.

Examples and counterexamples

All of the following formulas are in CNF:

¬A(BC)
(AB)(¬BC¬D)(D¬E)
AB
AB

The last formula is in CNF because it can be seen as the conjunction of the two single-literal clauses A and B. Incidentally, the last two formulae are also in disjunctive normal form.

The following formulas are not in CNF:

¬(BC)
(AB)C
A(B(DE)).

The above three formulas are respectively equivalent to the following three formulas that are in CNF:

¬B¬C
(AC)(BC)
A(BD)(BE).

Conversion into CNF

Every propositional formula can be converted into an equivalent formula that is in CNF. This transformation is based on rules about logical equivalences: the double negative law, De Morgan's laws, and the distributive law.

Since all logical formulae can be converted into an equivalent formula in conjunctive normal form, proofs are often based on the assumption that all formulae are CNF. However, in some cases this conversion to CNF can lead to an exponential explosion of the formula. For example, translating the following non-CNF formula into CNF produces a formula with 2n clauses:

(X1Y1)(X2Y2)(XnYn).

In particular, the generated formula is:

(X1Xn1Xn)(X1Xn1Yn)(Y1Yn1Yn).

This formula contains 2n clauses; each clause contains either Xi or Yi for each i.

There exist transformations into CNF that avoid an exponential increase in size by preserving satisfiability rather than equivalence.[1][2] These transformations are guaranteed to only linearly increase the size of the formula, but introduce new variables. For example, the above formula can be transformed into CNF by adding variables Z1,,Zn as follows:

(Z1Zn)(¬Z1X1)(¬Z1Y1)(¬ZnXn)(¬ZnYn).

An interpretation satisfies this formula only if at least one of the new variables is true. If this variable is Zi, then both Xi and Yi are true as well. This means that every model that satisfies this formula also satisfies the original one. On the other hand, only some of the models of the original formula satisfy this one: since the Zi are not mentioned in the original formula, their values are irrelevant to satisfaction of it, which is not the case in the last formula. This means that the original formula and the result of the translation are equisatisfiable but not equivalent.

An alternative translation includes also the clauses Zi¬Xi¬Yi. With these clauses, the formula implies ZiXiYi; this formula is often regarded to "define" Zi to be a name for XiYi.

First-order logic

In first order logic, conjunctive normal form can be taken further to yield the clausal normal form of a logical formula, which can be then used to perform first-order resolution. In resolution-based automated theorem-proving, a CNF formula

( l11 l1n1 ) ( lm1 lmnm ) , with lij literals, is commonly represented as a set of sets
{ { l11 , , l1n1 } , , { lm1 , , lmnm } } .

See below for an example.

Computational complexity

An important set of problems in computational complexity involves finding assignments to the variables of a boolean formula expressed in Conjunctive Normal Form, such that the formula is true. The k-SAT problem is the problem of finding a satisfying assignment to a boolean formula expressed in CNF in which each disjunction contains at most k variables. 3-SAT is NP-complete (like any other k-SAT problem with k>2) while 2-SAT is known to have solutions in polynomial time. As a consequence,[3] the task of converting a formula into a DNF, preserving satisfiability, is NP-hard; dually, converting into CNF, preserving validity, is also NP-hard; hence equivalence-preserving conversion into DNF or CNF is again NP-hard.

Typical problems in this case involve formulas in "3CNF": conjunctive normal form with no more than three variables per conjunct. Examples of such formulas encountered in practice can be very large, for example with 100,000 variables and 1,000,000 conjuncts.

A formula in CNF can be converted into an equisatisfiable formula in "kCNF" (for k>=3) by replacing each conjunct with more than k variables X1XkXn by two conjuncts X1Xk1Z and ¬ZXkXn with Z a new variable, and repeating as often as necessary.

Converting from first-order logic

To convert first-order logic to CNF:[4]

  1. Convert to negation normal form.
    1. Eliminate implications and equivalences: repeatedly replace PQ with ¬PQ; replace PQ with (P¬Q)(¬PQ). Eventually, this will eliminate all occurrences of and .
    2. Move NOTs inwards by repeatedly applying De Morgan's Law. Specifically, replace ¬(PQ) with (¬P)(¬Q); replace ¬(PQ) with (¬P)(¬Q); and replace ¬¬P with P; replace ¬(xP(x)) with x¬P(x); ¬(xP(x)) with x¬P(x). After that, a ¬ may occur only immediately before a predicate symbol.
  2. Standardize variables
    1. For sentences like (xP(x))(xQ(x)) which use the same variable name twice, change the name of one of the variables. This avoids confusion later when dropping quantifiers later. For example, x[yAnimal(y)¬Loves(x,y)][yLoves(y,x)] is renamed to x[yAnimal(y)¬Loves(x,y)][zLoves(z,x)].
  3. Skolemize the statement
    1. Move quantifiers outwards: repeatedly replace P(xQ(x)) with x(PQ(x)); replace P(xQ(x)) with x(PQ(x)); replace P(xQ(x)) with x(PQ(x)); replace P(xQ(x)) with x(PQ(x)). These replacements preserve equivalence, since the previous variable standardization step ensured that x doesn't occur in P. After these replacements, a quantifier may occur only in the initial prefix of the formula, but never inside a ¬, , or .
    2. Repeatedly replace x1xnyP(y) with x1xnP(f(x1,,xn)), where f is a new n-ary function symbol, a so-called "skolem function". This is the only step that preserves only satisfiability rather than equivalence. It eliminates all existential quantifiers.
  4. Drop all universal quantifiers.
  5. Distribute ORs inwards over ANDs: repeatedly replace P(QR) with (PQ)(PR).

As an example, the formula saying "Who loves all animals, is in turn loved by someone" is converted into CNF (and subsequently into clause form in the last line) as follows (highlighting replacement rule redices in red):

x ( y Animal( y ) Loves(x, y ) ) ( y Loves( y ,x) )
x ( y ¬ Animal( y ) Loves(x, y ) ) ( y Loves( y ,x) ) by 1.1
x ¬ ( y ¬ Animal( y ) Loves(x, y ) ) ( y Loves( y ,x) ) by 1.1
x ( y ¬ ( ¬ Animal( y ) Loves(x, y ) ) ) ( y Loves( y ,x) ) by 1.2
x ( y ¬ ¬ Animal( y ) ¬ Loves(x, y ) ) ( y Loves( y ,x) ) by 1.2
x ( y Animal( y ) ¬ Loves(x, y ) ) ( y Loves( y ,x) ) by 1.2
x ( y Animal( y ) ¬ Loves(x, y ) ) ( z Loves( z ,x) ) by 2
x z ( y Animal( y ) ¬ Loves(x, y ) ) Loves( z ,x) by 3.1
x z y ( Animal( y ) ¬ Loves(x, y ) ) Loves( z ,x) by 3.1
x y ( Animal( y ) ¬ Loves(x, y ) ) Loves( g(x) ,x) by 3.2
( Animal( f(x) ) ¬ Loves(x, f(x) ) ) Loves( g(x) ,x) by 4
( Animal( f(x) ) Loves( g(x) ,x) ) ( ¬Loves(x,f(x)) Loves(g(x),x) ) by 5
{ { Animal( f(x) ) , Loves( g(x) ,x) } , { ¬Loves(x,f(x)) , Loves(g(x),x) } } (clause representation)

Informally, the skolem function g(x) can be thought of as yielding the person by whom x is loved, while f(x) yields the animal (if any) that x doesn't love. The 3rd last line from below then reads as "x doesn't love the animal f(x), or else x is loved by g(x)".

The 2nd last line from above, (Animal(f(x))Loves(g(x),x))(¬Loves(x,f(x))Loves(g(x),x)), is the CNF.

Notes

  1. Tseitin (1968)
  2. Jackson and Sheridan (2004)
  3. since one way to check a CNF for satisfiability is to convert it into a DNF, the satisfiability of which can be checked in linear time
  4. Artificial Intelligence: A modern Approach [1995...] Russel and Norvig

See also

References

  • Paul Jackson, Daniel Sheridan: Clause Form Conversions for Boolean Circuits. In: Holger H. Hoos, David G. Mitchell (Eds.): Theory and Applications of Satisfiability Testing, 7th International Conference, SAT 2004, Vancouver, BC, Canada, May 10–13, 2004, Revised Selected Papers. Lecture Notes in Computer Science 3542, Springer 2005, pp. 183–198
  • G.S. Tseitin: On the complexity of derivation in propositional calculus. In: Slisenko, A.O. (ed.) Structures in Constructive Mathematics and Mathematical Logic, Part II, Seminars in Mathematics (translated from Russian), pp. 115–125. Steklov Mathematical Institute (1968)

External links