Insight grammar learning using pro- and anti-Unification

This web demo accompanies the paper:

Steels, L. and P. Van Eecke (2016). Insight grammar learning using pro- and anti-unification. Under Review.

Explanations on how to use this demo are here.

Menu:

WD-1. Transient structure.

WD-2. Construction schema.

WD-3. Search space comprehension.

WD-4. Search space production.

WD-5. Handing agreement failure using variable decoupling.

WD-6. Handling word order deviation using variable decoupling.

WD-7. Handling mismatch in feature values using Value Relaxation

WD-8. Unit and feature or predicate deletion

WD-9. Consolidating a new word order using pro-unification

WD-10. Consolidating a simpler construction using pro-unification

WD-11. Experimental results.


1. BACKGROUND

1.1. Basic components of FCG

WD-1:

(a) A transient structure contains all that is known about the utterance at a particular stage of processing.

Click on the cross in the circle to see details.

Back to menu

WD-2:

(b) Construction schemas represent constructions. Here are some examples from French.

Click on a box to see details.

Back to menu


1.2. Routine language processing

WD-3:

(a) Search Space Comprehension


Comprehending "un petit dīner"


Applying
in comprehension


initial structure
application process
applied constructions
resulting structure

Meaning:

gstruct0(statusindefinite?x-152)struct1(sizesmall?x-152)struct0:varXdash1521->struct1:varXdash1522struct2(mealdinner?x-152)struct1:varXdash1522->struct2:varXdash1523

Back to menu

WD-4:

b. Search Space Production


Formulating 

gstruct0(mealdinnerdinner-1)struct1(sizesmalldinner-1)struct0:DINNERdash11->struct1:DINNERdash12struct2(statusindefinitedinner-1)struct1:DINNERdash12->struct2:DINNERdash13

Applying
in formulation


initial structure
application process
applied constructions
resulting structure

Utterance: "un petit dīner"

Back to menu


2. ANTI-UNIFICATION

2.1. Variable decoupling

The same variable occurs more than once in the pattern but corresponds to different values in the source. In this case, this variable can be split into different variables for each case.

WD-5:

Example 1: Handling agreement failure by variable decoupling

The utterance `un petit fille' (a small girl) cannot be parsed due to a conflict in gender between article, adjective, noun.


Comprehending "un petit fille"


Applying
in comprehension


initial structure
application process
applied constructions
resulting structure

Meaning:

gstruct0(statusindefinite?x-204)struct1(sizesmall?x-203)struct2(persongirl?x-207)

The NP construction has not applied and therefore the meaning supplied by individual words is not properly connected.

Computing generalized construction using anti-unification:

Resulting anti-unified construction:

Note how this generalization has different variables for the gender feature between the noun, and the article and adjective.

When we apply this generalized construction we get a connected interpretable meaning, which implies that the generalized construction could Match with the transient structure and Merge. Here is the final transient structure

And its derived meaning:

gstruct0(statusindefinite?x-223)struct1(sizesmall?x-223)struct0:varXdash2231->struct1:varXdash2232struct2(persongirl?x-223)struct1:varXdash2232->struct2:varXdash2233

Back to menu


WD-6:

Example 2: Handling word order deviation by variable decoupling

The utterance `un dīner formidable' (a formidable dinner) cannot be parsed due to deviant constituent order according to the current grammar (NP-CXN).

Failure in parsing:


Comprehending "un dīner formidable"


Applying
in comprehension


initial structure
application process
applied constructions
resulting structure

Meaning:

gstruct0(statusindefinite?x-250)struct1(qualitysplendid?x-247)struct2(mealdinner?x-252)

The NP construction has not applied and therefore the meaning supplied by individual words is not properly connected.

Computing generalized construction using anti-unification:

Note how this generalization has different variables within the meets constraints.

When we apply this generalized construction we get a correct interpretable meaning, which implies that the generalized construction could Match with the transient structure and Merge. Here is the final transient structure:

And the derived meaning:

gstruct0(statusindefinite?x-269)struct1(qualitysplendid?x-269)struct0:varXdash2691->struct1:varXdash2692struct2(mealdinner?x-269)struct1:varXdash2692->struct2:varXdash2693

Back to menu


WD-7:

2.2. Value relaxation

Example 3: Handle mismatch in feature values through value relaxation.

Value-relaxation means that there is a different value for a particular feature in the pattern and in the source. It is resolved by assuming that the value is a variable in the more general pattern.

English Grammar fragment used in this example:

`The children' is comprehended correctly, but processing `many children' gets stuck.


Comprehending "the children"


Applying
in comprehension


initial structure
application process
applied constructions
resulting structure

Meaning:

gstruct0(peoplechildren?x-288)struct1(statusdefinite?x-288)struct0:varXdash2881->struct1:varXdash2882


Comprehending "many children"


Applying
in comprehension


initial structure
application process
applied constructions
resulting structure

Meaning:

gstruct0(peoplechildren?x-295)struct1(statusindefinite-set?x-296)

The NP-cxn could not apply because the feature because the determiner ?det expects an article as lex-cat. We now anti-unify the NP-cxn with the final transient structure. It creates a new construction where the lex-cat feature is variable.

Anti-unified NP-cxn:

Transient structure after applicaton of the anti-unified construction:

And the derived meaning:

gstruct0(statusindefinite-set?x-311)struct1(peoplechildren?x-311)struct0:varXdash3111->struct1:varXdash3112

Back to menu


WD-8:

2.3 Unit, feature and predicate deletion

Example 4. Leaving out a unit and features or predicates.

The NP-cxn cannot apply to the utterance 'une fille', as it needs an article, an adjective and a noun.

Original construction:

Transient Structure:

By anti-unifying the construction with the transient structure, we get a new construction which only requires two units. Note that the ordering constraints are generalised to an unbound variable.

Anti-unified construction:

Back to menu


3. PRO-UNIFICATION

WD-9:

Example 6. Consolidating a new constituent order.

The word order of the input utterance `un dīner formidable' conflicts with the word order specified in the NP-cxn. Anti-unification helps to arrive at an interpretation and then pro-unification is used to consolidate this repair.

Original Construction:

Transient Structure:

We will now anti-unify the construction with the transient structure. The word order (meets constraints) or now generalised to unbound variables.

Anti-unified Construction:

We will now use pro-unification to constrain the anti-unified construction towards the transient structure. We can see in the meets constraints that the word order is learned.

Pro-unified Construction:

Application Result of the pro-unified construction on the transient structure:



gstruct0(statusindefinite?x-346)struct1(qualitysplendid?x-346)struct0:varXdash3461->struct1:varXdash3462struct2(mealdinner?x-346)struct1:varXdash3462->struct2:varXdash3463

Demonstration of the use of the pro-unified construction in formulation:


Formulating (max 2 solutions) 

gstruct0(qualitysplendido-1)struct1(statusindefiniteo-1)struct0:Odash11->struct1:Odash12struct2(mealdinnero-1)struct1:Odash12->struct2:Odash13

Computing max 2 solutions for application of
in formulation


initial structure
application process
solution 1
applied constructions
resulting structure
solution 2
applied constructions
resulting structure

Utterances: "un dīner formidable, un formidable dīner"

Back to menu


Example 7. Creating a new construction with one unit less using pro-unification

WD-10:

Original construction:

Transient Structure:

By anti-unifying the construction with the transient structure, we get a new construction which only requires two units. Note that the ordering constraints are generalised to an unbound variable.

Anti-unified construction:

Now, we pro-unify the anti-unified np-cxn with the transient structure. The ordering constraints that are learned in this construction is that the article should immediately preceed the noun.

Pro-unified construction:

Result:



gstruct0(statusindefinite?x-390)struct1(persongirl?x-390)struct0:varXdash3901->struct1:varXdash3902



The learned construction can now also be used in formulation.


Added  
to  


Formulating 

gstruct0(persongirlo-1)struct1(statusindefiniteo-1)struct0:Odash11->struct1:Odash12

Applying
in formulation


initial structure
application process
applied constructions
resulting structure

Utterance: "une fille"

Back to menu


4. RESULTS

WD-11:

We carried out experiments with three sets of French utterances: (i) utterances that can be parsed by the initial grammar, (ii) utterances that are novel but grammatical in French and can be learned, and (iii) non-grammatical utterances which should not be parsable. Below are some examples of the constructions generalized through anti-unification and then pro-unified or not.

For the experiment reported in the paper, the following three anti-unified and pro-unified NP-constructions were generated:

For the experiment with anti-unification only:

An anti-unified NP-cxn with relaxed gender constraints to accommodate for the sentence 'une petite fille'.'

An anti-unified NP-cxn with relaxed form constraints and relaxed gender constraints. It was made for the utterance 'une semaine bouleversante'

An anti-unified NP-cxn for NPs without adjective. It does not constrain the the gender of article and noun to be equal, nor to be adjacent. It was made for the utterance 'une feuille'

For the experiment with anti-unification and pro-unification

A pro-unified NP-cxn for noun phrases in which article, ajective and noun have the same gender and occur in this order, e.g. la petite fille.

A pro-unified NP-cxn for noun phrases in which article, noun and adjective have the same gender and occur in this order, e.g. une semaine bouleversante

A pro-unified NP-cxn for NPs without adjective. Article and noun should have the same gender. It was made for the utterance 'une feuille'