Preserve position of TextType

[dishmint]

LexicalCases/FaizonZaman/LexicalCases/Kernel/LexicalCases.wl

Line 263 in 8fb6d24

ContentAssociation[sourcetext_String, se_] :=

Currently, all instances of a text type will be merged into a single Alternatives. This is imprecise.

If I have LexicalPattern[TextType["Noun"]~~TextType["Verb"]~~TextType["Noun"]], the noun TTs in positions 1 and 3 will match the same set of nouns. A precise lexical pattern shouldn't work this way — each noun TT should only match nouns that actually occur in those positions. To make this work with the current implementation, it probably requires additional positional checks.

A successful TT match is one where the TT occurs in the same sequence position in the source text as it does in the lexical pattern.

The whole point of grabbing all TT instances first, is that the alternative is slow. Hopefully performing this check doesn't add too much overhead.

[dishmint]

Holding off on this one for now — I don't have an efficient design yet.