Misalignment

[djbpitt]

In CollateX Python 2.1.3rc2, the input:

from collatex import *
collation = Collation()
collation.add_plain_witness("A", "The big, gray, fuzzy koala.")
collation.add_plain_witness("B","The big, old, gray koala:")
collation.add_plain_witness("C","The big, gray, fuzzy wombat.")
table = collate(collation, segmentation=False, near_match=True)
print(table)

produces (with or without near matching):

+---+-----+-----+---+------+---+-------+--------+---+
| A | The | big | , | gray | , | fuzzy | koala  | . |
| B | The | big | , | old  | , | gray  | koala  | : |
| C | The | big | , | gray | , | fuzzy | wombat | . |
+---+-----+-----+---+------+---+-------+--------+---+

This fails to align “gray”, which matches exactly in all witnesses. The desired alignment is:

+---+-----+-----+---+------+---+------+---+-------+--------+---+
| A | The | big | , |      |   | gray | , | fuzzy | koala  | . |
| B | The | big | , | old  | , | gray |   |       | koala  | : |
| C | The | big | , |      |   | gray | , | fuzzy | wombat | . |
+---+-----+-----+---+------+---+------+---+-------+--------+---+

This appears to be a transposition situation, where CollateX aligns the commas in preference to the words. A philologist would prioritize aligning the words.

[rhdekker]

There are no token types in the Gothenburg model. The aligner does not know what punctuation is or what words are for that matter. If this feature is desired the model would need to be extended and the implementation(s) updated.

[tla]

This is a great use case for the suggestion I just made in #69 :)