Laboratoire ICAR » Plateforme TXM

remove the "-" at the end of words.

Index of ".+-" [] gives :

eux-    mêmes
...
ex-    dictateur
...
mi-    sur
...
porte-    data
porte-    avions
...

Such words are encoded in the TRS files with spaces eg. "porte- data", "ex- dictateur"

Solution¶

Fix the TRS files

Solution 2¶

implement tokenizing rules to merge the necessary tokens

Apply spell checker software on TRS files.

The spell checker must manage a dictionary of compound words, with '-' inside.