Feature #1779
TBX: 0.7.7, tokenizer must handle common cases
Status: | New | Start date: | 04/13/2016 | |
---|---|---|---|---|
Priority: | Normal | Due date: | ||
Assignee: | - | % Done: | 0% |
|
Category: | TAL | Spent time: | - | |
Target version: | TXM X.X |
Description
Better tokenize common cases:
- numbers such as 2.3.3, 200 000, or 2,4
- "CDU/CSU-Koalition"
History
#1 Updated by Sebastien Jacquot over 2 years ago
- Target version changed from TXM 0.8.0a (split/restructuration) to TXM 0.8.0
#2 Updated by Matthieu Decorde almost 2 years ago
- Target version changed from TXM 0.8.0 to TXM X.X