Feature #1779
TBX: 0.7.7, tokenizer must handle common cases
| Status: | New | Start date: | 04/13/2016 | |
|---|---|---|---|---|
| Priority: | Normal | Due date: | ||
| Assignee: | - | % Done: | 0% |
|
| Category: | TAL | Spent time: | - | |
| Target version: | TXM X.X |
Description
Better tokenize common cases:
- numbers such as 2.3.3, 200 000, or 2,4
- "CDU/CSU-Koalition"
History
#1 Updated by Sebastien Jacquot about 1 year ago
- Target version changed from TXM 0.8.0a (split/restructuration) to TXM 0.8.0
#2 Updated by Matthieu Decorde 5 months ago
- Target version changed from TXM 0.8.0 to TXM X.X