Feature #1779

TBX: 0.7.7, tokenizer must handle common cases

Added by Serge Heiden about 3 years ago. Updated 3 months ago.

Status:New Start date:04/13/2016
Priority:Normal Due date:
Assignee:- % Done:

0%

Category:TAL Spent time: -
Target version:TXM X.X

Description

Better tokenize common cases:
  • numbers such as 2.3.3, 200 000, or 2,4
  • "CDU/CSU-Koalition"

History

#1 Updated by Sebastien Jacquot 12 months ago

  • Target version changed from TXM 0.8.0a (split/restructuration) to TXM 0.8.0

#2 Updated by Matthieu Decorde 3 months ago

  • Target version changed from TXM 0.8.0 to TXM X.X

Also available in: Atom PDF