Feature #1779

TBX: 0.7.7, tokenizer must handle common cases

Added by Serge Heiden almost 5 years ago. Updated almost 2 years ago.

Status:New Start date:04/13/2016
Priority:Normal Due date:
Assignee:- % Done:

0%
Category:TAL Spent time: -
Target version:TXM X.X

Description

Better tokenize common cases:
  • numbers such as 2.3.3, 200 000, or 2,4
  • "CDU/CSU-Koalition"

History

#1 Updated by Sebastien Jacquot over 2 years ago

  • Target version changed from TXM 0.8.0a (split/restructuration) to TXM 0.8.0

#2 Updated by Matthieu Decorde almost 2 years ago

  • Target version changed from TXM 0.8.0 to TXM X.X

Also available in: Atom PDF