Laboratoire ICAR » Plateforme TXM

Help to sample a corpus at:

• import
  • cut texts at n first words after tokenization
    • add 'Sampling/Échantillonnage' section in import parameters form
    • add 'Sample texts to [ ] first words' parameter
    • add 'Cut at sentence boundaries (inclusive)' option parameter

or

• update
  • add new corpus command 'Sample texts at n first words' (on XML-TXM pivot)
    • add 'Number of words' parameter
    • add 'Cut at sentence boundaries (inclusive)' option parameter
    • update corpus

or

• update
  • add new corpus command 'Sample texts from sub-corpus' (on XML-TXM pivot from sub-corpus matches)
    • for example with sub-corpus built with query <text> []{1,10000} and MatchingStrategy set at 'longest'
    • update corpus

Solution¶

Create the corpus/TruncateTextsAtFirstWords macro to sample the xml-txm files of a TXM corpus with one parameter : number of words to keep per text