Package: ucto (0.30-3 and others)

[ Source: ucto  ]

Unicode Tokenizer

Ucto can tokenize UTF-8 encoded text files (i.e. separate words from punctuation, split sentences, generate n-grams), and offers several other basic preprocessing steps that make your text suited for further processing such as indexing, part-of-speech tagging, or machine translation.

This package provides the command-line tool itself.

Ucto was written by Maarten van Gompel and Ko van der Sloot. Work on Ucto was funded by NWO, the Netherlands Organisation for Scientific Research, under the Implicit Linguistics project, the CLARIN-NL program, and the CLARIAH project.

Ucto is a product of the Centre of Language and Speech Technology (Radboud University Nijmegen), and previously the ILK Research Group (Tilburg University, The Netherlands).

If you are interested in machine parsing of UTF-8 encoded text files, e.g. to do scientific research in natural language processing, ucto will likely be of use to you.

Tags: Implemented in: C++, Role: Program

Other Packages Related to ucto

• dep: libc6 (>= 2.34) [not alpha, ia64, sh4]

  GNU C Library: Shared libraries
  also a virtual package provided by libc6-udeb

  dep: libc6 (>= 2.40) [sh4]

• dep: libc6.1 (>= 2.34) [alpha]

  GNU C Library: Shared libraries
  also a virtual package provided by libc6.1-udeb

  dep: libc6.1 (>= 2.37) [ia64]

• dep: libfolia14 (>= 2.4) [ia64]

  Implementation of the FoLiA document format

• dep: libfolia19 (>= 2.17) [not ia64]

  Implementation of the FoLiA document format

• dep: libgcc-s1 (>= 3.0) [not armel, armhf, hppa, ia64, m68k]

  GCC support library

  dep: libgcc-s1 (>= 3.5) [armel, armhf]

• dep: libgcc-s2 (>= 4.2.1) [m68k]

  GCC support library

• dep: libgcc-s4 (>= 4.1.1) [hppa]

  GCC support library

• dep: libicu72 (>= 72.1~rc-1~)

  International Components for Unicode

• dep: libstdc++6 (>= 13.1)

  GNU Standard C++ Library v3

• dep: libticcutils8t64 (>= 0.24) [ia64]

  utility functions used in the context of Natural Language Processing (library)

• dep: libticcutils9 (>= 0.34) [not ia64]

  utility functions used in the context of Natural Language Processing (library)

• dep: libucto5t64 (>= 0.21.1) [ia64]

  Unicode Tokenizer - runtime

• dep: libucto6 (>= 0.30) [not ia64]

  Unicode Tokenizer - runtime

• dep: libunwind8 [ia64]

  library to determine the call-chain of a program - runtime

• dep: uctodata

  Data files for Ucto

Download ucto

Download for all available architectures

Architecture	Version	Package Size	Installed Size	Files
alpha (unofficial port)	0.30-3	23.5 kB	90.0 kB	[list of files]
amd64	0.30-3+b1	25.3 kB	87.0 kB	[list of files]
arm64	0.30-3+b1	23.1 kB	91.0 kB	[list of files]
armel	0.30-3+b1	23.4 kB	82.0 kB	[list of files]
armhf	0.30-3+b1	23.2 kB	70.0 kB	[list of files]
hppa (unofficial port)	0.30-3+b1	23.2 kB	75.0 kB	[list of files]
i386	0.30-3+b1	25.8 kB	86.0 kB	[list of files]
ia64 (unofficial port)	0.21.1-2.1+b1	57.0 kB	144.0 kB	[list of files]
m68k (unofficial port)	0.30-3+b1	23.0 kB	82.0 kB	[list of files]
mips64el	0.30-3+b1	23.2 kB	93.0 kB	[list of files]
ppc64 (unofficial port)	0.30-3+b1	24.1 kB	93.0 kB	[list of files]
ppc64el	0.30-3+b1	24.2 kB	91.0 kB	[list of files]
riscv64	0.30-3+b1	23.8 kB	75.0 kB	[list of files]
s390x	0.30-3+b1	24.6 kB	83.0 kB	[list of files]
sh4 (unofficial port)	0.30-3+b1	25.2 kB	90.0 kB	[list of files]
sparc64 (unofficial port)	0.30-3+b1	22.0 kB	1,054.0 kB	[list of files]
x32 (unofficial port)	0.30-3+b1	24.7 kB	83.0 kB	[list of files]