Sisyphus repository
Last update: 1 october 2023 | SRPMs: 18631 | Visits: 37045546
en ru br
ALT Linux repos
S:0.06-alt1
5.0: 0.05-alt2
4.1: 0.05-alt1
4.0: 0.05-alt1

Group :: Development/Perl
RPM: perl-String-Tokenizer

 Main   Changelog   Spec   Patches   Sources   Download   Gear   Bugs and FR  Repocop 

Current version: 0.06-alt1
Build date: 3 march 2016, 11:51 ( 421.1 weeks ago )
Size: 20.15 Kb

Home page:   http://www.cpan.org

License: Artistic
Summary: A simple string tokenizer
Description:

A simple string tokenizer which takes a string and splits it on
whitespace. It also optionally takes a string of characters to use as
delimiters, and returns them with the token set as well. This allows
for splitting the string in many different ways.

This is a very basic tokenizer, so more complex needs should be either
addressed with a custom written tokenizer or post-processing of the output
generated by this module. Basically, this will not fill everyones needs,
but it spans a gap between simple "split / /, $string" and the other
options that involve much larger and complex modules.

Also note that this is not a lexical analyser. Many people confuse
tokenization with lexical analysis. A tokenizer mearly splits its
input into specific chunks, a lexical analyzer classifies those
chunks. Sometimes these two steps are combined, but not here.

Current maintainer: Vitaly Lipatov

List of contributors

List of rpms provided by this srpm:

  • perl-String-Tokenizer
ACL:
     
    design & coding: Vladimir Lettiev aka crux © 2004-2005, Andrew Avramenko aka liks © 2007-2008
    current maintainer: Michael Shigorin