SupportClass Tokenizer ClassEncog Machine Learning Framework for .Net
The class performs token processing in strings
Inheritance Hierarchy

System Object
  Encog.MathUtil.LIBSVM SupportClass Tokenizer

Namespace: Encog.MathUtil.LIBSVM
Assembly: encog-core-cs (in encog-core-cs.dll) Version: 3.3.0.0 (3.3.0.0)
Syntax

public class Tokenizer : IEnumerator

The SupportClass Tokenizer type exposes the following members.

Constructors

  NameDescription
Public methodSupportClass Tokenizer(String)
Initializes a new class instance with a specified string to process
Public methodSupportClass Tokenizer(String, String)
Initializes a new class instance with a specified string to process and the specified token delimiters to use
Public methodSupportClass Tokenizer(String, String, Boolean)
Initializes a new class instance with a specified string to process, the specified token delimiters to use, and whether the delimiters must be included in the results.
Top
Methods

  NameDescription
Public methodEquals
Determines whether the specified Object is equal to the current Object.
(Inherited from Object.)
Protected methodFinalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from Object.)
Public methodGetHashCode
Serves as a hash function for a particular type.
(Inherited from Object.)
Public methodGetType
Gets the type of the current instance.
(Inherited from Object.)
Public methodHasMoreTokens
Determines if there are more tokens to return from the source string
Protected methodMemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Public methodMoveNext
Performs the same action as HasMoreTokens.
Public methodNextToken 
Returns the next token from the token list
Public methodNextToken(String)
Returns the next token from the source string, using the provided token delimiters
Public methodReset
Does nothing.
Public methodToString
Returns a string that represents the current object.
(Inherited from Object.)
Top
Properties

  NameDescription
Public propertyCount
Remaining tokens count
Public propertyCurrent
Performs the same action as NextToken.
Top
See Also