Tokenizing Functions

##Tokenizing Functions

All of the AQL tokenizing functions are mapped to System.String.

###Example

    dv.FacebookUsers.Select(u => u.name.Split(' '));

will generate

    for $u in dataset FacebookUsers return word-tokens($u.name)

For an example of each function, view the relevant tests.

###Supported Functions

• word-tokens : myString.Split(' ')