Token -> Tokenizer
Pre-release
Pre-release
Change from token type to tokenizer type (#2) * Update API Switch internal terminology from use of `Token` to `Tokenizer`. Change external API from `matches(:)` back to the original `tokens(:)`. Add a convenience method `components(:)` that returns just substrings rather than array of `Token`. * Update file name. * Update README to show `Token` type. * Include `import Mustard` in code snippet.