tokenize

Tokenizes text with a search analyzer.

Syntax

tokenize( <expr> [, analyzer => <analyzer> ] )

Arguments

<expr> is a string expression.

analyzer is optional. Currently supported value is log, which is also the default.

Returns

Returns an array of lowercase string tokens.

Examples

SELECT tokenize('level=info status=200 request completed');