mabel.utils.token_labeler

interpret_value (value)

function_in (x, y)

function_contains (x, y)

get_token_type (token)

Guess the token type.

build_splitter ()

CLASS: Tokenizer (exp)

next ()

peek ()

has_next ()

next_token_type ()

next_token_value ()

clean_statement (string)

Remove carriage returns and all whitespace to single spaces

tokenize (expression)

---

This file has been automatically generated, it is not the truth. If in doubt the code will tell you unambiguously what it does.