Searched defs:test_tokens (Results 1 – 4 of 4) sorted by relevance
34 struct test_tokens : lex::lexer<Lexer> struct36 test_tokens() in test_tokens() argument65 test_tokens<lex::lexertl::actor_lexer<token_type> > the_lexer; in main() argument
116 bool test_tokens(token_data const* d, std::vector<Token> const& tokens) in test_tokens() function
45 def test_tokens(data_filename, tokens_filename, verbose=False): function
16 test_tokens = [ variable in TestTokenStream