Back to Eqiora docs Skip to main content

lex

Function lex 

pub fn lex(
    file: impl Into<String>,
    source: &str,
) -> (Vec<Token>, Vec<Diagnostic>)
Description

Tokenize one UTF-8 source file without discarding bytes.