Struct acs::cal::tokenizer::Token

pub struct Token {
    pub value: TokenKind,
    pub range: Range,
}

Useful for lexical analysys, with the tokenizer we transform series of characters into tokens to feed to the parser

Fields

value: TokenKind

range: Range

Implementations

impl Token

pub fn new(value: TokenKind, range: Range) -> Self

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a copy of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq<Token> for Token

fn eq(&self, other: &Token) -> bool

This method tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

This method tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl Eq for Token

impl StructuralEq for Token

impl StructuralPartialEq for Token