Loyc.Syntax.Lexing.ILexer< Token > Interface Template Reference

A standard interface for lexers. More...

---

Source file:

• /Core/Loyc.Syntax/Lexing/ILexer.cs

Inheritance diagram for Loyc.Syntax.Lexing.ILexer< Token >:

Remarks

A standard interface for lexers.

Template Parameters

Token

Type of tokens produced by the lexer (usually Loyc.Syntax.Lexing.Token).

Properties
ISourceFile	SourceFile [get]
	The file being lexed. More...
IMessageSink	ErrorSink [get, set]
	Event handler for errors. More...
int	IndentLevel [get]
	Indentation level of the current line. This is updated after scanning the first whitespaces on a new line, and may be reset to zero when NextToken() returns a newline. More...
UString	IndentString [get]
	Gets a string slice that holds the spaces or tabs that were used to indent the current line. More...
int	LineNumber [get]
	Current line number (1 for the first line). More...
int	InputPosition [get]
	Current input position (an index into SourceFile.Text). More...

Public Member Functions
Maybe< Token >	NextToken ()
	Scans the next token and returns information about it. More...
Public Member Functions inherited from Loyc.Syntax.IIndexToLine
SourcePos	IndexToLine (int index)
	Returns the position in a source file of the specified index. More...

Member Function Documentation

Maybe<Token> Loyc.Syntax.Lexing.ILexer< Token >.NextToken

(

)

Scans the next token and returns information about it.

Returns

The next token, or null at the end of the source file.

Implemented in Loyc.Syntax.Les.LesLexer, Loyc.Ecs.Parser.CommentSaver, Loyc.Syntax.Lexing.IndentTokenGenerator< Token >, Loyc.Syntax.Lexing.BaseILexer< CharSrc, Token >, Loyc.Ecs.Parser.EcsPreprocessor, Loyc.Ecs.Parser.EcsLexer, Loyc.Syntax.Lexing.TokensToTree, Loyc.Syntax.Lexing.LexerWrapper< Token >, Loyc.Syntax.Lexing.TokenListAsLexer, and Loyc.Syntax.Lexing.WhitespaceFilter< Token >.

Property Documentation

IMessageSink Loyc.Syntax.Lexing.ILexer< Token >.ErrorSink

getset

Event handler for errors.

int Loyc.Syntax.Lexing.ILexer< Token >.IndentLevel

get

Indentation level of the current line. This is updated after scanning the first whitespaces on a new line, and may be reset to zero when NextToken() returns a newline.

UString Loyc.Syntax.Lexing.ILexer< Token >.IndentString

get

Gets a string slice that holds the spaces or tabs that were used to indent the current line.

int Loyc.Syntax.Lexing.ILexer< Token >.InputPosition

get

Current input position (an index into SourceFile.Text).

int Loyc.Syntax.Lexing.ILexer< Token >.LineNumber

get

Current line number (1 for the first line).

ISourceFile Loyc.Syntax.Lexing.ILexer< Token >.SourceFile

get

The file being lexed.