java.lang.Object
- eu.royalsloth.depbuilder.dsl.DslLexer.Tokenizer

Enclosing class:: DslLexer

public static class DslLexer.Tokenizer
extends Object

Field Summary

Fields
Modifier and Type Field Description

String input

int line

int position

Constructor Summary

Constructors
Constructor Description

Tokenizer(String input)

Method Summary

All Methods Static Methods Instance Methods Concrete Methods
Modifier and Type	Method	Description
`void`	`advance()`
`void`	`back()`
`int`	`getCharacterNumberInLine(Token token)`
`char`	`getCurrentChar()`
`int`	`getLine()`
`int`	`getLine(Token token)`	Get the line in which the token appears.
`Token`	`getNextToken()`
`static Token`	`parseDigitToken(DslLexer.Tokenizer tokenizer, Token token)`
`static Token`	`parseIdentifier(DslLexer.Tokenizer tokenizer, Token token)`
`char`	`peekNextChar()`
`Token`	`peekNextToken()`
`String`	`substring(int start, int end)`
`List<Token>`	`toTokens()`

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

position
```
public int position
```

line
```
public int line
```

input
```
public final String input
```

Constructor Detail
- Tokenizer
```
public Tokenizer(String input)
```

Method Detail

peekNextToken
```
public Token peekNextToken()
```

getNextToken
```
public Token getNextToken()
```

getCurrentChar
```
public char getCurrentChar()
```

advance
```
public void advance()
```

back
```
public void back()
```

substring

public String substring(int start,
                        int end)

peekNextChar
```
public char peekNextChar()
```

getLine
```
public int getLine()
```
Returns:

get current tokenizer line on which we are parsing the tokens

getLine
```
public int getLine(Token token)
```
Get the line in which the token appears. This should be only used for reporting error messages, as this method is quite slow (iterating over the entire text).

getCharacterNumberInLine

public int getCharacterNumberInLine(Token token)

toTokens
```
public List<Token> toTokens()
```

parseDigitToken

public static Token parseDigitToken(DslLexer.Tokenizer tokenizer,
                                    Token token)

parseIdentifier

public static Token parseIdentifier(DslLexer.Tokenizer tokenizer,
                                    Token token)

Class DslLexer.Tokenizer

Field Summary

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Field Detail

position

line

input

Constructor Detail

Tokenizer

Method Detail

peekNextToken

getNextToken

getCurrentChar

advance

back

substring

peekNextChar

getLine

getLine

getCharacterNumberInLine

toTokens

parseDigitToken

parseIdentifier