Compiler implementation of the D programming language.
Creates a Lexer for the source code base[begoffset..endoffset+1]. The last character, base[endoffset], must be null (0) or EOF (0x1A).
const(char)* filename
| used for error messages |
const(char)* base
| source code, must be terminated by a null (0) or EOF (0x1A) character |
size_t begoffset
| starting offset into base[] |
size_t endoffset
| the last offset to read into base[] |
bool doDocComment
| handle documentation comments |
bool commentToken
| comments become TOK.comment's |
DiagnosticReporter diagnosticReporter
| the diagnostic reporter to use |
true
if any errors occurred during lexing or parsing.Token
.Look ahead at next token's value.
Look 2 tokens ahead at value.
Turn next token in buffer into a token.
tk is on the opening (. Look ahead and return token that is past the closing ).
Combine two document comments into one, separated by an extra newline if newParagraph is true.
© 1999–2019 The D Language Foundation
Licensed under the Boost License 1.0.
https://dlang.org/phobos/dmd_lexer.html