程序包 org.antlr.runtime

类 UnbufferedTokenStream

  • 所有已实现的接口:
    IntStream, TokenStream
    public class UnbufferedTokenStream
extends LookaheadStream<Token>
implements TokenStream
    A token stream that pulls tokens from the code source on-demand and without tracking a complete buffer of the tokens. This stream buffers the minimum number of tokens possible. It's the same as OnDemandTokenStream except that OnDemandTokenStream buffers all tokens. You can't use this stream if you pass whitespace or other off-channel tokens to the parser. The stream can't ignore off-channel tokens. You can only look backwards 1 token: LT(-1). Use this when you need to read from a socket or other infinite stream.
    另请参阅:
    BufferedTokenStream, CommonTokenStream

    • 字段详细资料

      • tokenIndex

        protected int tokenIndex

      • channel

        protected int channel
        Skip tokens on any channel but this one; this is how we skip whitespace...

    • 构造器详细资料

      • UnbufferedTokenStream

        public UnbufferedTokenStream​(TokenSource tokenSource)

    • 方法详细资料

      • getTokenSource

        public TokenSource getTokenSource()
        从接口复制的说明: TokenStream
        Where is this stream pulling tokens from? This is not the name, but the object that provides Token objects.
        指定者:
        getTokenSource 在接口中 TokenStream

      • toString

        public java.lang.String toString​(int start,
                                 int stop)
        从接口复制的说明: TokenStream
        Return the text of all tokens from start to stop, inclusive. If the stream does not buffer all the tokens then it can just return "" or null; Users should not access $ruleLabel.text in an action of course in that case.
        指定者:
        toString 在接口中 TokenStream

      • toString

        public java.lang.String toString​(Token start,
                                 Token stop)
        从接口复制的说明: TokenStream
        Because the user is not required to use a token with an index stored in it, we must provide a means for two token objects themselves to indicate the start/end location. Most often this will just delegate to the other toString(int,int). This is also parallel with the TreeNodeStream.toString(Object,Object).
        指定者:
        toString 在接口中 TokenStream

      • LA

        public int LA​(int i)
        从接口复制的说明: IntStream
        Get int at current input pointer + i ahead where i=1 is next int. Negative indexes are allowed. LA(-1) is previous token (token just matched). LA(-i) where i is before first token should yield -1, invalid char / EOF.
        指定者:
        LA 在接口中 IntStream

      • get

        public Token get​(int i)
        从接口复制的说明: TokenStream
        Get a token at an absolute index i; 0..n-1. This is really only needed for profiling and debugging and token stream rewriting. If you don't want to buffer up tokens, then this method makes no sense for you. Naturally you can't use the rewrite stream feature. I believe DebugTokenStream can easily be altered to not use this method, removing the dependency.
        指定者:
        get 在接口中 TokenStream

      • getSourceName

        public java.lang.String getSourceName()
        从接口复制的说明: IntStream
        Where are you getting symbols from? Normally, implementations will pass the buck all the way to the lexer who can ask its input stream for the file name or whatever.
        指定者:
        getSourceName 在接口中 IntStream