U lu fV @sdZddlZddlmZmZddlmZmZmZm Z ddl m Z dddgZ Gd ddeZ Gd ddeZiZGd ddeZdS) z pygments.lexers.special ~~~~~~~~~~~~~~~~~~~~~~~ Special lexers. :copyright: Copyright 2006-2023 by the Pygments team, see AUTHORS. :license: BSD, see LICENSE for details. N)Lexerline_re)TokenErrorTextGeneric)get_choice_opt TextLexer OutputLexer RawTokenLexerc@s:eZdZdZdZdgZdgZdgZdZddZ d d Z d S) r z3 "Null" lexer, doesn't highlight anything. z Text onlytextz*.txtz text/plaing{Gz?ccsdt|fVdSNr)rselfr r;/tmp/pip-unpacked-wheel-7eq1ciah/pygments/lexers/special.pyget_tokens_unprocessedsz TextLexer.get_tokens_unprocessedcCstjS)N)r priority)r rrr analyse_text"szTextLexer.analyse_textN) __name__ __module__ __qualname____doc__namealiases filenames mimetypesrrrrrrrr sc@s"eZdZdZdZdgZddZdS)r zj Simple lexer that highlights everything as ``Token.Generic.Output``. .. versionadded:: 2.10 z Text outputoutputccsdtj|fVdSr )rZOutputrrrrr/sz"OutputLexer.get_tokens_unprocessedN)rrrrrrrrrrrr &sc@s:eZdZdZdZgZgZdgZddZddZ dd Z d S) r a Recreate a token stream formatted with the `RawTokenFormatter`. Additional options accepted: `compress` If set to ``"gz"`` or ``"bz2"``, decompress the token stream with the given compression algorithm before lexing (default: ``""``). zRaw token datazapplication/x-pygments-tokenscKs*t|dddddgd|_tj|f|dS)Ncompressnonegzbz2)rrr__init__)roptionsrrrr#Es  zRawTokenLexer.__init__ccs|jr~t|tr|d}z>|jdkr:ddl}||}n|jdkrVddl}||}Wn$tk r|t| dfVYnXt|t r| d}| dd}| |D]\}}}||fVqdS)Nlatin1r!rr" ) r isinstancestrencodegzip decompressr"OSErrorrdecodebytesstripr)rr r*r"itvrrr get_tokensJs"       zRawTokenLexer.get_tokensc csd}t|D]}z|dd\}}t|}|st}|ddd}|D]&}|rh|dspt dt ||}qT|t|<t |}t |tst dWn$tt fk r|}t}YnX|||fV|t|7}qdS)Nr .zmalformed token namez expected str)rfinditergrouprstripsplit _ttype_cachegetrisupper ValueErrorgetattrast literal_evalr'r( SyntaxErrorrlen) rr lengthmatchZttypestrvalttypeZttypesZttype_rrrr_s*       z$RawTokenLexer.get_tokens_unprocessedN) rrrrrrrrr#r3rrrrrr 6s )rr@Zpygments.lexerrrZpygments.tokenrrrrZ pygments.utilr__all__r r r;r rrrrs