o 2h3@s$dZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z ddl m Z ddlmZedZdZdZejdkrLeZ ejd krWeZejZneZejZed Zed Zd d ZddZddZddZddZ ddZ!ddZ"d!ddZ#ddZ$d"dd Z%dS)#z/Converting code to AST. Adapted from Tangent. N)errors) inspect_utils) tf_inspect ) )r __future__z\s*cCs |ddS)z7Removes any backslash line continuations from the code.z\ r)replace) code_stringr b/var/www/html/chatgem/venv/lib/python3.10/site-packages/tensorflow/python/autograph/pyct/parser.py_unfold_continuations:s rcCst|}tt|j}d}g}z |D]}||qWn tjy'Ynw|D]&}|\}}}}}|tjkr@|}t |}n|tj tj tj tj fvrPd}nq*|sU|St |}d|v} t|D]3\} }|\}}}}}|tjkrd|vrw| s}d|vr| stdt ||kr||d}||f|| <qat|} g} t|d| dD]0\} }tt| }tt|}t |t |kr| t |t |d}n| }| |qd| } | S)z9Dedents a code so that its first line starts at row zero.Nr  z:code mixing tabs and spaces for indentation is not allowedr)rtokenizegenerate_tokensioStringIOreadlineappend TokenErrorINDENTlenNLNEWLINESTRINGCOMMENT enumeraterUnsupportedLanguageElementError untokenizezipsplitrematch_LEADING_WHITESPACEgroupjoin)r token_genblock_indentationtokenstoktok_type tok_string_ block_levelfirst_indent_uses_tabsinew_code dedented_codelinenew_lineoriginal_indent new_indent dedented_liner r r dedent_block?sd           r9c Cst|r t|Szt|}Wnty'}z td|d|d}~wwt|}tdd|D}d ||f}t |t |d|fS)aReturns the AST and source code of given entity. Args: entity: Any, Python function/method/class future_features: Iterable[Text], future features to use (e.g. 'print_statement'). See https://docs.python.org/2/reference/simple_stmts.html#future Returns: gast.AST, Text: the parsed AST node; the source code that was parsed to generate the AST (including any prefixes that this function may have added). z$Unable to locate the source code of a=. Note that functions defined in certain environments, like the interactive Python shell, do not expose their source code. If that is the case, you should define them in a .py source file. If you are certain the code is graph-compatible, wrap the call using @tf.autograph.experimental.do_not_convert. Original error: Ncss|]}d|VqdS)zfrom __future__ import {}N)format).0namer r r s  zparse_entity..r) preamble_len) rislambda _parse_lambdagetimmediatesourceOSErrorrInaccessibleSourceCodeErrorr9tupler'parser)entityfuture_featuresoriginal_sourceesourcefuture_statementsr r r parse_entitys$  rLc Cst|D] }t|dd}|dur|||_t|dd}|dur%|||_q||d|}t|dd}|durB|dd||d<t|dd} | dur]td|d } | dur]| d } | durk|d | d|d <d d d |D} || fS) zCReturns a clean node and source code without indenting and context.linenoN end_linenoend_col_offset col_offsetz(?z$_without_context..) gastwalkgetattrrMrNr#searchstartr') nodelinesminlmaxlnrMrN code_linesrPrRr$ code_blockr r r _without_contexts*       rccCs0|durdSt|tjr|jSt|tsJ|SN) isinstancerWNameidstr)r\r r r _arg_names  ricCst|}tdd|jjD}|t|jkrdS|jt|jjkr$dS|jt|jjkr/dStdd|jj D}|t|j krCdSdS)z.Returns True is node fits the argspec of func.cs|]}t|VqdSrdrir;argr r r r=z(_node_matches_argspec..Fcsrjrdrkrlr r r r=rnT) rgetfullargspecrDargsvarargsrivarargvarkwkwarg kwonlyargs)r\funcarg_spec node_argsnode_kwonlyargsr r r _node_matches_argspecs rzcst}t}jj}t||j}d|}t |ddd}g}|D]}t |d||kr5| |q%g} |D]}| ddt |Dq:g} | D]C} td} } t | D]"}t| t |d| } t |d| }t |dd }|d urw|}t| |} qZ| |kr| krnqN| | | | fqNt| d kr| \\}} } t||| | S| sd d d | D}tdd|fdd | D}t|d kr|\\}} } t||| | Sd ddt|D}tdd|)a&Returns the AST and source code of given lambda function. Args: lam: types.LambdaType, Python function/method/class Returns: gast.AST, Text: the parsed AST node; the source code that was parsed to generate the AST (including any prefixes that this function may have added). rrFr> single_noderMcss |] }t|tjr|VqdSrd)rerWLambda)r;r`r r r r=s   z _parse_lambda..rNNrOrcSsg|]}t|qSr )unparse)r;lr r r rU+rVz!_parse_lambda..z#could not parse the source code of z*: no matching AST found among candidates: csg|] }t|dr|qS)r)rz)r;vlamr r rU1scss.|]\}\}}}d|t|ddVqdS)z Match {}: {} F)include_encoding_markerN)r:r~)r;r1r\r.r r r r=7s   z: found multiple definitions with identical signatures at the location. This error may be avoided by defining each lambda on a single line and with unique argument names. The matching definitions were: )inspect getmodule getsourcefile__code__co_firstlineno linecachegetlines__dict__r'rErYrextendrWrXMAX_SIZEminmaxrrcrrr)rmodfdef_liner]rJ all_nodes search_nodesr\ lambda_nodes candidateslnr^r_r`rMrN lambda_codesmatchesr rr r@sf               r@TcCsJt|}|j}|r||d}|r#t|dkrtd||dS|S)aReturns the AST of given piece of code. Args: src: Text preamble_len: Int, indicates leading nodes in the parsed AST which should be dropped. single_node: Bool, whether `src` is assumed to be represented by exactly one AST node. Returns: ast.AST NrOz!expected exactly one node, got {}r)rWrEbodyr ValueErrorr:)srcr>r| module_nodenodesr r r rEBs   rEcCs<t|}t|tdd} t|tjstd||j S)zReturns the AST of given identifier. Args: src: A piece of code that represents a single Python expression Returns: A gast.AST object. Raises: ValueError: if src does not consist of a single Expression. Tr{z.expected exactly one node of type Expr, got {}) STANDARD_PREAMBLEstriprESTANDARD_PREAMBLE_LENrerWExprrr:value)rr\r r r parse_expressionZs  rcCs~~t|ttfs |f}g}|r|d|D]#}t|tjr$t|}n|}ttur/t ||t | qd |S)aReturns the source code of given AST. Args: node: The code to compile, as an AST object. indentation: Unused, deprecated. The returning code will always be indented at 4 spaces. include_encoding_marker: Bool, whether to include a comment on the first line to explicitly specify UTF-8 encoding. Returns: code: The source code generated from the AST object source_mapping: A mapping between the user and AutoGraph generated code. z# coding=utf-8r) relistrDrrWAST gast_to_ast astunparseastfix_missing_locationsr~rr')r\ indentationrcodesr`ast_nr r r r~ms     r~)rT)NT)&__doc__rrrrr#systextwraprrrW tensorflow.python.autograph.pyctrrtensorflow.python.utilrdedent PY2_PREAMBLE PY3_PREAMBLEr version_informaxsizemaxintcountrcompiler%rr9rLrcrirzr@rErr~r r r r sH        D$"  Z