o 2h@sxdZddlZddlZddlZddlZddlZddlZedddgZddZ dd Z d d Z d d Z ddZ ddZdS)z-A module to support operations on ipynb filesNCodeLine cell_numbercodecCs(|ddko|do|ddd S)z+Checks if the cell consists of Python code. cell_typersourcerz%% startswith)cellr _/var/www/html/chatgem/venv/lib/python3.10/site-packages/tensorflow/tools/compatibility/ipynb.py is_pythons r cCstdt|\}}dd|D}tjddd=}|d||\}}} } |r:|r:t|||d} t | |n t dd | |} | | ||} | }Wd n1sXwYt |j|| | |fS) z;The function where we inject the support for ipynb upgrade.z,Extracting code lines from original notebookcSsg|]}|jqSr )r).0clr r r %sz process_file..wF)delete z&Was not able to process the file: %s N)print _get_codetempfileNamedTemporaryFileupdate_string_pastajoin_update_notebooksplitjsondump SyntaxError _format_logshutilmovename) in_filename out_filenameupgraderraw_codenotebook raw_lines temp_fileprocessed_filenew_file_contentlogprocess_errors new_notebookfiles_processed report_texterrorsr r r process_file!s(    r2cCs|D] }||r dSqdS)aChecks if the cell has magic, that is not Python-based. Args: code_line: A line of Python code magic_list: A list of jupyter "magic" exceptions Returns: If the line jupyter "magic" line, not Python line >>> skip_magic('!ls -laF', ['%', '!', '?']) True TFr) code_line magic_listmagicr r r skip_magic>s  r6cCs td|S)zChecks if a line was split with `\`. Args: code_line: A line of Python code Returns: If the line was split with `\` >>> skip_magic("!gcloud ml-engine models create ${MODEL} \\\n") True z\\\s*\n$)research)r3r r r check_line_splitSs r9c Csg}t| }t|}Wdn1swYd}|dD]Q}t|rr|d}d}t|D]<\}} t| gds>|rFd| } t| }|rLt| }|t|dkr_| d r_| d d } | t || d d q1|d7}q!||fS) z5Loads the ipynb file and returns a list of CodeLines.NrcellsrF)%!?###!!!r###===) openrloadr enumerater6r9lenendswithreplaceappendrrstrip) input_filer&in_filer' cell_indexr cell_lines is_line_splitline_idxr3r r r rcs2    rcst|}t|tksJdt|td|dD].}t|s&qfddt|D}fdd|D}d|dd d d|d <d 7q|S) z)Updates notebook, once migration is done.zCThe lengths of input and converted files are not the same: {} vs {}rr:csg|] \}}|jkr|qSr )r)r idxr3) code_cell_idxr r rs  z$_update_notebook..csg|]}|qSr r )r rO)updated_code_linesr r rsrr>rr@rr?)copydeepcopyrDformatr rCrrF)original_notebookoriginal_raw_linesrQr.r applicable_linesnew_coder )rPrQr rs$    r)__doc__ collectionsrRrr7r r namedtuplerr r2r6r9rrr r r r s -