o 2h@sddlZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm Z dd l m Z dd l mZdd d Zd dZddZdS)N)backend)treeconvert_spec_to_tensor)get_input_signature)make_tf_tensor_spec)DEFAULT_ENDPOINT_NAME) ExportArchive) patch_tf2onnx)io_utilsc Ks|}|durd}|durt|}|r|jstdtdvrAddlm}tt|}t ||fi|}t |j j |||dntdkrddl }td d |} t| } td d | Drdtd t|drm|tZtjdddtjdddtjdddtjdddtjdddz|jj|| |dd} t| dr| | |Wn|durd}|jj|| ||dYWdn1swYntd|rtd|ddSdS)aExport the model as a ONNX artifact for inference. This method lets you export a model to a lightweight ONNX artifact that contains the model's forward pass only (its `call()` method) and can be served via e.g. ONNX Runtime. The original code of the model (including any custom layers you may have used) is *no longer* necessary to reload the artifact -- it is entirely standalone. Args: filepath: `str` or `pathlib.Path` object. The path to save the artifact. verbose: `bool`. Whether to print a message during export. Defaults to `None`, which uses the default value set by different backends and formats. input_signature: Optional. Specifies the shape and dtype of the model inputs. Can be a structure of `keras.InputSpec`, `tf.TensorSpec`, `backend.KerasTensor`, or backend tensor. If not provided, it will be automatically computed. Defaults to `None`. **kwargs: Additional keyword arguments. **Note:** This feature is currently supported only with TensorFlow, JAX and Torch backends. **Note:** The dtype policy must be "float32" for the model. You can further optimize the ONNX artifact using the ONNX toolkit. Learn more here: [https://onnxruntime.ai/docs/performance/](https://onnxruntime.ai/docs/performance/). **Note:** The dynamic shape feature is not yet supported with Torch backend. As a result, you must fully define the shapes of the inputs using `input_signature`. If `input_signature` is not provided, all instances of `None` (such as the batch size) will be replaced with `1`. Example: ```python # Export the model as a ONNX artifact model.export("path/to/location", format="onnx") # Load the artifact in a different process/environment ort_session = onnxruntime.InferenceSession("path/to/location") ort_inputs = { k.name: v for k, v in zip(ort_session.get_inputs(), input_data) } predictions = ort_session.run(None, ort_inputs) ``` NTzSThe model provided has never called. It must be called at least once before export.) tensorflowjaxr)tf2onnx) output_pathtorchcSs t|ddS)N)replace_none_numberr)xrP/var/www/html/chatgem/venv/lib/python3.10/site-packages/keras/src/export/onnx.py\s zexport_onnx..css|]}t|tVqdS)N) isinstancedict).0rrrr aszexport_onnx..zUCurrently, `export_onnx` in the torch backend doesn't support dictionaries as inputs.evalignorez4.*\n.*\n*.*\n*.*export will treat it as a constant.*)messagez+.*not properly registered as a submodule,.*z3.*which is what 'get_attr' Nodes typically target.*z2.*underlying reference in the owning GraphModule.*z(.*suppressed about get_attr references.*)verbosedynamooptimizeF)rzI`export_onnx` is only compatible with TensorFlow, JAX and Torch backends.zSaved artifact at 'z'.)r_called ValueErrorrkeras.src.utils.module_utilsrr map_structurerget_concrete_fnr convert from_functionrtupleanyhasattrrwarningscatch_warningsfilterwarningsonnxexportr saveNotImplementedErrorr print_msg) modelfilepathrinput_signaturekwargsactual_verboser decorated_fnr sample_inputs onnx_programrrr export_onnxs0       (r;cCsv|}d|vr d|d<d|vrddd|d<|ddur!td|dddur-td|dd dur9td |S) N is_staticT jax2tf_kwargsF) enable_xlanative_serializationzB`is_static` must be `True` in `kwargs` when using the jax backend.r>zU`enable_xla` must be `False` in `kwargs['jax2tf_kwargs']` when using the jax backend.r?z_`native_serialization` must be `False` in `kwargs['jax2tf_kwargs']` when using the jax backend.)copyr")r6rrr_check_jax_kwargss( rAcKsNtdkr t|}t}|jt||fi|tdkr"||tS)z0Get the `tf.function` associated with the model.r r )rrAr track_and_add_endpointr_filter_and_track_resources_get_concrete_fn)r3r5r6export_archiverrrr%s   r%)NN)r+ keras.srcrrkeras.src.export.export_utilsrrrkeras.src.export.saved_modelrr keras.src.export.tf2onnx_libr keras.src.utilsr r;rAr%rrrrs