Import an ONNX model as an external network:

Evaluate the model on some input data:

Import a quantized image classifier:

Define a minimal pipeline to pre- and post-process the data:

Run the external model:

Run a real-time face detector:

Define a transformation from an image to a list of arrays:

Run the detector on the encoded image:

Extract the bounding box and probability information from the result:

Visualize the detections, filtering the ones with low probability or large overlap:

This network can analyze more that 40 images per second on a consumer laptop:

Import a text-generating model:

Run the model until a termination token is reached:

Import a "GGUF" file as an embedding model:

Generate an embedding vector for each token in a string:

Input given as a NumericArray will cause the output to also be a NumericArray:

External net models typically have a hard-coded batch dimension:

Ordinary networks do not have an explicit batch dimension:

They work both on single examples and batches of any size:

External models cannot be modified:

External models cannot be retrained: