Skip to content

[docs] Optimization/special hardware #4786

@stevhliu

Description

@stevhliu

From #4428 (comment), the Optimization/Special Hardware section has grown and it may be time to reorganize it. I want to explore how we can do this, and my initial thoughts are:

To me, there are three subtopics in this section that we can reorganize on:

  1. General optimizations that you can apply to DiffusionPipeline (memory/speed, torch 2.0 support, xFormers, token merging)
  2. Optimized or specialized model types (OVStableDiffusionPipeline, ORTStableDiffusionPipeline, CoreML models, Stable Diffusion in JAX/Flax)
  3. Hardware (MPS, Habana)

For the "Memory/speed" page, I think we can even split this into two docs; one focused on saving memory and the other on speeding up inference.

Happy to hear your thoughts! cc @pcuenca @patrickvonplaten @sayakpaul @yiyixuxu

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions