Skip to content

Conversation

@mudler
Copy link
Owner

@mudler mudler commented Aug 12, 2025

Description

This PR:

Notes for Reviewers

Currently WIP

What works:

Signed commits

  • Yes, I signed my commits.
@netlify
Copy link

netlify bot commented Aug 12, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit a4bdaab
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/68a81144786af50008a84e7b
😎 Deploy Preview https://deploy-preview-6049--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@github-actions
Copy link

yamllint Failed

Show Output
::group::backend/index.yaml
::warning file=backend/index.yaml,line=95,col=6::95:6 [comments] missing starting space in comment
::error file=backend/index.yaml,line=140,col=24::140:24 [trailing-spaces] trailing spaces
::warning file=backend/index.yaml,line=723,col=6::723:6 [comments] missing starting space in comment
::warning file=backend/index.yaml,line=928,col=3::928:3 [comments-indentation] comment not indented like content
::endgroup::

Workflow: Yamllint GitHub Actions, Action: __karancode_yamllint-github-action_2, Lint: backend

@mudler
Copy link
Owner Author

mudler commented Aug 21, 2025

due to Blaizzy/mlx-vlm#470 mlx-vlm installed here is behind and does not support many new models, but this is a start!

@mudler
Copy link
Owner Author

mudler commented Aug 21, 2025

arg, more failures as it's a really old version. we might need to drop the mlx-vlm from this PR for now

mudler added 13 commits August 21, 2025 23:46
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler changed the title feat(mlx): add mlx and mlx-vlm backends Aug 21, 2025
@mudler mudler changed the title feat(mlx): add mlx backends Aug 21, 2025
@mudler mudler marked this pull request as ready for review August 21, 2025 21:49
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler merged commit 1d830ce into master Aug 22, 2025
68 of 70 checks passed
@mudler mudler deleted the feat/mlx branch August 22, 2025 06:42
This was referenced Aug 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

2 participants