Skip to content

Gemma Model Fine-tuning UI: Streamlit-Based Real-Time Training and Custom Model Export #157

Open
@william-Dic

Description

@william-Dic

Description of the feature request:

Description:
Create an interactive Streamlit-based web application designed to simplify fine-tuning of Google's Gemma open models on custom datasets. The application allows users to easily upload and preprocess datasets (supporting CSV, JSONL, and TXT formats), configure essential hyperparameters such as learning rate, batch size, and epochs, and monitor training progress through real-time visualizations including loss curves, evaluation metrics, and live-generated text examples.

Key features include:
Real-Time Training Visualization: Dynamic updates of training loss, accuracy, F1-scores, and generated text examples.
LoRA Integration: Efficient fine-tuning using Low-Rank Adaptation (LoRA) with customizable parameters.
Model Export: Convenient options to download the trained model in PyTorch format, with placeholder functionality for TensorFlow SavedModel and GGUF conversions.
Cloud Integration (Optional): Basic framework for integration with Google Cloud Storage and Vertex AI for scalable training (currently placeholder implementation).
Clear Documentation & Examples: Embedded tooltips, step-by-step guidance, and a straightforward UI ensure accessibility for all users.

Demo:
Image

What problem are you trying to solve with this feature?

No response

Any other information you'd like to share?

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    wishlistA wish list of cookbooks

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions