Skip to main content

Model Management

info

The Model Management page allows users to view and manage a list of supported models for fine-tuning or inference purposes. Models can be downloaded directly from Hugging Face repositories. Before using the feature, ensure that your device is connected to the internet, as model downloads require access to external servers.

Additionally, on the first download attempt, users will be prompted to provide an Access Token from Hugging Face. This token can be obtained by following Hugging Face's official guidelines for token generation.

Model Management

Features​

  1. Model List:
    • Displays all available models, including their names, sizes, and current processing status.
    • Users can search for specific models using the search bar.
  2. Model Details:
    • Model Name: Specifies the name of the model (e.g., meta-llama/Llama-3.1-8B-Instruct).
    • Support: Use the Phison tag for full parameters and Unsloth for the LoRA mechanism. A model tagged with both supports two different LLM fine-tuning approaches.
    • Size: Shows the storage size of each model (e.g., 29.93 GiB, 262.86 GiB).
    • Process Status: Indicates whether the model is ready to use (✓ for ready).
    • Action: Allows users to manage the model (e.g., download, delete).
  3. Download Process:
    • Displays the download progress for models that are currently being fetched.
    • Provides a clear indication of the model size and estimated time remaining.
    • Supports pause and resume functionality for interrupted downloads.
  4. Access Token Requirement:
    • During the initial download, users are required to provide a Hugging Face Access Token for authentication. Access Token
    • For token generation, visit the Hugging Face website and follow the official instructions to create and retrieve your personal token.

Supported Models​

  • Full Parameters (Phison Supported)
Model FamilyModel
Deepseek-aiDeepSeek-R1-Distill-Llama-70B
DeepSeek-R1-Distill-Qwen-32B
deepseek-llm-7b-chat
Googlegemma-3-27b-it
gemma-3-1b-it
gemma-2-9b-it
Meta-llamaLlama-3.3-70B-Instruct
Llama-3.2-3B-Instruct
Llama-3.1-405B-Instruct
Llama-3.1-8B-Instruct
Llama-3-Taiwan-70B-Instruct
MicrosoftPhi-4-reasoning
phi-4
Phi-3.5-mini-instruct
MistralMistral-Small-3.1-24B-Instruct-2503
Mixtral-8x22B-Instruct-v0.1
Mixtral-8x7B-Instruct-v0.1
QwenQwen3-32B
Qwen3-0.6B
QwQ-32B
Qwen2.5-72B-Instruct
Qwen2-7B
  • LoRA (Unsloth Supported)
Model FamilyModel
Deepseek-aiDeepSeek-R1-Distill-Llama-8B
DeepSeek-R1-Distill-Qwen-14B
DeepSeek-R1-Distill-Qwen-1.5B
DeepSeek-R1-Distill-Qwen-7B
Googlegemma-3-1b-it
gemma-3-4b-it
gemma-3-12b-it
Meta-llamaLlama-3.1-8B-Instruct
Llama-3.2-1B-Instruct
Llama-3.2-3B-Instruct
MistralaiMistral-7B-Instruct-v0.3
Mistral-Nemo-Instruct-2407
QwenQwen3-0.6B
Qwen3-0.6B-Base
Qwen3-1.7B
Qwen3-1.7B-Base
Qwen3-4B
Qwen3-4B-Base
Qwen3-8B
Qwen3-8B-Base
Qwen3-14B
Qwen3-14B-Base
MicrosoftPhi-3-mini-4k-instruct
Phi-3-medium-4k-instruct
IBM-granitegranite-3.2-2b-instruct
granite-3.2-8b-instruct

Steps for Access Token​

  1. Navigate to the Hugging Face website: https://huggingface.co.
  2. Log in to your Hugging Face account.
  3. Go to your account settings and select the Access Tokens tab.
  4. Generate a new token with the required permissions.
  5. Copy the token and provide it when prompted during the model download process in the application.

For more details, refer to the Hugging Face documentation.

warning

Some models, such as LLAMA, require user consent for sharing contact information before download.