Instructions to use darkmaniac7/tokforge-assets with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use darkmaniac7/tokforge-assets with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf darkmaniac7/tokforge-assets:Q4_K_M --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf darkmaniac7/tokforge-assets:Q4_K_M --embeddings
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible embeddings server: ./llama-server -hf darkmaniac7/tokforge-assets:Q4_K_M --embeddings
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible embeddings server: ./build/bin/llama-server -hf darkmaniac7/tokforge-assets:Q4_K_M --embeddings
- LM Studio
- Jan
- Ollama
How to use darkmaniac7/tokforge-assets with Ollama:
ollama run hf.co/darkmaniac7/tokforge-assets:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use darkmaniac7/tokforge-assets with Docker Model Runner:
docker model run hf.co/darkmaniac7/tokforge-assets:Q4_K_M
- Lemonade
How to use darkmaniac7/tokforge-assets with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull darkmaniac7/tokforge-assets:Q4_K_M
Run and chat with the model
lemonade run user.tokforge-assets-Q4_K_M
List all available models
lemonade list
- Atomic Chat
tokforge-assets
Published by TokForge for on-device inference.
Support assets used by TokForge.
This repository is not a standalone language model release. It stores auxiliary runtime assets that are useful to the app and related tooling.
Current contents
kokoro-en-v0_19/: Kokoro v0.19 text-to-speech (ONNX, fp32 and INT8)sherpa-onnx-whisper-tiny.en/: Whisper tiny.en speech recognition (ONNX INT8)zipvoice-distill-int8/: ZipVoice-Distill text-to-speech with a Vocos vocoder (ONNX)bge-small/: bge-small-en-v1.5 embeddings (GGUF Q4_K_M)
Intended use
- TokForge app support files
- voice / auxiliary feature experiments
- reproducible hosting of shared runtime assets
Limitations
- Not a full model card for a standalone chat model
- No Hugging Face Inference widget is expected here
- Contents may evolve as TokForge asset packaging changes
TokForge
- Website: https://tokforge.ai
- Discord: https://discord.gg/Acv3CBtfVm
- Google Play: https://play.google.com/store/apps/details?id=dev.tokforge
- iOS TestFlight: https://testflight.apple.com/join/jnufjzRr
Runs on-device in the TokForge app.
License
The folders here are under different licenses. zipvoice-distill-int8/ holds k2-fsa's ZipVoice-Distill model, which k2-fsa publishes under CC-BY-NC (non-commercial) on its model card; the repo metadata declares that, the most restrictive license here. The Vocos vocoder in the same folder is MIT. kokoro-en-v0_19/ is Apache-2.0 except its espeak-ng-data/, which is eSpeak NG data under GPL-3.0. Whisper tiny.en and bge-small-en-v1.5 are MIT. Each part is listed under Credits.
Credits
- Kokoro-82M v0.19 by hexgrad (Hugging Face). Used under the Apache-2.0 license. In
kokoro-en-v0_19/. - eSpeak NG data (GitHub), in
kokoro-en-v0_19/espeak-ng-data/as shipped with the sherpa-onnx Kokoro export. Used under the GPL-3.0 license. - The Kokoro ONNX export is from sherpa-onnx by k2-fsa (Apache-2.0), via csukuangfj/kokoro-en-v0_19.
- Whisper tiny.en by OpenAI (Hugging Face), in
sherpa-onnx-whisper-tiny.en/: unmodified sherpa-onnx INT8 export from csukuangfj/sherpa-onnx-whisper-tiny.en. Used under the MIT license (LICENSE.whisper). - ZipVoice-Distill by k2-fsa (Hugging Face, GitHub), in
zipvoice-distill-int8/. As k2-fsa publishes it: the code is under the Apache-2.0 license, and the pre-trained model is under CC-BY-NC (non-commercial) because of its Emilia training data. - Vocos mel 24 kHz vocoder by Charactr (Hugging Face). Used under the MIT license. As
zipvoice-distill-int8/vocos_24khz.onnx. - bge-small-en-v1.5 by BAAI (Hugging Face). Used under the MIT license. As
bge-small/bge-small-en-v1.5-q4_k_m.gguf, quantized with llama.cpp.
- Downloads last month
- 12
4-bit