Instructions to use senaro/atlas-v21-gemma4-31b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use senaro/atlas-v21-gemma4-31b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="senaro/atlas-v21-gemma4-31b") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("senaro/atlas-v21-gemma4-31b") model = AutoModelForMultimodalLM.from_pretrained("senaro/atlas-v21-gemma4-31b", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use senaro/atlas-v21-gemma4-31b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "senaro/atlas-v21-gemma4-31b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "senaro/atlas-v21-gemma4-31b", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/senaro/atlas-v21-gemma4-31b
- SGLang
How to use senaro/atlas-v21-gemma4-31b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "senaro/atlas-v21-gemma4-31b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "senaro/atlas-v21-gemma4-31b", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "senaro/atlas-v21-gemma4-31b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "senaro/atlas-v21-gemma4-31b", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Unsloth Desktop
- Docker Model Runner
How to use senaro/atlas-v21-gemma4-31b with Docker Model Runner:
docker model run hf.co/senaro/atlas-v21-gemma4-31b
Atlas v21. This version was to test the 31B Dense model. This is the full merged model.
This is an experimental model.
The safety refusals have been altered, do not use without proper safety layers or system prompt.
Trained on curated dataset comprising 60% Opus 4.6/Sonnet 4.6 thinking traces across Math, Science, General Knowledge, 40% Mental Health conversations 50/50 split between synthetic and authentic*
*authentic conversations have been cleaned to remove any personal information and I have approval from the sources
Developed by: senaro
License: apache-2.0
Finetuned from model : senaro/atlas-gemma4-31b-trm7
This gemma4 model was trained 2x faster with Unsloth and Huggingface's TRL library.
License & Attribution
This model is a derivative work fine-tuned from the base Gemma 4 architecture. Use of this model is subject to the Gemma Terms of Use.
Gemma is a trademark of Google LLC.
Citation
BibTeX:
@misc{gemma2026gemma4,
title={Gemma 4 Technical Report},
author={Gemma Team},
year={2026},
eprint={2607.02770},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
APA 7th Edition:
Gemma Team. (2026). Gemma 4 Technical Report (arXiv:2607.02770). arXiv. https://arxiv.org

- Downloads last month
- 13