NorBERT3-absa-coarse-sent

This model is a fine-tuned version of NorBERT3-large, applied on the sentence-level NorPaC_absa dataset. The model is trained on a total of 25 unique coarse aspect+sentiment labels.

Example Usage

import torch
from transformers import AutoTokenizer, AutoModelForSequenceClassification

tokenizer = AutoTokenizer.from_pretrained("ltg/norbert3-coarse-absa", trus_remote_code=True)
model = AutoModelForSequenceClassification.from_pretrained("ltg/norbert3-coarse-absa", trust_remote_code=True)

model.eval()

text = "fastlegen lytter til meg, men jeg synes ventetiden er for lang."

# tokenize input
inputs = tokenizer(text, return_tensors="pt", truncation=True, padding=True, max_length=512)

# Run inference
with torch.no_grad():
    outputs = model(**inputs)

# Get predictions
threshold = 0.5
probs = torch.sigmoid(outputs.logits).squeeze()
predictions = [model.config.id2label[i] for i, prob in enumerate(probs) if prob > threshold]
print(predictions)
# -> ['staff_pos', 'avail_neg'] (Healthcare providers and staff:positive, Access and availability:negative)

Class labels

List of labels and abbreviations coming.

Evaluation

GP SMH
60.76\std{1.84} 66.79\std{1.66}

The table shows weighted avg. F1 scores averaged across five seeds for the General Practitioner (GP) and Special Mental Healthcare (SMH) domain.

Citation

@inproceedings{storset-etal-2026-pain,
    title = "From Pain to Praise: Aspect-Based Sentiment Analysis for {N}orwegian Patient Feedback",
    author = "Storset, Lilja Charlotte  and
      Jelin, Elma  and
      Norman, Rebecka Maria  and
      Bjertnaes, Oyvind  and
      {\O}vrelid, Lilja  and
      Velldal, Erik",
    editor = {Danilova, Vera  and
      Kurfal{\i}, Murathan  and
      S{\"o}derfeldt, Ylva  and
      Reed, Julia  and
      Burchell, Andrew},
    booktitle = "Proceedings of the 1st Workshop on Linguistic Analysis for Health ({H}ea{L}ing 2026)",
    month = mar,
    year = "2026",
    address = "Rabat, Morocco",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2026.healing-1.16/",
    doi = "10.18653/v1/2026.healing-1.16",
    pages = "191--202",
    ISBN = "979-8-89176-367-8",
    abstract = "This paper describes a new dataset for aspect-based sentiment analysis (ABSA) for analyzing patient feedback about healthcare services. In an interdisciplinary collaboration spanning the fields of natural language processing and healthcare research, we manually annotate a dataset of 2382 free-text comments collected from national patient experience surveys in Norway, covering two sub-fields of services {--} special mental healthcare and general practitioners. Annotations are provided on both the sentence- and comment-level, covering a fine-grained set of 25 unique healthcare-related aspects and their polarities. We also report results for fine-tuning both encoder- and decoder models on the resulting dataset, comparing different modeling strategies, like joint and sequential prediction of aspects and polarity. The resources developed in this work can assist healthcare researchers in the analysis of patient feedback, bringing a much more efficient approach compared to today{'}s manual analysis, potentially leading to improved patient satisfaction and clinical outcomes."
}
Downloads last month
27
Safetensors
Model size
0.4B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ltg/norbert3-coarse-absa

Finetuned
(8)
this model

Collection including ltg/norbert3-coarse-absa