Image-Text-to-Text
PaddleOCR
Safetensors
English
Chinese
multilingual
paddleocr_vl
ERNIE4.5
PaddlePaddle
image-to-text
ocr
document-parse
layout
table
formula
chart
seal
spotting
conversational
custom_code
Eval Results
Instructions to use PaddlePaddle/PaddleOCR-VL-1.6 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PaddleOCR
How to use PaddlePaddle/PaddleOCR-VL-1.6 with PaddleOCR:
# See https://www.paddleocr.ai/latest/version3.x/pipeline_usage/PaddleOCR-VL.html to installation from paddleocr import PaddleOCRVL pipeline = PaddleOCRVL(pipeline_version="v1.6") output = pipeline.predict("path/to/document_image.png") for res in output: res.print() res.save_to_json(save_path="output") res.save_to_markdown(save_path="output") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -57,7 +57,7 @@ We introduce PaddleOCR-VL-1.6, an upgraded compact document parsing model built
|
|
| 57 |
|
| 58 |
**🚀 New SOTA Accuracy**: OmniDocBench v1.6 achieves **96.33%**, setting new state-of-the-art records on OmniDocBench v1.5 and Real5-OmniDocBench as well. It delivers comprehensive leading performance across text, formula, and table recognition, surpassing both open-source and closed-source solutions.
|
| 59 |
|
| 60 |
-
**⚡ Fully Upgraded Capabilities**: Significant improvements in table, ancient document, and rare character recognition, along with notable enhancements in seal/stamp detection, text spotting, chart recognition, and more diverse scenarios.
|
| 61 |
|
| 62 |
**🔄 Seamless Migration**: The model architecture is **fully compatible with PaddleOCR-VL-1.5** — zero adaptation cost, plug-and-play replacement.
|
| 63 |
|
|
@@ -274,57 +274,30 @@ model = AutoModelForImageTextToText.from_pretrained(model_path, torch_dtype=torc
|
|
| 274 |
> - Real5-OmniDocBench is a brand-new benchmark oriented toward real-world scenarios, which we constructed based on the OmniDocBench v1.5 dataset. The dataset comprises five distinct scenarios: Scanning, Warping, Screen-photography, Illumination, and Skew. For further details, please refer to [Real5-OmniDocBench](https://huggingface.co/datasets/PaddlePaddle/Real5-OmniDocBench).
|
| 275 |
|
| 276 |
|
| 277 |
-
## Visualization
|
| 278 |
|
| 279 |
|
| 280 |
#### Table Recognition
|
| 281 |
|
| 282 |
-
<div align="center">
|
| 283 |
-
<img src="https://raw.githubusercontent.com/cuicheng01/PaddleX_doc_images/refs/heads/main/images/paddleocr_vl_1_5/light.jpg" width="800"/>
|
| 284 |
-
</div>
|
| 285 |
|
| 286 |
|
| 287 |
#### Chart Parsing
|
| 288 |
|
| 289 |
-
<div align="center">
|
| 290 |
-
<img src="https://raw.githubusercontent.com/cuicheng01/PaddleX_doc_images/refs/heads/main/images/paddleocr_vl_1_5/skew.jpg" width="800"/>
|
| 291 |
-
</div>
|
| 292 |
-
|
| 293 |
|
| 294 |
#### Formula Recognition
|
| 295 |
|
| 296 |
-
<div align="center">
|
| 297 |
-
<img src="https://raw.githubusercontent.com/cuicheng01/PaddleX_doc_images/refs/heads/main/images/paddleocr_vl_1_5/screen.jpg" width="800"/>
|
| 298 |
-
</div>
|
| 299 |
-
|
| 300 |
|
| 301 |
#### Chinese Ancient Document Recognition
|
| 302 |
|
| 303 |
-
<div align="center">
|
| 304 |
-
<img src="https://raw.githubusercontent.com/cuicheng01/PaddleX_doc_images/refs/heads/main/images/paddleocr_vl_1_5/scaning.jpg" width="800"/>
|
| 305 |
-
</div>
|
| 306 |
|
| 307 |
#### Chinese Rare Character Recognition
|
| 308 |
|
| 309 |
-
<div align="center">
|
| 310 |
-
<img src="https://raw.githubusercontent.com/cuicheng01/PaddleX_doc_images/refs/heads/main/images/paddleocr_vl_1_5/curving.jpg" width="800"/>
|
| 311 |
-
</div>
|
| 312 |
-
|
| 313 |
|
| 314 |
### Seal Recognition
|
| 315 |
|
| 316 |
|
| 317 |
-
|
| 318 |
-
<img src="https://raw.githubusercontent.com/cuicheng01/PaddleX_doc_images/refs/heads/main/images/paddleocr_vl_1_5/seal.jpg" width="800"/>
|
| 319 |
-
</div>
|
| 320 |
-
|
| 321 |
-
|
| 322 |
-
### Real-world Low-Quality Document Parsing
|
| 323 |
-
|
| 324 |
|
| 325 |
-
<div align="center">
|
| 326 |
-
<img src="https://raw.githubusercontent.com/cuicheng01/PaddleX_doc_images/refs/heads/main/images/paddleocr_vl_1_5/spotting.jpg" width="800"/>
|
| 327 |
-
</div>
|
| 328 |
|
| 329 |
## Acknowledgments
|
| 330 |
|
|
|
|
| 57 |
|
| 58 |
**🚀 New SOTA Accuracy**: OmniDocBench v1.6 achieves **96.33%**, setting new state-of-the-art records on OmniDocBench v1.5 and Real5-OmniDocBench as well. It delivers comprehensive leading performance across text, formula, and table recognition, surpassing both open-source and closed-source solutions.
|
| 59 |
|
| 60 |
+
**⚡ Fully Upgraded Capabilities**: Significant improvements in table, Chinese ancient document, and Chinese rare character recognition, along with notable enhancements in seal/stamp detection, text spotting, chart recognition, and more diverse scenarios.
|
| 61 |
|
| 62 |
**🔄 Seamless Migration**: The model architecture is **fully compatible with PaddleOCR-VL-1.5** — zero adaptation cost, plug-and-play replacement.
|
| 63 |
|
|
|
|
| 274 |
> - Real5-OmniDocBench is a brand-new benchmark oriented toward real-world scenarios, which we constructed based on the OmniDocBench v1.5 dataset. The dataset comprises five distinct scenarios: Scanning, Warping, Screen-photography, Illumination, and Skew. For further details, please refer to [Real5-OmniDocBench](https://huggingface.co/datasets/PaddlePaddle/Real5-OmniDocBench).
|
| 275 |
|
| 276 |
|
| 277 |
+
<!-- ## Visualization
|
| 278 |
|
| 279 |
|
| 280 |
#### Table Recognition
|
| 281 |
|
|
|
|
|
|
|
|
|
|
| 282 |
|
| 283 |
|
| 284 |
#### Chart Parsing
|
| 285 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 286 |
|
| 287 |
#### Formula Recognition
|
| 288 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 289 |
|
| 290 |
#### Chinese Ancient Document Recognition
|
| 291 |
|
|
|
|
|
|
|
|
|
|
| 292 |
|
| 293 |
#### Chinese Rare Character Recognition
|
| 294 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 295 |
|
| 296 |
### Seal Recognition
|
| 297 |
|
| 298 |
|
| 299 |
+
### Real-world Low-Quality Document Parsing -->
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 300 |
|
|
|
|
|
|
|
|
|
|
| 301 |
|
| 302 |
## Acknowledgments
|
| 303 |
|