AI product Open source
OXR (Optical Everything Recognition) is an open-source AI document-parsing model and service from the SoMark team. It converts PDFs and document images into agent-oriented Markdown or JSON, extracting text, tables, formulas, code blocks, chemical equations, chemical structures, and other document elements with layout bounding-box coordinates.
Its architecture separates layout analysis from the OXR recognition model, while integrating reading-order handling into recognition. The layout-analysis component is independently replaceable, allowing a custom layout model to be used while retaining OXR's content recognition and reading-order capabilities. During post-training, it uses a recursive self-improvement loop that targets samples the model handles incorrectly or weakly without human annotation.
OXR can run locally on Linux with a supported NVIDIA GPU and is distributed with Docker and source-based deployment options. It also provides a web demo and parsing API, with compatibility for SoMark's Python and JavaScript SDKs and CLI tools. The repository is released under the custom OXR Open Source License, based on Apache 2.0 with additional terms.
1 use taken from transcripts — each links to the moment in the video.
Turns messy PDFs and document images into data AI tools can work with, extracting text, tables, formulas, and chemical structures and exporting as markdown or JSON with page positions. Runs on a supported NVIDIA GPU with a swappable layout model.
1 in the library.