Marker PDF to MD

🌟 Introduction

Welcome to this Obsidian PDF to Markdown Converter! This plugin brings the power of advanced PDF conversion directly into your Obsidian vault. By leveraging the capabilities of Marker through a self-hosted API, the hosted solution on datalab.to, or the powerful MistralAI OCR capabilities, this plugin offers a seamless way to transform your PDFs into rich, formatted Markdown files, with support for tables, formulas and more!

[!IMPORTANT] This plugin requires a Marker API endpoint, a paid account for datalab, the python api of marker, or a free MistralAI API key to work. Without an endpoint, the application can't convert anything.

You can find the related repositories and services here:

• Marker Project (AI model for PDF conversion + Simple Python API)
• datalab.to (Hosted API for the Marker AI model, provided by the developer himself)
• Marker API Docker Container (Container for self-hosting, needs Nvidia GPU)
• Marker API (API for self-hosting the conversion service)
• MistralAI (Free OCR API with excellent results)

🚀 Features

• OCR Capabilities: Convert scanned PDFs to rich markdown
• Formula Detection: Accurately captures and converts mathematical formulas
• Table Extraction: Preserves table structures in your Markdown output
• Image Handling: Extracts and saves images from your PDFs and includes them in the markdown
• Batch Processing: Convert multiple PDFs at once by selecting files with Alt + Click (Note: Processing multiple files may take considerable time depending on their size and complexity)
• Mobile Compatibility: Works on both desktop and mobile Obsidian apps
• Flexible Output: Choose between full content extraction or specific elements (text/images)
• Smart Folder Integration: If a folder with the PDF's name already exists, the plugin will ask if you want to integrate the new files into the existing folder

🛠 Why This Plugin?

1. Superior Extraction: Utilizes the Marker project's advanced AI model or MistralAI's powerful OCR for high-quality conversions
2. Mobile Accessibility: Unlike many converters, this works seamlessly on mobile devices (when the API is accessible)
3. Customizable: Tailor the conversion process to your specific needs
4. Obsidian Integration: Converts PDFs directly within your Obsidian environment

♥️ Support the Project

If you enjoy this plugin, feel free to star the repository and share it with others! When you want to support the development, consider buying me a coffee:

📋 Requirements

To use this plugin, you'll need:

1. A working Obsidian installation
2. Access to a Marker API endpoint (self-hosted, paid service, or Python API server) OR a free MistralAI API key

🔧 Setup

1. Install the plugin in your Obsidian vault
2. Choose your conversion method:
   • MistralAI: Get a free API key from console.mistral.ai/api-keys
   • Datalab.to: Sign up for a paid account
   • Self-hosted Marker API: Set up Docker on a machine with a solid GPU/CPU
   • Python Local API: Run the Python server on the same local machine where Obsidian is running. It passes the absolute local file path to the API.
   • Python Cloud API: Run the Python server on a remote server, a separate machine, or in WSL. It uploads the file contents using multipart form data, which is necessary since the API server cannot access the local files directly.
3. Configure your chosen endpoint/API key in the plugin settings

Which solution should I use?

[!NOTE] MistralAI Privacy Consideration: When using the MistralAI endpoint, your PDFs will be uploaded to Mistral's servers for processing. These files are stored for at least 24 hours. If you have sensitive documents, consider using a self-hosted solution instead.

🧾 Usage

You can convert PDFs to Markdown in multiple ways:

1. Single PDF file: Right-click on a PDF file in the file explorer and select "Convert to MD" from the context menu
2. Multiple PDF files: Select multiple PDF files with Alt + Click and right-click to convert them all at once
3. PDF file in editor: After opening a PDF file in the editor, click on the three dots in the top right corner and select "Convert to MD"
4. Use the command palette: Open the command palette and search for "Convert PDF to MD" (only works if a PDF file is open)

Folder Integration: If a folder with the same name as your PDF already exists, the plugin will ask if you want to integrate the new files into this existing folder. This allows you to update or add to already converted documents.

⚙️ Settings

🙏 Acknowledgements

This plugin wouldn't be possible without the incredible work of:

• Marker Project: The AI model powering the conversions
• Marker API: The API that enables self-hosting of the conversion service
• MistralAI: For providing the free OCR capabilities

A huge thank you to these projects for their contributions to the community!

🐛 Troubleshooting

If you encounter issues related to the plugin itself, please open an issue in this repository. For problems with the conversion process or API, please refer to the Marker and Marker API repositories.

[!NOTE] When converting multiple files at once, be patient as the process can take a significant amount of time depending on the size and complexity of your PDFs. For very large batches, consider processing them in smaller groups.

🤝 Contributing

Contributions, issues, and feature requests are welcome! Feel free to check the issues page.

Happy converting! 📚➡️📝