Home | Appendix

Quick links: |  | Chat Summarization Image Generation Transcription

PRO

|  |  | AI

From setting up your default chat engine and deciding what kind of permissions you give it when searching or working with your Mac, the AI view is where you set these options. For creating AI-based images, see the Image Generation view. And if you need to detect or convert speech to text in images and media files, see the Transcription view. Chat Choose your AI model and settings specific to it, as needed. Also set from where the model can get information, if it can effect changes to your database, and what kind of summaries you'd like it to return. Chat Setup: Specify what large language model (LLM) you want to use and set up any required parameters for it. Note several of the controls here are dynamic and the options will change depending on what LLM you've chosen. Provider: Choose from the list of supported chat engines, e.g, ChatGPT, Anthropic's Claude, or even one you are running locally. API Key: Enter the personalized key you were provided by your AI service provider. URL: Enter the URL of a locally running LLM server. This option will only appear as needed. Model: Choose from the list of models for a specific LLM, e.g., Gemini Flash 8B. Each model may show one of several icons showing its capabilities: for reasoning, for vision, for tooling, for deep search, for coding support, and for cost, with the icon's boldness indicating higher or lower costs. Context Window: This is the number of tokens at a time the LLM can process and "remember" in a conversation. A larger context window means more data is passed or rememebered. However, if you're trying to run a local LLM, larger context windows use more RAM. This also displays how many tokens have been used, sending and receiving responses. Usage: Choose an option to balance cost and quality of results, from fewer tokens with less precision to more tokens but a higher chance of useful results. Role: Define an optional default "persona" or instructions for the AI, e.g., "You are an undergraduate professor presenting to your class. Use Markdown formatting with sections and subsections but no lists. Include links to your sources." This is used in automation, like AI assisted scripting. Assistant: Certain AI models have access to "tooling" and may be able to accept DEVONthink-related commands. You need to decide what behaviors you will allow it to use on your Mac and with your databases. Allow property & content changes: Decide whether the chat assistant can make changes to your database, e.g., add tags to a document or create a new one for you. Allow download of web pages: Allow AI to download the content of web pages to examine as part of its querying process. This may be considered an insecure option. Allow screenshots of window: Allow the AI assistant to capture and examine a screen capture of DEVONthink's window for use in queries. Requires a compatible AI model, e.g, Claude Sonnet. Allow image generation: Allows the AI assistant to create images, e.g., asking `What does the Eiffel Tower look like?` This utilizes the text-to-image engine chosen in the AI > Images settings. Load remote images automatically: Control whether linked images in web content is downloaded for examination. This may be considered an insecure option. Search: Choose from where you would like the chat assistant to search for information: in your Databases, on the arXiv, PubMed or Wikipedia websites, or on the Web, in general. Summarization Model: Choose a specific AI provider and model for summarization or Default to use the Chat model. Style: Determine what summary format you'd like in response to asking chat to summarize a document. The choices are: Text: Gives you a brief synopsis in a few paragraphs. Bullet Points: Returns a list of the main points. Key Points: Provide a distilled response of the main topics. Table: Create a table of columns and rows, often used for correlating pages or links to text. Custom: Provide a summary defined by a template you define in this settings pane. Custom Prompt: Create your own prompt defining what kind of response you'd like, including how you'd like the summary to be structured. Use the special placeholder `%@` to refer to the information being summarized. Image Generation Choose and set up a text-to-image AI model. These controls are dynamic and their options change depending on the model you choose. Image Generator Setup: Model: Choose a supported text-to-image model, e.g, DALL-E or Flux. Size: Choose a predefined size for the images. Style: Choose a predefined style, if applicable. Quality: Decide whether to generate Standard or HD images, if available. API Key: Enter the API key you received from the image generation provider, e.g., Replicate.com for the Flux generator. Transcription AI speech-to-text processes incoming media files and processes them per these settings. For example, an `.mp3` file could be transcribed into a separate annotation file for future use. For each type of text recognition – images or audio/video – choose where to store the recognized text via the Destination dropdown. The available options are: Searchable Text: This is similar to Apple's Live Text feature in that a text layer isn't added to the document, but instead is stored in the database's index and associated with the file. Annotation: Create an annotation file with the transcribed text. Comment: Add the transcribed text as a Finder comment on the file. Images: Decide what live OCR engine you want to process images added to your database: Fast Apple Vision text recognition: Quickly detect text in images using Apple's Vision framework. Often sufficient for many use cases. Accurate Apple Vision text recognition: Detect text in images with an emphasis on accuracy over speed. Text recognition via chat: Uses your chosen Chat model to detect text in images, provided the model supports image analysis. When enabled, you can choose a vision-capable AI model, if desired. Audio & Video: Choose the transcription engine you want to process media files added to your database: Local Apple Speech transcription: Transcribe audio on your Mac with Apple's Speech frameworks. May be less accurate and requires Siri or Dictation to be enabled on your Mac. However, you aren't required to share the information with Apple. Remote Apple Speech transcription: Transcribe audio by sending the data to Apple's servers to be processed by their Speech framework. Remote OpenAI GPT-4o Transcription: Transcribe audio remotely with OpenAI's Whisper service. Remote Mistral Voxtral transcription: Transcribe audio via Mistral's Voxtral Mini model. Add timestamps to transcription: Examines the speech and inserts timestamps at certain points. Transcription Language: Choose the language of the media file to be transcribed. Only used with OpenAI's Whisper. API Key: Enter the API key you received from your AI transcription provider, e.g., OpenAI.