Zotero -> zotfile -> mdnotes -> obsidian -> dataview Workflow

This is a workfrow about setting up a smooth(ish) transition from getting a pdf into zotero (which is a reference manager), annotating it, extracting annotations (with or without color coding for that), pushing those into Obsidian using the @argentum’s mdnotes plugin and have those readily usable with Michael Brenan’s Dataview plugin.

Some Caveats:

  1. The mdnotes plugin I’m using is the current alpha build, that makes all of this really great. I am not sure how any of this will work for future versions of zotero.
  2. I’m using a mac for this, and have not tested the workflow on windows.
  3. I’ve created a basic “Setting up Zotero” process, for those who want that. Feel free to skip anything irrelevant.
  4. I’m currently using Juris-M, which is based on zotero with additional zotero fields for legal referencing. Other than the additional legal information added on to cases in my library, everything else should translate to zotero. The version I’m on is Juris-M 5.0.93m18. I have not tried the latest beta-builds of zotero as of this date. For this post and to avoid confusion, I’m going to say ‘zotero’, which means ‘the Juris-M build of zotero’. I do use Zotero (5.0.96.1) for the main sections #1 and #2, and Juris-M for everything from #3 onward.
  5. I’m using a test-book item in zotero, with a lorem ipsum text randomly highlighted.
  6. I’ve included screenshots and descriptions of what’s happening right before the screenshot.

1. Setting up Zotero and the other add-ons

This is a list of one-time set-ups for this workflow in Zotero.

1.1 Zotero Installation

  1. Go to zotero.org.
  2. Download relevant installation file.
  3. Install zotero on your system.
  4. Get a zotero account.
  5. Open zotero. Once you open zotero, it should show you an Introduction pop-up. If you press Continue, it will take you to the plugin installation window. Here, it shows you the plugins available for the word processing applications you have (including Libre Office and MS Word). If you plan on using citations in any such program, select the appropriate plugins here and press “Continue”, which will install them.
  6. Once this is done, it will take you to an empty-looking window with “My Library” at the top left. This is your library, and if this is your first time using zotero, it’s probably empty. (Screenshot 01)
  7. Collections in Zotero look like sub-folders under “My Library” in the main zotero window, but function like tags, in that you can have the same item in more than one collection at the same time. You can create a new collection by selecting File → New Collection. Enter a name for your new collection (I enter “Open Access”). Press OK. It should show you the new collection under “My Library”. Screenshot 01-2 and 01-3).
    01:

01-2

01-3

1.2 Zotero Sync

Before getting pdfs into zotero, you want to decide where you’d like to store these pdfs. If you’re not planning to use a zotero account to sync your library, then zotero will store your files locally on your computer at the default location. If you are planning on intensive use of zotero for academic citation management, it’s probably best to get an account. If you plan on not syncing your library to any cloud, skip this step.

Zotero offers 300 MB of free storage, and paid upgrades. Depending on your usage, this may or may not be enough. You can also choose to sync your library through a different cloud storage.

Steps.

  1. Open zotero
  2. Go to Preferences (Zotero → Preferences in Mac, Edit → Preferences on win)
  3. Go to the “Sync” tab.
  4. Input your zotero username and password, if you already have an account. Select “Create an account” if you didn’t do that in 1.1 (Screenshot 02)

02 Sync

  1. Once you have an account, if you don’t plan on using zotero sync, unselect “Sync full-text context” as seen in the screenshot.
  2. You can use a webdav account for syncing instead, by choosing the “WebDAV” option in “Sync attachment files in My Library using” option.

If you’re not planning on using zotero file storage but want to use another cloud that isn’t WebDAV, go to the “Advanced” Tab, and then to the “Files and Folders” subtab (screenshot 04).

Zotero allows you to link files into your library (instead of attaching them) and uses the same cloud folder across different computers as long as their path to the “Base directory”. Here’s how to set that up:

  1. Select a base directory for your library under “Linked Attachment Base Directory”. This is where you want to store all your Zotero attachments. (eg. I created a folder in my locally-synced-cloud, and gave it a name, “ZoteroAttachments”) (Screenshot 05)

1.3 Install the Browser Plugin

Steps

  1. Install the zotero plugin on your preferred browser. For this, I’m going with Chrome.
  2. Go to zotero.org/download
  3. Select “Install Chrome Connector”, which should take you to the connector on the Chrome web store.
  4. Select “Add To Chrome” → “Add Extension”.
  5. The plugin should install, and then show you a pop-up that tells you how to use it.
  6. Once installed, click the menu button for the plugin and select Options.
  7. If you’re using sync, select the “Authorize” button under “Save to Zotero.org” and log in to your zotero account when prompted. Once Logged in, accept defaults or change the key to your preference.
  8. The default settings under “Save to Zotero.org” should have “Automatically take Snapshots…” and “Automatically download associated PDFs…” both enabled. I don’t use snapshots, so I have disabled that in mine, but that’s my preference. The defaults are usually fine here.

1.4 Install Zotfile; Install Mdnotes and Better Bibtex for steps in No. 3 onward.

Here are the links to Zotfile, Zotero-mdnotes, and Better BibTex.

Steps:

  1. Save the .xpi files from the installation links onto your computer.
  2. In Zotero, go to Tools → Add-Ons
  3. Click on the settings button at the top-right corner, and select “Install Add-on From File” (Screenshot 06)

  1. Select the downloaded .xpi files and then click Install.
  2. Restart Zotero when prompted.

1.5 Zotfile and Bibtex: Basic Preferences

Zotfile can manage your pdfs, rename them, extract annotations and store them wherever you want it to do that.
Zotero, Zotfile, and mdnotes also have hidden preferences, which I edit in part 3 of this workflow, with examples of different outputs for the various settings.

1.5.1 Zotfile Preferences

Steps for setting up file organisation if you’re using a cloud to link files into zotero

  1. Go to Zotero → Tools → Zotfile Preferences
  2. In general settings, you can tell zotfile where to store your documents. For this, in “Location of Files”, choose Custom Location, and choose the folder you selected in 1.2 (in my case, “ZoteroAttachments”)
  3. You can choose to have zotfile sub-categorise your files in this folder, using these wildcards. Many people choose to categorise by Author (%a) or year (%y).
  4. I prefer organising my files by subject, so I pick %c, meaning collection. You can also combine different wildcards, like so: “%c/%a” (Screenshot 07). The wildcards will create folders with the entirity of the field referred to. In my case, it will create a folder with the name of the collection in Storage (/ZoteroAttachments/CollectionName)

Steps for setting up zotfile renaming

  1. Go to Zotero → Tools → Zotfile Preferences
  2. Under the Renaming Rules Tab, using these wildcards again, decide how you want to name your files. This depends on what works best for you. The default settings can be fine if you like that. I use: “{%a} {(%y)} {%t}”, because I like the way that is visualised. (see screenshot 08)

  1. Next, go to advanced settings, and under “Other Advanced Settings”, select the “Always rename” option for “Automatically rename new attaktments”. Disable “Ask user when attaching new files”. (Screenshot 09).
  2. Close Preferences.

2. Get References and PDF papers into Zotero, Extracting Annotations (basic)

Zotero has browser plugins that allow you to directly add items to zotero. This works well with most journal databases (which, if accessible, sometimes allow you to download the pdf directly through the plugin). It also works well with google scholar, which I’m using for this demo.

For this, I’ve picked a random search for “open access” in google scholar, picking one of the results that gave me access to the pdf (Open Access and global participation in science by James A Evans et al, Science, 20 Feb 2009: Vol. 323, Issue 5917, pp. 1025, DOI: 10.1126/science.1154562).

Steps to get reference and pdf into zotero:

  1. To use the zotero chrome connector, from the google scholar search page, click on the zotero plugin (it should look like a folder) (Screenshot 10)

  2. Once you click on it, it should open a po-pup that lists all the results on the page as selectable items.

  3. Select the one(s) you want. Then select “OK” (Screenshot 11)

  4. The plugin shows a pop-up saying that it is saving to My Library, with the name of the paper below that. It should also show a semi-transparent pdf icen with “Full Text” on it. This becomes opaque if zotero can access the file (which it can, in this case). If you click on the arrow on the right of “My Library”, you can select a different collection for the reference and the file. I select the “Open Access” Collection (Screenshot 12).

  5. Once Zotero has the PDF, zotfile renames it and transfers it to the folder you specified in zotfile settings. You get a pop-up confirming that zotfile has renamed the pdf (Screenshot 14).

  1. You can also add Tags, Clicking on done. Here, I’ve added two tags, Unread and Science (Screenshot 15).

  1. When you go to zotero, you can see the reference you’ve added, along with the snapshot and the link to the file (which is the pdf of the paper that was downloaded with the chrome plugin) (Screenshot 16)

  1. This PDF can be annotated in whatever pdf reader you choose (This does not include the new zotero pdf reader beta tool).

  2. For those who do not care about formatting annotations, Zotfile allows you to extract any annotations you’ve made on the PDF file. simply right-click on the pdf file in Zotero, hover on “Manage Attachments”, and Select “Extract Annotations” (Screenshot 17). This should create a new note for the Reference with any highlights you made in the PDF extracted as text into the note. (Screenshot 18)

Screenshots 17 and 18:

3. Formatting Extracted Annotations for mdnotes and dataview

(I’m using Juris-M from here on, but everything I do here should work the same way on Zotero).

For those who do want to format annotations, Zotfile allows a number of edits to give you a lot of options. I’ll go through some of them here. This requires some comfort with fiddling with and editing the configuration files (or “hidden preferences”) in zotero. This assumes that you’re comfortable enough with step 9 in No. 2. I’m also not going to give screenshots for steps after this point, and instead reserving screenshots for displaying the export format.

Mdnotes has some different templates for the export; The documentation for that is here. Because This workflow involves changing the default and hidden settings for both zotfile and mdnotes, I’m first going to go through my edits in the mdnotes template and then go through the zotfile formatting, so I can display the output in obsidian for the different formats after having edited the mdnotes template

3.1 Mdnotes default template:

The mdnotes plugin comes with a default template, saved in a .md file. You can find this file by checking Tools → Mdnotes Preferences. In the “Export Preferences” tab, the last section shows you the Template Folder path. There, the default template is called “Mdnotes Default Template.md”, and this is the file that I will be using.

In mdnotes preferences, my “Export Preferences” settings are:

  • enable “Use the item’s citekey as title” (this uses the Better BibTex citekey as the title of the .md export. That can be edited by going to Zotero → Preferences, to the “Better BibTex” tab, to the Citation keys sub-tab, and editing the “Citation key format” option. Details for formatting that are at this link. My own format reads: “[auth]([year])[shorttitle3_3]”)
  • “Single file” for File organisation. (I prefer having all my notes on a particular reference in one single file in zotero. Choosing split files exports separate .md files for each note in the reference and a separate metadata note for the reference itself.)
  • A Folder in my Obsidian Vault for the Export Directory (Pick whatever folder works for your organisation of reference notes)
  • “Attach file links to zotero” is enabled

Here’s what the default mdnotes template looks like:

{{title}}

![[%(metadataFileName)#Metadata]]

Other files:
{{mdnotesFileName}}
{{metadataFileName}}

##  Zotero links
{{localLibrary}}
{{cloudLibrary}}

## Notes

This is the template that’s used when you use mdnotes to “Create full export note”. Other export formats are also available, if you want to export individual notes separately into markdown format for obsidian to read.

This includes {{placeholders}} and %(wildcards). Placeholders are the terms within curly brackets, like so: {{placeholder}}, and can be defined in the hidden preferences. Wildcards are the terms in regular brackets following a percentage symbol, like so: %(wildcard). Mdnotes has an option to “skip” placeholders that don’t exist, while this cannot be done for wildcards. If mdnotes encounters a wildcard that doesn’t exist, it exports the term “undefined” in its place. So for this workflow to be robust in exporting different kinds of references, we want to try to use placeholders instead of wildcards. Mdnotes can read custom placeholders, as long as they are defined with existing zotero fields.

3.1.1 Adding and Editing Mdnotes Placeholders

First, we want to create placeholders to add to the YAML Metadata that the Dataview plugin in Obsidian can read. For this, we create custom placeholders that are formatted according to the YAML-dataview requirements, meaning strings need to be in quotes, anything with multiple references (such as a book with more than one author) needs to be formatted with newline bullets for each such item. I have a set of custom placeholders and formats here that can be used.

Steps to add a new Mdnotes Placeholder

  1. Go to Zotero → Preferences → Advanced (subtab) → click on “Config Editor”.
  2. Once inside, search for “mdnotes” (without quotes).
  3. This should show a bunch of settings, listed with “Preference Name”, “Status”, “Type”, and “Value”.
  4. To add a new placeholder, right-click on any preference. Hover over “New”, and Select the option “String”
  5. It opens a pop-up, “New String Value”, asking you to enter the preference name.
  6. Enter extensions.mdnotes.placeholder.yamlauthorlist (without the backticks, if they show up when you’re copy-pasting). This creates a new placeholder, {{yamlauthorlist}}. Press OK.
  7. Next, it asks you to enter string value.
  8. Enter {"content":"Authors: \n- \"{{field_contents}}\"","zotero_field":"author","link_style":"no-links","list_separator": "\"\n- \""} (again without the backticks). This points to the “author” field in zotero, and formats the output to first Tag the output with “Authors:”, and then have the authors each listed in new lines with a ‘-’ bullet and include quotation marks for all the Authors exported, without links on them.
  9. Repeat the process from 4 to 8 for each new placeholder you want to define.

Here are some of my placeholders, I’ve listed them in this format:

  1. {{placeholder}} (What the placeholder does)–> (This is the name of the placeholder to be used in the final template)
  2. Preference name → Use this in Step 6 above.
  3. Value → Use this in Step 8 above.
Placeholders:
  1. {{yamlbooktitle}} (Outputs the title of the book)
  2. extensions.mdnotes.placeholder.yamlbooktitle
  3. {"content":"BookTitle: \"{{field_contents}}\"","zotero_field":"bookTitle","link_style":"no-links"}

.

  1. {{yamlcasetitle}} (outputs the name of the legal case)
  2. extensions.mdnotes.placeholder.yamlcasetitle
  3. {"content":"{{field_contents}}","zotero_field":"caseName","link_style":"no-links"}

.

  1. {{yamldate}} (outputs the date of the reference)
  2. extensions.mdnotes.placeholder.yamldate
  3. {"content":"{{field_contents}}","zotero_field":"date","link_style":"no-links"}

.

  1. {{yamldatedecided}} (outputs the date that a legal case was decided)
  2. extensions.mdnotes.placeholder.yamldatedecided
  3. {"content":"{{field_contents}}","zotero_field":"dateDecided","link_style":"no-links"}

.

  1. {{yamleditorlist}} (outputs the list of editors)
  2. extensions.mdnotes.placeholder.yamleditorlist
  3. {"content":"Editors: \n- \"{{field_contents}}\"","zotero_field":"editor","link_style":"no-links","list_separator": "\"\n- \""}

.

  1. {{yamljurisdiction}} (outputs the jurisdiction of a legal case)
  2. extensions.mdnotes.placeholder.yamljurisdiction
  3. {"content":"Jurisdiction: \"{{field_contents}}\"","zotero_field":"jurisdiction","link_style":"no-links"}

.

  1. {{tags}} (Outputs tags as wiki-style links, separated by commas)
  2. extensions.mdnotes.placeholder.tags
  3. {"content":"{{bullet}} Tags: {{field_contents}}", "field_contents": "{{content}}", "link_style": "wiki", "list_separator": ", "}

.

  1. {{yamltags}} (Outputs the tags of the reference)
  2. extensions.mdnotes.placeholder.yamltags
  3. {"content":"Subjects: \n- \"{{field_contents}}\"","zotero_field":"tags","link_style":"no-links","list_separator": "\"\n- \""}

.

  1. {{yamlcollections}} (outputs the collections that the reference is in)
  2. extensions.mdnotes.placeholder.yamlcollections
  3. {"content":"\n- \"{{field_contents}}\"","zotero_field":"collections","link_style":"no-links","list_separator": "\"\n- \""}

.

  1. {{yamltitle}} (outputs the title of the reference)
  2. extensions.mdnotes.placeholder.yamltitle
  3. {"content":"{{field_contents}}","zotero_field":"title","link_style":"no-links"}

.

  1. {{yamltranslatorlist}} (outputs a list of the translators)
  2. extensions.mdnotes.placeholder.yamltranslatorlist
  3. {"content":"\n- \"{{field_contents}}\"","zotero_field":"translator","link_style":"no-links","list_separator": "\"\n- \""}

(A note on {{yamlcollections}} : I use this right after the tags reference, which adds both collections and tags to the YAML reference “Subjects:”, which is output in {{yamltags}}. I do this because I want both tags and collections to be listed together. It fails if a reference has no tags. If you wish to separate tags and collections, use this Value for {{yamlcollections}} instead: {"content":"Collections: \n- \"{{field_contents}}\"","zotero_field":"collections","link_style":"no-links","list_separator": "\"\n- \""})

Here’s what that looks like inzotero, once done: (Screenshot 19)

Once your custom placeholders are ready, you can edit the default mdnotes template to your liking.
Here’s mine:

---
aliases: [{{yamltitle}}{{yamlcasetitle}}]
Title: "{{yamltitle}}{{yamlcasetitle}}"
{{yamlbooktitle}}
{{yamlauthorlist}}
{{yamleditorlist}}
{{yamltranslatorlist}}
Year: {{yamldate}}{{yamldatedecided}} 
{{yamljurisdiction}}
{{yamltags}}{{yamlcollections}}
---
{{yamlauthor}} ({{yamldate}}{{yamldatedecided}}) {{yamltitle}}{{yamlcasetitle}}

### Metadata

{{itemType}}
{{bookTitle}}
{{author}}
{{proceedingsTitle}}
{{caseName}}
{{jurisdiction}}
{{court}}
{{date}} {{dateDecided}}
{{yearAsVolume}}
{{url}}
{{DOI}}
{{citekey}}
{{collections}}
{{related}}
{{tags}}, #zotero, #literature-notes, #reference
{{pdfAttachments}}
{{book}}
{{editor}}
{{translator}}
{{extra}}
{{abstractNote}}

###  Zotero links
{{localLibrary}}
{{cloudLibrary}}

You can use this template directly; since all of these are placeholders, if a reference doesn’t have a particular zotero field, that particular placeholder will get skipped by default. Once you’re ready to export an item into obsidian, right-click on the item, and select Mdnotes → Create full export note. This creates the note in your chosen folder, which, if in an obsidian vault, exports to obsidian.

3.2 Formatting Extraction of Notes:

For this section, I’m going to describe zotfile hidden preferences for formatting, what they do to the zotfile Extract, and give you screenshots of the zotfile export and the corresponding obsidian export. I’ve created a sample reference item (A book section) for this, with Lorem Ipsum text as the attached PDF file. It has some annotations and highlights of different colors. I’m going to go through a few iterations of formats and give screenshots of the mdnotes output in Obsidian, along with references about what the setting does. You can use the settings for whatever format fits your needs.

I start with the default settings and add additional formats in steps so it’s easy to pick the efefcts you do want, and notice what’s happening with each one. I assume for this that you’re comfortable with using the config editor (described in 3.1.1 above).

3.2.1 Default Zotfile Extraction

By default, Zotfile extraction of Annotations gives Highlights as text in quotes (“Lorem ipsum dolor sit amet”), Annotated comments as italicised text (Test comment on yellow highlight with [[backlinkthingamagees]]), and Underlined annotations as Underlined text in quotes (“Lorem Ipsum Text PDF”). Each of these is followed by a link that opens the page at which the annotation is made in your default PDF viewer. (Screenshots 20, 21)


3.2.2 Changing the Note Title

In zotero’s config editor, the setting extensions.zotfile.pdfExtraction.formatNoteTitle Can be edited to change the Title of the Extracted Note.
The default is <p><b>%(title) (%(date))</b><p>. Because I’m not interested in keeping the date, I change it to <p><b>%(title) </b><p>.
Output in Screenshots 22, 23.


3.2.3 Editing the Annotated Comments

I want to visually separate out my annotated comments from the parts of the main text that are highlighted. I also want to add a tag to my name for searchability.

This requires editing the extensions.zotfile.pdfExtraction.formatAnnotationNote preference.
The default is <p><i>%(content) (<a href="%(uri)">note on p.%(page)</a>)</i></p><br>

Adding Blockquotes

I change it to <blockquote><p> [[%(label)]] %(content) (<a href="%(uri)">note on p.%(page)) </blockquote><br></p>
This adds a blockquote to my annotations; that gives a visual break to emphasise that these are separate from the rest of the text when I review the reference notes, and I know that I wrote them. %(label) extracts the name of the author from the PDF reader used for the annotations. the [[]] tags it, so it’s backlinked to the name in Obsidian for easy reference.
Output in screenshots 24, 25.


(Side note - you might prefer to put highlights in blockquotes, but since this is a reference note, I assume that the default is a quote, and try to emphasise my thoughts on the note with the blockquote, since that is what I need to pay attention to while reviewing).

3.2.4 Changing Underlines

Mdnotes converts underlines to markdown headers. This makes sectioning in the annotations easy - Underlining headers in the PDF makes them sections. To facilitate this, I edit the underline to remove quotation marks and the citation link.

The underlining can be edited in extensions.zotfile.pdfExtraction.formatAnnotationUnderline
The default value is <p>"<u>%(content)</u>" (%(cite))</p>.

I edit that to <p><u>%(content)</u><br></p>
Output in screenshots 26, 27.


3.2.5 Highlight Colors

Zotfile can extract the Highlighted text according to color. It can also separate out the annotations into separate notes according to the color of the highlight. This is controlled in the preference
extensions.zotfile.pdfExtraction.colorAnnotations. This is a boolean preference, the default value is “false”. Doulble clicking it changes it to “true”.

If you want separate notes for each color, double click on the boolean preference extensions.zotfile.pdfExtraction.colorNotes. The default value is false. Changing it to true makes zotfile extract highlights into different notes, grouped by the color of the highlight. For the screenshots, I’m keeping this value as “false”, so you can see the different colors within the same screenshot.

Output in screenshots 28, 29.


3.2.6 Editing the color title output

Now, the reason that I use colored highlights is to visually separate out what I’m thinking when I annotate a document. Yellows are default highlights, Cyans are things that the author says that I think are important for things I’m working on, reds are things that I disagree with the author of the paper on, greens are references I want to follow up and read, Magentas are places where the author critiques someone else.

Having the extracted tags name the color before each annotation does not help me much. Zotfile lets me edit the color categories, so I can tag it with whatever I actually want it to say.

This is in the preference extensions.zotfile.pdfExtraction.colorCategories. The default value is a string of colors and hex codes: {"Black": "#000000", "White": "#FFFFFF", "Gray": "#808080", "Red": "#FF0000", "Orange": "#FFA500", "Yellow": "#FFFF00", "Green": "#00FF00", "Cyan": "#00FFFF", "Blue": "#0000FF", "Magenta": "#FF00FF"}. The color names refer to a range of RGB points that will be read as that particular color category, the hexcode is the category name that zotfile can use instead. I edit this preference to read {"Black": "", "White": "", "Gray": "[[Argument]]:", "Red": "[[Disagreement]]:", "Orange": "[[Idea]]", "Yellow": "", "Green": "- [ ] ", "Cyan": "[[Important]]", "Blue": "[[Confusion]]:", "Magenta": "[[Critique]]:"}
to correspond with the labels I want it to use. I put some of these in backlinks for Obsidian.

For the green tag, I edit the hex code to use a “task” tag, which Dataview can extract.

This is insufficient for getting the output I want, however, which is for the color names to be replaced with the custom tags.
That setting is in extensions.zotfile.pdfExtraction.formatAnnotationHighlight
the default value for this is <p>"%(content)" (%(cite))</p>
I change that to <p>%(color_category) %(content) (%(cite)) <br></p>
Which tells zotfile to use the custom color tags.

Output in screenshots 30, 31.


Removing the colors, retaining colortags

Because of the excessive html text that now gets exported, I prefer not to have colored highlights in my extracted annotations. I can retain the custom color tags and remove the highlights by setting extensions.zotfile.pdfExtraction.colorAnnotations to “false” once again, while retaining the %(color_categories) wildcard in the highlight extraction.
Output in screenshots 32, 33.


Dataview

Once in obsidian, the Dataview plugin can extract and output your references based on different conditions.

In reference to my “green” color tag replacement above, one thing I like to have is an automated reading list, sorted by the book/paper I got the reference from. For this, I use

```dataview
task from #zotero    

For this output, I’m restricting it to the fake tag I created (#authorref) to keep it to the fake reference note. (I usually use #zotero, which lists my reading list from all exported literature notes)

```dataview
task from #authorref 

Output in screenshot 34.

Other Dataview queries and the general format for Dataview can be seen at this link.

32 Likes

This Community Just keeps getting better! Thank you @Cat

2 Likes

incredible documentation, can i get you to do this for some of my FOSS projects? :rofl:

2 Likes

Here’s the string I’ve made (testing still pending)

{"Black": "", "White": "", "Gray": "", "Red": "[[Important]]:", "Orange": "", "Yellow": "[[Author Point]]", "Green": "[[Disagreement]]:", "Cyan": "#pkbmk", "Blue": "[[Re-Read]]:", "Magenta": "- [ ] #litreview"}

I want to use the Checklist plugin so I can pickup #pkbmk and #litreview as hashtags in the way that @tallguyjenks uses them (marking stages of development)

:astonished: :astonished: :astonished:

This is remarkable thank you!

However, if anyone reading this is like me and can’t figure out why it isn’t working quite correctly, check your Zotero version. The new beta version 5.0.97-beta breaks some of this functionality so those of us who have it just have to wait for the fixes to roll out.

I beat my head into a wall for several hours before discovering that.

I have found that you need to use the latest mdnote plugin to use customized placeholder version like 0.1.2 or 0.1.3 don’t support customized placeholder

As I am on Windows, and so it might be different, but I was wondering how you get colours and blockquote to translate into Obsidian? Is it directly in your extracted notes after exporting it into markdown?

In Zotero, everything looks like it should, blockquote and colours and all, but I have nothing in markdown. I’m trying to pinpoint where my problem is and I have a feeling it is during that process.

The only thing I didn’t change from your setup was the extensions.zotfile.pdfExtraction.colorAnnotations again, because I wanted to see if I’d like it that way.

The only thing I can’t get to work quite right is that the note title created by Zotfile includes way more than the first paragraph/block.

My formatNoteTitle should be ending after the date: <p><b>%(title)</b><p><p>- Extracted %(date)</p> - and I’ve tried this with varying layers all the way down to just %(title) with no luck.

Is this one of the issues you’ve seen with the beta? I (perhaps prematurely) updated to the beta too. If you’ve seen this also, I’ll stop tinkering :wink: .

@Erisred this is a weird Zotero/Zotfile bug, click on the note once and then on something else. It should “fix” the note title and only show the first line.

Yes, that works. Unfortunate extra step, but it keeps my filenames tidy. Thanks!

Actually it looks like I may have just forgotten to use zotfile to extract the annotations first. No wonder mdnotes wasn’t working for me! :laughing:

Yes I’m also getting the same thing in my extracted note. But I just accidentally double clicked the note and when I dismissed the popup the note was automatically renamed to just Extracted Annotations. ¯\_(ツ)_/¯

Although I think formatNoteTitle is for the title as it appears in the note since it includes HTML tags. HTML is not used in the note title as it appears in the screenshot above. (to my knowledge anyway, I could be wrong)

1 Like

What I need now is a decent PDF annotation tool that actually works well.

When I double click the PDF in Zotero it just opens in Preview. EDIT: Ok I got the new pdf.js viewer to work but the annotations appear to not be detected by zotfile. :frowning:

I have Skim but it requires jumping through hoops to get the annotations back into the PDF properly.

Are there any really good PDF highlighting/annotation apps out there that work on both MacOS and iOS? So the colors/etc will be consistent.

I really like PDF Expert,other nice editor is pdfPEn (it integrates really nice with Hook)

PDF Expert is free for annotationg on iOS, on Mac it may be quite expensive but I bought it together with VPN and other apps bundle in less than half of normal price

I like Highlights too (the pane with annotation is really nice and it offers export to markdown)

@davecan - I’ve pretty much figured out that Zotero uses the first ‘block’ from the note to create the title for the note - that’s why I was surprised the extraction name had things from the next block(s) in it. I can only assume that if it’s a known bug, and has been reported to Zotfile.

This being the only hang-up in the whole Zotero - Zotfile - Mdnotes process, I’m happy to oblige with an extra click or two.

Foxit Reader works really well with this method (when I tried it out the other month haha).

Colored highlights are really great.

I compared it with Adobe Reader, and surprisingly for exporting highlights Foxit Reader works better. On Mac that is.

Thing is I can’t remember why I found it to be better :sweat_smile: I think it was something due to colors being a bit incompatible with exporting the highlights(?) despite changes to the config file for zotero colors that is.

Tbh I’m really not sure hahaha. It’s also possible that it’s just I make extensive use of the “rectangle area highlight” which works well with this.

And then again, it’s been some time since I used the export highlights functionality with Zotero since I primarily use MarginNotes for all PDFs that I study.

Thank you for this awesome thread.

I am trying to setup a similar workflow, right now my major issue is figuring out how pdf annotation works . When I read a book I also try to make a outline of mine for the book beside highlighting. I’ve noticed that zotfile only extracts highlights and underlines, not sticky notes and text boxes and other useful tools like drawing tools that Adobe provides, I also can’t find some of these tools in the new zotero local pdf reader, and I suppose other pdf readers. I don’t know it is lack of standard or what. Also highlighting and reading a passage in a book which has multiple highlights is a bit annoying. I think it would be very handy if we could extract more that just highlights and underlines from the text. Do you know is that possible with the zotfile or not? I could not find anything useful in zotfile’s setting to this end.

Hi @Archie, unfortunately no, Zotfile only recognizes highlights and underlines. In case this helps: Zotero best practices - #57 by argentum

1 Like

@Archie also to add, sticky notes should work too. Are you using a custom Adobe note? Could you maybe share a screenshot?

1 Like