Also, you can use the inline Key:: Value as well if you like something to be a part of the note body and not be hidden in YAML. And that works with tags! I used to have a #watched tag which Iâd write in my daily note bullets where I watched an interesting YouTube video or movie. Now I do it like this,
- Some note about something
- #watched:: [[Inception (2009)]] with [[John Doe]]
- More notes about other things
And the query in my Watch Log note,
TABLE watched as Watched
FROM #watched
SORT file.ctime ASC
Caveats: The Key:: value part needs to either be on itâs own line OR start as the first part of a sentence. Something like
These are great tips! They take Dataview to a new level by organically integrating it right into the body of the note itself instead of the front matter.
Hi,
I also want to generate a daily note summery.
I donât use yaml and inline-metadata so far, but I do have different headings in my daily note template, like
## Gratitude
## what happend today?
## ...
Now Iâm wondering, if I could use dataview, to just summerize all the content, I wrote underneath the âwhat happend today?â-heading.
Is that possible, and if yes, how could I accomplish this?
Yes, in my summary, I could embed links to the âwhat happened todayâ headings in my daily notes.
but that would mean, if I have 10 daily notes, I would need to manually generate a link to each of the 10 daily note headingsâŚ
But Iâd like the summary to be automatically generated and that new daily notes dynamically be integrated in the summary.
=> to get such a dynamical summary, I assumed that dataview could be the right toolâŚ
Unfortunately, Iâm not so deep in dataview so far. Is it possible to use headings in dataview queries? And if yes, could you give me an example? I didnât find anything in the doc, or maybe I didnât understand the doc correctly.
I see what you mean. Unfortunately Dataview is not the right tool here since it focuses only on metadata and not text or location in the file. You would be able to use dataview to generate your list of filenames for your daily notes, but unfortunately its support for embed links is not great.
A possible alternative might be using Obsidianâs built-in search, which you can stick in a note via a query block. You could use that to search for the heading you want to show.
There also may be community plugins that can help with this, since aggregating from daily notes is something lots pf people want to do.
Unfortunately, the result just shows the files in which the heading âwhat happend todayâ appears, and not the content underneath these headings. How could I achieve a list of the contents underneath the âwhat happend todayâ headings?
You can extract the full âWhat happened today?â section via regex.
For best performance youâll want to change the Dataview query dv.pages() to limit it to your daily notes only. If you use the tag â#dailyâ, that would be dv.pages('#daily')
```dataviewjs
const header = '## What happened today\\?'
// You can update this to filter as you like - filtering for just your daily notes would be good
const pages = dv.pages()
// This regex will return text from the Summary header, until it reaches
// the next header, a horizontal line, or the end of the file
const regex = new RegExp(`\n${header}\r?\n(.*?)(\n#+ |\n---|$)`, 's')
for (const page of pages) {
const file = app.vault.getAbstractFileByPath(page.file.path)
// Read the file contents
const contents = await app.vault.read(file)
// Extract the summary via regex
const summary = contents.match(regex)
if (summary) {
// Output the header and summary
dv.header(2, file.basename)
dv.paragraph(summary[1].trim())
}
}
```
Hi Alan,
thanks a lot for your help und the example-code!!!
I did the following:
I generated a new note, called âdiaryâ, there I pasted your code, in order to get a summarization of all âwhat happend today?â-headers in my daily notes, and get the following result:
If you used my code without any changes, I can confirm that code is working. Just check that you pasted with Ctrl+Shift+V so that you donât paste with any formatting. Or you could paste in source mode rather than Live Preview.
Youâre right, I didnât copy your code with âStrg+Shift+Vâ. I copied your code with âStrg+Vâ and did some formating on my own, so maybe here is the failureâŚ
But hmmm⌠after copying your code with âStrg + Shift + Vâ, I see a strange behaviour here:
Thatâs because there are no notes matching your search. You need to make sure the header variable matches what your actual headers are.
In your original post you have the headers as ## what happend today? with âhappenedâ misspelled. If itâs spelled that way in your actual notes, youâll need to change my code on the first line where it says:
const header = '## What happened today\\?'
If you want to include the question mark, make sure to put it with a double backslash before it like this: today\\?.
Thanks Alan!!! I didnât know, that I must write the complete header in the query, not just a part of it.
⌠Iâm german, so in my daily notes thereâs no âwhat happened today?â but âwas ist heute passiert?â insteadâŚ
But no, everything works perfectly fine. Thanks for your help!
Haha, one last question:
The result of the dataviewjs query is not sorted yet. Is ist possible to sort the result chronologically, corresponding to the filenames of my daily notes, which have the format YYYY-MM-DD?
The sorting hierarchy should be from new to old (up to down of the note).
Okay, and now, the very last question (promise! ):
As you can see, I donât have entries underneath the âwhat happened todayâ-header in every daily note. For example on 2022-08-28 I donât have an entry. Is it possible to sort these daily notes out of the query, which donât have an entry underneath the âwhat happened todayâ-header?
Can I recommend that you have a look at a beginners Javascript course. Thereâs an amazing German instructor who I love, and this is where I learned Javascript:
The file.lists by example - Chapter 3: using DQL to gather list items or task items under the specific heading (and filter by a field) (and sum up a field) (and display each DVIF)
Summary
How to gather list items or task items under the specific heading? (DQL90 , DVJS90)
How to gather list items or task items under the specific heading
Each of the following DQLs requires a specific note.
How to filter by a field? (DQL10, DQL20, DQL30)
How to sum up a field? (DQL63, DQL65)
How to display each DVIF in items as a table
case_FLST_HLSS : DQL10
case_FLST_HLSSS : DQL20
case_FLST_HLDSS : DQL30
case_FLST_HLDDD : DQL61, DQL63, DQL65
Q1: How to gather list items or task items under the specific heading and display each DVIF in items as a table?
Answers: DQL10, DQL20, or DQL30
Q2: How to gather root list items or root task items under the specific heading?
Answers: DQL61, DQL63, or DQL65
Q3: How to distinguish list items from task items from the file.lists data?
Answers
How to distinguish list items from task items from the file.lists data?
a list item: !L.task
a task item: L.task
a root list item: !L.parent AND !L.task
a root task item: !L.parent AND L.task
L : each element of file.lists of each page
No one can distinguish a list item from a task item from the value of L.text where L is an element of file.lists .
Structures:
Summary
Q1: How to use the file.lists data to design a Markdown file as a table in the database, where each record consists of multiple columns?
Summary_Q1
A1_11:
Another Example: A1_11
There are at least four methods to do that by using the file.lists data.
0.To require the note in the following form: case_FLST_HLSS 1.To flatten file.lists 2.To gather list items where the heading contains âmilestonesâ 3.To gather task items where the heading contains âmain tasksâ 4.To filter by F_duration_days 5.To filter by L.tags and L.outlinks 6.To sort by file.link in ascending order 7.To display each DVIF in items as a table [without the desired structure]
Note: Require the files with the case_FLST_HLSS structure
Notes
Require the files with the case_FLST_HLSS structure
case_FLST_HLSS: use file.lists where L.text contains one field separator like " "
FLST: Use file.lists
H: a header
L : an element of file.lists
S: field separators
filename : dic_20040301 contains the heading âmilestonesâ
```md
---
Date: 2004-03-01
---
#Project/P03
Areas:: #research
#### input
##### milestones
- 2004-03-01 add this feature_A #Test/d01 [[Note J]] , [[Note K]]
- 2004-03-02 add this feature_B #Test/d02 [[Note J]]
- 2004-03-03 add this feature_C [[Note K]]
- 2004-03-04 add this feature_D #Test/d04
- 2004-03-05 add this feature_E #Test/d05 [[Note K]]
- 2004-03-06 add this feature_F #Test/d06
- 2004-73-07 add this feature_G #Test/d07
- 2004-03-08 add this feature_H [[Note J]] , [[Note K]]
- 2004-03-09 add this feature_I
- 2004-03-10 add this feature_J
- It is finished!
```
filename : dic_20040401 contains the heading âmain tasksâ
```md
---
Date: 2004-04-01
---
#Project/P04
Areas:: #mocap
## input
### main tasks
- [ ] 2004-04-01 add this feature_a #Test/d01 [[Note P]] , [[Note Q]]
- [ ] 2004-04-02 add this feature_b #Test/d02 [[Note P]]
- [ ] 2004-04-03 add this feature_c [[Note Q]]
- [ ] 2004-04-04 add this feature_d #Test/d04
- [x] 2004-04-05 add this feature_e #Test/d05 [[Note Q]]
- [ ] 2004-04-06 add this feature_f #Test/d06
- [ ] 2004-74-07 add this feature_g #Test/d07
- [ ] 2004-04-08 add this feature_h [[Note P]] , [[Note Q]]
- [ ] 2004-04-09 add this feature_i
- [ ] 2004-04-10 add this feature_j
- [ ] It is finished!
```
title: DQL10_flatten_fLists_and_display_list_items_and_task_items_under_the_heading_and_filter =>0.Require the files with the `case_FLST_HLSS` structure
collapse: close
icon:
color:
```dataview
TABLE WITHOUT ID
file.link AS "File",
choice(L.task, "- [" + L.status + "] " + "", "- " + "") AS "m_or_t",
F_duration_days AS "dur_days",
F_text_without_outlinks AS "Event",
F_sDate_of_L AS "L_sDate",
F_fsDate_of_L AS "L_fsDate",
L.tags AS "tags",
L.outlinks AS "outlinks"
FROM "100_Project/02_dataview/Q92_FileLists/Q92_test_data" AND #Project
FLATTEN file.lists AS L
FLATTEN meta(L.header).subpath AS F_subpath
FLATTEN meta(L.header).type AS F_type
WHERE (contains(F_subpath, "milestones") AND F_type = "header")
OR (contains(F_subpath, "main tasks") AND F_type = "header")
WHERE regexmatch("^\d{4}-\d{2}-\d{2}\s+", L.text)
FLATTEN split(L.text, " ")[0] AS F_sDate_of_L
FLATTEN regexreplace(L.text, "^\d{4}-\d{2}-\d{2} ", "") AS F_text_without_date
FLATTEN regexreplace(F_text_without_date, "\s+#.+$", "") AS F_text_without_tags
FLATTEN regexreplace(F_text_without_tags, "(\s+\[\[.+\]\].*$)", "") AS F_text_without_outlinks
WHERE F_sDate_of_L != null
WHERE date(F_sDate_of_L) != null
FLATTEN date(F_sDate_of_L) AS F_dtDate_of_L
FLATTEN dateformat(F_dtDate_of_L, "yyyy-MM-dd") AS F_fsDate_of_L
FLATTEN Date AS YAML_Date
FLATTEN dur(F_dtDate_of_L - YAML_Date).days AS F_duration_days
WHERE F_duration_days != 0
WHERE (contains(L.tags, "#Test/d05") AND contains(L.outlinks, [[Note K]]))
OR (contains(L.tags, "#Test/d05") AND contains(L.outlinks, [[Note Q]]))
SORT file.link ASC
```
0.To require the note in the following form: case_FLST_HLSSS 1.To flatten file.lists 2.To gather list items where the heading contains âsome eventsâ 3.To gather task items where the heading contains âsome tasksâ 4.To filter by L.tags 5.To sort by file.link in ascending order 6.To display each DVIF in items as a table [without the desired structure]
Note: Require the files with the case_FLST_HLSSS structure
Notes
Require the files with the case_FLST_HLSSS structure
case_FLST_HLSSS: use file.lists where L.text contains at least one field separator like â|â
FLST: Use file.lists
H: a header
L : an element of file.lists
S: field separators
filename : dic_20040301 contains the heading âsome eventsâ
title: DQL20_flatten_fLists_and_display_list_items_and_task_items_under_the_heading_and_filter =>0.Require the files with the `case_FLST_HLSSS` structure
collapse: close
icon:
color:
```dataview
TABLE WITHOUT ID
file.link AS "File",
choice(L.task, "- [" + L.status + "] " + "", "- " + "") AS "m_or_t",
F_sDate_of_L AS "L_sDate",
F_fsDate_of_L AS "L_fsDate",
F_type AS "type",
F_desc AS "desc",
F_cost AS "cost",
L.tags AS "tags",
L.outlinks AS "outlinks"
FROM "100_Project/02_dataview/Q92_FileLists/Q92_test_data" AND #Project
FLATTEN file.lists AS L
FLATTEN meta(L.header).subpath AS F_subpath
FLATTEN meta(L.header).type AS F_type
WHERE contains(F_subpath, "some events") AND F_type = "header"
OR (contains(F_subpath, "some tasks") AND F_type = "header")
WHERE regexmatch("^\d{4}-\d{2}-\d{2}\s+", L.text)
FLATTEN split(L.text, "\s+\|\s+")[0] AS F_sDate_of_L
FLATTEN split(L.text, "\s+\|\s+")[1] AS F_type
FLATTEN split(L.text, "\s+\|\s+")[2] AS F_desc
FLATTEN split(L.text, "\s+\|\s+")[3] AS F_cost
WHERE F_sDate_of_L != null
WHERE date(F_sDate_of_L) != null
FLATTEN date(F_sDate_of_L) AS F_dtDate_of_L
FLATTEN dateformat(F_dtDate_of_L, "yyyy-MM-dd") AS F_fsDate_of_L
WHERE contains(L.tags, "#Test/d02")
SORT file.link ASC
```
0.To require the note in the following form: case_FLST_HLDSS 1.To flatten file.lists 2.To gather list items where the heading contains âother eventsâ 3.To gather task items where the heading contains âother tasksâ 4.To filter by L.tags 5.To sort by file.link in ascending order 6.To display each DVIF in items as a table [without the desired structure]
Note: Require the files with the case_FLST_HLDSS structure
Notes
Require the files with the case_FLST_HLDSS structure
case_FLST_HLDSS: use file.lists where L.text consists of one DVIF and field separators
FLST: Use file.lists
H: a header
L : an element of file.lists
D: DVIF
S: field separators
filename : dic_20040301 contains the heading âother eventsâ
title: DQL30_flatten_fLists_and_display_list_items_and_task_items_under_the_heading_and_filter =>0.Require the files with the `case_FLST_HLDSS` structure
collapse: close
icon:
color:
```dataview
TABLE WITHOUT ID
file.link AS "File",
choice(L.task, "- [" + L.status + "] " + "", "- " + "") AS "m_or_t",
F_sDate_of_L AS "L_sDate",
F_fsDate_of_L AS "L_fsDate",
F_type AS "type",
F_desc AS "desc",
F_cost AS "cost",
L.tags AS "tags",
L.outlinks AS "outlinks"
FROM "100_Project/02_dataview/Q92_FileLists/Q92_test_data" AND #Project
FLATTEN file.lists AS L
FLATTEN meta(L.header).subpath AS F_subpath
FLATTEN meta(L.header).type AS F_type
WHERE contains(F_subpath, "other events") AND F_type = "header"
OR (contains(F_subpath, "other tasks") AND F_type = "header")
WHERE L.info != null
FLATTEN split(L.info, "\s+\|\s+")[0] AS F_sDate_of_L
FLATTEN split(L.info, "\s+\|\s+")[1] AS F_type
FLATTEN split(L.info, "\s+\|\s+")[2] AS F_desc
FLATTEN split(L.info, "\s+\|\s+")[3] AS F_cost
WHERE F_sDate_of_L != null
WHERE date(F_sDate_of_L) != null
FLATTEN date(F_sDate_of_L) AS F_dtDate_of_L
FLATTEN dateformat(F_dtDate_of_L, "yyyy-MM-dd") AS F_fsDate_of_L
WHERE contains(L.tags, "#Test/d02")
SORT file.link ASC
```
0.To require the note in the following form: case_FLST_HLDDD 1.To flatten file.lists 2.To gather root list items or root task items where the heading contains âwhat happened todayâ 3.To sort by file.link in ascending order 4.To display each DVIF in root items as a table [without the desired structure]
Note: Require the files with the case_FLST_HLDDD structure
Notes
Require the files with the case_FLST_HLDDD structure
case_FLST_HLDDD: use file.lists where L.text consists of more than one DVIF
FLST: Use file.lists
H: a header
L : an element of file.lists
D: DVIF
filename : dic_20040301 contains the heading âwhat happened todayâ
title: DQL61_flatten_fLists_and_display_root_list_items_and_root_task_items_under_the_heading =>0.Require the files with the `case_FLST_HLDDD` structure
collapse: close
icon:
color:
```dataview
TABLE WITHOUT ID
file.link AS "File",
choice(L.task, "- [" + L.status + "] " + "", "- " + "") AS "m_or_t",
L.type AS "type",
L.desc AS "desc",
L.cost AS "cost",
L.tags AS "tags",
L.outlinks AS "outlinks",
L.header AS "header"
FROM "100_Project/02_dataview/Q92_FileLists/Q92_test_data" AND #Project
FLATTEN file.lists AS L
FLATTEN meta(L.header).subpath AS F_subpath
FLATTEN meta(L.header).type AS F_type
WHERE !L.parent
WHERE contains(F_subpath, "what happened today") AND F_type = "header"
SORT file.link ASC
```
0.To require the note in the following form: case_FLST_HLDDD 1.To flatten file.lists 2.To gather root list items where the heading contains âwhat happened todayâ 3.To group by file.link and let G_file_link = rows.file.link; 4.To sort by G_file_link in descending order 5.To sum up rows.L.cost as âsum_r_costâ 6.To display each DVIF in root list items as a table [without the desired structure]
Note: Require the files with the case_FLST_HLDDD structure
title: DQL63_flatten_fLists_groupBy_fLink_and_display_root_list_items_under_the_heading_and_sum =>0.Require the files with the `case_FLST_HLDDD` structure
collapse: close
icon:
color:
```dataview
TABLE WITHOUT ID
G_file_link AS "File",
rows.L.type AS "type",
rows.L.desc AS "desc",
rows.L.cost AS "cost",
sum(map(rows.L.cost, (e) => sum(default(e, 0)))) AS "sum_r_cost",
map(rows.L, (L) => choice(L.task, "- [" + L.status + "] ", "a list item")) AS "milestones_or_tasks"
FROM "100_Project/02_dataview/Q92_FileLists/Q92_test_data" AND #Project
FLATTEN file.lists AS L
FLATTEN meta(L.header).subpath AS F_subpath
FLATTEN meta(L.header).type AS F_type
WHERE !L.parent AND !L.task
WHERE contains(F_subpath, "what happened today") AND F_type = "header"
GROUP BY file.link AS G_file_link
SORT G_file_link DESC
```
0.To require the note in the following form: case_FLST_HLDDD 1.To flatten file.lists 2.To gather root task items where the heading contains âwhat happened todayâ 3.To group by file.link and let G_file_link = rows.file.link; 4.To sort by G_file_link in descending order 5.To sum up rows.L.cost as âsum_r_costâ 6.To display each DVIF in root task items as a table [without the desired structure]
Note: Require the files with the case_FLST_HLDDD structure
title: DQL65_flatten_fLists_groupBy_fLink_and_display_root_task_items_under_the_heading_and_sum =>0.Require the files with the `case_FLST_HLDDD` structure
collapse: close
icon:
color:
```dataview
TABLE WITHOUT ID
G_file_link AS "File",
rows.L.type AS "type",
rows.L.desc AS "desc",
rows.L.cost AS "cost",
sum(map(rows.L.cost, (e) => sum(default(e, 0)))) AS "sum_r_cost",
map(rows.L, (L) => choice(L.task, "- [" + L.status + "] ", "a list item")) AS "milestones_or_tasks"
FROM "100_Project/02_dataview/Q92_FileLists/Q92_test_data" AND #Project
FLATTEN file.lists AS L
FLATTEN meta(L.header).subpath AS F_subpath
FLATTEN meta(L.header).type AS F_type
WHERE !L.parent AND L.task
WHERE !rows.L.cost
WHERE contains(F_subpath, "what happened today") AND F_type = "header"
GROUP BY file.link AS G_file_link
SORT G_file_link DESC
```
1.To flatten file.lists 2.To gather list items or task items where the heading contains âwhat happened todayâ 3.To group by file.link and let G_file_link = rows.file.link; 4.To sort by G_file_link in descending order 5.To display the result as a table [without the desired structure]
1.The DQL90 is based on the DQL07 in the following topic. 1.1 Q93_Tasks: Solutions
Notes
dictionary files
filename : dic_20040301 contains the heading âwhat happened todayâ
title: DQL90_flatten_fLists_groupBy_fLink_and_display_list_items_and_task_items_under_the_heading =>1.To flatten file.lists 2.To gather list items or task items where the heading contains "what happened today" 3.To group by file.link and `let G_file_link = rows.file.link;` 4.To sort by G_file_link in descending order 5.To display the result as a table [without the desired structure]
collapse: close
icon:
color:
```dataview
TABLE WITHOUT ID
G_file_link AS "File",
map(rows.L, (L) => choice(L.task, "- [" + L.status + "] " + L.text, L.text)) AS "milestones_or_tasks"
FROM "100_Project/02_dataview/Q92_FileLists/Q92_test_data" AND #Project
FLATTEN file.lists AS L
FLATTEN meta(L.header).subpath AS F_subpath
FLATTEN meta(L.header).type AS F_type
WHERE contains(F_subpath, "what happened today") AND F_type = "header"
GROUP BY file.link AS G_file_link
SORT G_file_link DESC
```
1.To groupBy page.file.link as G1 (G1=group.rows) 2.To flatten page.file.lists 3.To gather a list item(or a task item) under the heading âwhat happened todayâ 4.To display the result by using the dv.taskList [with the desired structure]
1.The DVJS90 is based on the DVJS01 in the following topic. 1.1 Q17_GroupIn: Solutions