Commit Graph

727 Commits

Author SHA1 Message Date
Gabriel Horner
052d239682 enhance(dev): add debug context for get-page-uuid in importer 2024-12-19 14:54:13 -05:00
Gabriel Horner
409107f385 fix: duplicate journal pages when deadline is on same day
as block's page. Switched to using page-names-to-uuids instead
of db since it has the uuids of current page. Fixes logseq/db-test#192
2024-12-19 14:27:37 -05:00
Gabriel Horner
af044ddb1e fix: remove unnecessary block/refs task calculations
Part of LOG-3198. Also fix test assertion and add another
2024-12-04 15:57:55 -05:00
Gabriel Horner
d0a6ebf389 chore: add test for page block/refs fix
test for logseq/db-test#134
2024-12-03 17:12:18 -05:00
Gabriel Horner
14a621fdcb fix: imported pages don't have :block/refs
Fixes logseq/db-test#134. Also does a good chunk of
https://github.com/logseq/db-test/issues/134 as ref calculation of db
graphs was refactored to be reused across UI and CLI
2024-12-03 16:16:56 -05:00
Tienson Qin
665d7a817c fix: tests 2024-11-30 17:12:15 +08:00
Tienson Qin
cc27407699 fix: store #tag as #[[uuid]] internally 2024-11-30 17:12:15 +08:00
Tienson Qin
faf7f48860 refactor: internal ref uses [[uuid]] instead of ~^[[uuid]] 2024-11-30 17:12:15 +08:00
Gabriel Horner
a987826a48 enhance: import cards correctly regardless of tag options
and also ignore card properties which can't be applied in db version.
Fixes LOG-3062
2024-11-26 16:03:12 -05:00
Tienson Qin
326a7aa6ea Merge branch 'feat/db' into feat/property-default-value 2024-11-25 14:39:11 +08:00
Gabriel Horner
99bf950bd1 fix: import with journal refs result in invalid blocks 2024-11-22 16:07:38 -05:00
Gabriel Horner
6f0885b374 fix: importing a class via :parent that is then used
in :type property fails
2024-11-22 15:01:08 -05:00
Gabriel Horner
bfffde8b2d fix: import of some class pages can still lose identity
Some pages that turn into classes were still having split uuids.
Underlying cause was that existing page uuid was incorrect
2024-11-22 11:30:07 -05:00
Gabriel Horner
9c3785bca6 Merge branch 'feat/db' into feat/property-default-value 2024-11-21 11:49:44 -05:00
Gabriel Horner
8e81d7d855 enhance(dev): task to import multiple file graphs easily
Also add a --continue option to see all errors on a CLI import
2024-11-21 10:30:58 -05:00
Gabriel Horner
049bcd069f enhance: default to importing all tags
Fixes LOG-3235. Still default to not importing all tags in tests and
scripts to simplify their workflows
2024-11-21 18:32:45 +08:00
Gabriel Horner
b1cbc4aa35 fix: docs graph fails to import with both property*
options enabled
2024-11-21 18:32:45 +08:00
Gabriel Horner
a5832cc3f2 fix: db-import of property-classes option fails on docs graph
Fixed by ensuring that tag names and namespace names don't conflict
when making class idents. The specific bug was a conflict between
Tool class and Whiteboard/Tool. Interestingly the bug didn't appear
if the Tool's description property wasn't present.

Also fixed some importer tests not parsing namespaces correctly
or taking :verbose option
2024-11-21 18:32:45 +08:00
Gabriel Horner
5541205674 enhance: default to importing all tags
Fixes LOG-3235. Still default to not importing all tags in tests and
scripts to simplify their workflows
2024-11-20 13:31:42 -05:00
Gabriel Horner
484648b986 fix: docs graph fails to import with both property*
options enabled
2024-11-20 10:39:21 -05:00
Gabriel Horner
b5203fa4d3 fix: db-import of property-classes option fails on docs graph
Fixed by ensuring that tag names and namespace names don't conflict
when making class idents. The specific bug was a conflict between
Tool class and Whiteboard/Tool. Interestingly the bug didn't appear
if the Tool's description property wasn't present.

Also fixed some importer tests not parsing namespaces correctly
or taking :verbose option
2024-11-19 16:43:23 -05:00
Tienson Qin
15e3ce9858 fix: graph parser tests 2024-11-19 18:08:17 +08:00
Gabriel Horner
fb18cc5f52 fix: typo 2024-11-18 17:00:54 -05:00
Gabriel Horner
3469dfd65d fix: db import of blocks with namespaced tags are only tagged
with child leaf tag. Fixes two tags issue reported in
https://github.com/logseq/db-test/issues/7#issuecomment-2463162620
2024-11-18 16:53:03 -05:00
Gabriel Horner
bb98ec1004 refactor: most class creation in db import is like any other page tx
and not embedded in :block/tags. Doing this allows for simpler import tx
and is necessary in order to post process :block/tags
2024-11-18 15:47:31 -05:00
Gabriel Horner
7c6ba2dbc2 fix: importer tests with individual files didn't have flag set
Resulted in some incorrect block extraction e.g. namespaces
2024-11-18 13:55:12 -05:00
Gabriel Horner
2569488493 fix: db import of namespaced tags across multiple pages
Fixes conflicting upserts seen in
https://github.com/logseq/db-test/issues/7#issuecomment-2480564898
2024-11-18 11:40:55 -05:00
Gabriel Horner
7e25dd2a5d fix: db import of empty journal failing hard
Fixes `Vector's key for assoc must be a number.` error from
https://github.com/logseq/db-test/issues/7#issuecomment-2480564898.
This lower level graph-parser had been returning the wrong data
structure for awhile
2024-11-18 09:46:39 -05:00
Gabriel Horner
bb133c4eba fix: test cleanup for 2c23731b5d
Remove assertion that is no longer valid and remove
property filtering for a test that is no longer needed
2024-11-15 16:04:10 -05:00
Gabriel Horner
d4caacce3d fix: tags and refs on same page should have same uuid
Fixes identity issue in 1st section of
https://github.com/logseq/db-test/issues/7#issuecomment-2463162620
2024-11-14 17:21:06 -05:00
Gabriel Horner
1e128db972 refactor: also mv favorites page into initial create
and mark as built-in since it is
2024-11-14 12:00:14 -05:00
Gabriel Horner
cc126c009c refactor: Mv creation of initial views blocks for db graph
to initial transact!. Db graph should have everything it needs with
initial transact. With views page in new db graphs, test was able to
catch a bug, views page wasn't marked as a built-in? when it is
2024-11-14 11:44:37 -05:00
Gabriel Horner
b250e262d2 enhance: journal pages and blocks are created on their journal day
Fixes https://github.com/logseq/db-test/issues/77
2024-11-13 14:22:25 -05:00
Gabriel Horner
f1624fb20c fix: import namespaced tag correctly
Fixes db graphs being invalid and some of
https://github.com/logseq/db-test/issues/7#issuecomment-2463162620
2024-11-12 14:10:06 -05:00
Gabriel Horner
3154b849dd enhance(dev): add latest import options to script 2024-11-12 10:56:05 -05:00
Tienson Qin
502e3fd807 Merge branch 'feat/db' into refactor/dsl-query 2024-11-08 15:13:19 +08:00
Gabriel Horner
230e74fcd6 fix: tests and doc strings 2024-11-07 21:34:37 -05:00
Gabriel Horner
0fcbe9fe89 fix(dev): import script's user options 2024-11-06 15:22:45 -05:00
Gabriel Horner
643ff63a10 fix: 3 user options defaulting to #{""} values
which could have caused subtle bugs. Also cleaned up user-options so
future changes don't require making so many changes
2024-11-06 11:13:03 -05:00
Tienson Qin
3391ab2076 Merge branch 'feat/db' into refactor/dsl-query 2024-11-06 12:20:51 +08:00
Tienson Qin
1519d035b5 fix: graph-parser tests 2024-11-06 11:43:15 +08:00
Gabriel Horner
a3fde2a9f4 enhance: add import option to remove-inline-tags
Part of LOG-3235. Now with the ability to import all tags, Some users
will want to keep inline tags
2024-11-04 17:27:00 -05:00
Tienson Qin
38b0e1bfe3 Merge branch 'feat/db' into refactor/dsl-query 2024-11-04 12:43:36 +08:00
Gabriel Horner
2232fc8a1d fix: removing tags from content
when two tags have same prefix e.g. foo and foo-bar.
Similar issue to b34325be77.
Also tweaked import wording
2024-11-01 16:50:47 -04:00
Gabriel Horner
0f5faf7b40 enhance: user can optionally import all tags as classes in UI
Part of LOG-3235 and part of logseq/db-test#7
2024-11-01 14:19:39 -04:00
Tienson Qin
88a7602bda fix: graph parser tests 2024-11-01 15:51:04 +08:00
Tienson Qin
ba3a8b84fb fix: query dsl tests 2024-11-01 09:47:21 +08:00
Gabriel Horner
0036a5d9de fix: invalid throws and remove unused values
Caught by updating to latest kondo
2024-10-31 14:12:09 -04:00
Tienson Qin
03b3291486 Merge branch 'feat/db' into refactor/dsl-query 2024-10-31 20:57:40 +08:00
Gabriel Horner
379b7768ce enhance: add optional support for importing all tags as classes
Part of LOG-3235 and fixes part of logseq/db-test#7. Not enabled in UI yet as need to test more
2024-10-29 16:17:01 -04:00