Commit Graph

75 Commits

Author SHA1 Message Date
Gabriel Horner
691b8866ef refactor: mv another common ns out of db dir
Allows for more improved separate linting
2025-04-28 11:27:49 -04:00
Gabriel Horner
6ce701ccc3 fix: remove clj-kondo/ignore
that was moved to incorrect location.  Also fix clj-kondo config
so those ignores aren't needed anymore
2025-04-08 13:36:17 -04:00
Tienson Qin
1aca680ae4 Merge branch 'feat/db' into perf/app-start 2025-03-31 21:53:37 +08:00
Gabriel Horner
dd4b68a140 fix: export for overlapping property+class
overlapping entity with blocks was exporting duplicate blocks
2025-03-28 10:39:20 -04:00
Gabriel Horner
9dfb6713ca enhance: export+import supports properties
that double/overlap as classes
2025-03-27 17:02:32 -04:00
Gabriel Horner
e5061f1504 enhance: add export option to exclude-files
Useful for demo graphs as it's noisy and not useful to include since
imported graphs already have it. Also added descriptions for properties
graph to share it
2025-03-27 09:13:14 -04:00
Gabriel Horner
17acbbc8d4 enhance(dev): option to catch export validation errors
to write invalid edn and debug issues quicker
2025-03-26 10:25:54 -04:00
Gabriel Horner
f99a89f9b3 enhance: add :logseq.kv data to graph export
Addresses
https://github.com/logseq/logseq/pull/11784#pullrequestreview-2697690952.
Also improves :set option and removes outdated code in a test
2025-03-19 15:41:12 -04:00
Gabriel Horner
210f583cae enhance(dev): add set option for diff script 2025-03-18 13:00:43 -04:00
Gabriel Horner
332b7a0825 fix: lints and new scripts having same path bugs as feat/db 2025-03-17 12:08:44 -04:00
Gabriel Horner
9b9c22933f fix: built-in pages option
also renamed option and fixed a sorting bug
2025-03-17 11:59:16 -04:00
Gabriel Horner
c215617a0f fix extra exported property for graph
and add import option to diff script
2025-03-17 11:59:16 -04:00
Gabriel Horner
5c07ff3fe7 enhance: option to ignore built-ins for graph export
useful for lambda which has buggy built-in pages
2025-03-17 11:59:16 -04:00
Gabriel Horner
d7721981af enhance: add :exclude-namespaces export option
Useful for graphs with existing ontologies to avoid noisy
and needless exporting. Also update related scripts and noted
that create script has always been able to also update
2025-03-17 11:59:16 -04:00
Gabriel Horner
c344f4a577 CLI can create graphs from exported sqlite.build EDN 2025-03-17 11:59:13 -04:00
Gabriel Horner
ab9796ae60 Add scripts for exporting and diffing graphs
Allows for quick export<->import QA of more complex graphs
and any examples made in app
2025-03-17 11:58:30 -04:00
Gabriel Horner
fecb42f49d fix(dev): deps scripts not handling relative and absolute paths for graphs
transact and create didn't handle relative paths. All scripts except
import didn't handle absolute paths
2025-03-17 11:09:44 -04:00
Gabriel Horner
0cc9205e99 enhance(dev): option to query multiple graphs 2025-03-13 16:00:01 -04:00
Tienson Qin
5d2ab65d7c Merge branch 'feat/db' into feat/blocks-action-bar 2025-03-08 13:55:33 +08:00
Gabriel Horner
7917afaa45 chore: update nbb scripts to be repl friendly
With https://github.com/babashka/nbb/issues/95 done, this allows
all nbb script namespaces to required or used from a repl
2025-03-07 11:49:28 -05:00
Gabriel Horner
1ccdcab8a9 enhance(dev): optionally validate after creating a db
Doing this enough that an option makes this faster to invoke
and faster (no re-open) on large graphs
2025-03-07 11:45:17 -05:00
Gabriel Horner
c6a2ea6959 fix(dev): script fails on -h
Also minor db scripts cleanup
2025-03-06 16:21:21 -05:00
Gabriel Horner
8b8055dd72 refactor: use namespaced keyword for block export
instead of confusing :build/block. Also improved related tests,
simplified import steps, added some missing sqlite.build docs,
and fixed :build/uuid not working for some existing journals.
2025-02-10 15:18:45 -05:00
Gabriel Horner
455ccec296 chore: rename sqlite.build edn to remove mention
of schema. schema concept no longer exists and these old
names would be confusing
2025-01-21 14:22:16 -05:00
Gabriel Horner
68896c257f Merge branch 'feat/db' into refactor/block-schema 2025-01-16 17:11:53 -05:00
Gabriel Horner
769e68a3c6 enhance(dev): add :dispatch-key to validate-db! errors
so it's available to tests and to app
2025-01-15 18:04:47 -05:00
Tienson Qin
a7e9d073cd chore: rename :property/* to :logseq.property/* 2025-01-15 14:59:08 +08:00
Tienson Qin
93a7034249 Remove more cases of :block/schema 2025-01-13 10:00:00 +08:00
Gabriel Horner
b113967c9c enhance(dev): cli validation includes dispatch key
use dispatch-key to immediately find invalid schema
2025-01-10 10:06:43 -05:00
Tienson Qin
68f758cdc9 fix: invalid data
/Validate current graph will try to fix those errors.

fixes https://github.com/logseq/db-test/issues/205.
2025-01-09 21:15:12 +08:00
Tienson Qin
8a0a05183e refactor: remove :block/format for db graphs (#11667) 2025-01-05 12:10:47 +08:00
Gabriel Horner
1bba10c266 fix: graph counts after validation are wrong
after type->tags migration. Also update recommended validate cli options
to default to true. Also clean up graph counts spread across two
validators and importer. The property-pairs count in the UI were way off
because they were only counting pairs that are validated by malli-schema
2025-01-04 02:14:39 -05:00
rcmerci
b0379811c0 fix: fix validate db test (2) 2024-12-02 13:59:06 +08:00
rcmerci
d2c877b484 fix: fix validate db test 2024-12-02 13:51:27 +08:00
Gabriel Horner
e231192cda enhance: add import metadata
Useful for debugging different types of imports and knowing
when import was done, especially since it can differ from when
graph was created
2024-10-17 13:23:30 -04:00
Gabriel Horner
fbcaeb5e20 fix: example edn uses outdated property type 2024-08-20 17:10:28 -04:00
Tienson Qin
f46372b346 chore: keep using class instead of tag for internal usage 2024-08-06 07:15:41 +08:00
Tienson Qin
411b05e7ba Prefer to use ldb/{type}? check when possible 2024-08-05 17:51:24 +08:00
Tienson Qin
4083a2d0a0 enhance: prefer tag instead of class on UI
Some users are confused with Classes/Objects, so on UI it'll be
Tags/Nodes.
2024-08-05 15:06:54 +08:00
Tienson Qin
d26e620a82 refactor: update :block/type to cardinality one instead of many 2024-07-31 19:35:26 +08:00
Tienson Qin
d847023dc1 Refactor: rename :block/content to :block/title 2024-07-10 22:33:44 +08:00
Tienson Qin
a1f352773b refactor: rename :block/original-name to :block/title 2024-07-10 21:43:03 +08:00
Gabriel Horner
9a8c91c0cc chore: mv logseq.db.sqlite.db into sqlite.cli
for more explicit name and purpose. Also updated outdated db readme
and removed unused fns in logseq.db.sqlite.db
2024-06-14 16:53:19 -04:00
Gabriel Horner
95db811f55 fix: frontend tests shouldn't depend on sqlite3
frontend.test.helper was accidentally coupled to sqlite3 via
logseq.outliner.db-pipeline. Split out sqlite3 dependent fns to
logseq.outliner.cli so it's clear this shouldn't be coupled to frontend
2024-06-14 14:41:24 -04:00
Gabriel Horner
0f122e9a7e fix: schema graph generation
Regressed with property value change. Also updated debug file and
fixed a missing built-in property ns which caused an invalid debug file
2024-06-14 11:38:14 -04:00
Gabriel Horner
0e1ada2ef6 enhance: bb task for creating graphs from EDN file
Converted inferred graph to an EDN file now that this task exists. Also
merge last of tasks.create-graph to relevant ns so that external users
can also create such tasks
2024-06-11 10:09:37 -04:00
Gabriel Horner
32ca012635 enhance: pretty print + colorize query script by default 2024-05-23 14:58:55 -04:00
Gabriel Horner
670b46f221 fix: validate property values again
caused by property pair revert 5d4ae66d86
2024-04-30 12:25:12 -04:00
Gabriel Horner
2f0fc3c18c fix: large graph creation having blank and incorrect block counts
large graph chunking assumed a certain tx order which isn't guaranteed.
There are also some edge cases where blocks could get separated from
each other which are now fixed. Also fixed a bug with validating user
properties and made small enhancement for query script
2024-04-23 09:25:07 -04:00
Gabriel Horner
0853940a34 fix: closed :default values validate correctly
and values can be selected from UI. Also tweak query to expand
properties if available
2024-04-16 11:59:04 -04:00