megayu
79c25837cb
Migrate from yarn to pnpm ( #12529 )
...
* migrate yarn to pnpm
* chore: update pnpm version to 10.33.0 across all package.json files
* chore: update .npmrc and package.json for improved dependency management
* chore: unify Clojure, Node, and Java version in workflow files
* fix: enable shamefully-hoist for now and add electron, keytar to onlyBuiltDependencies
* feat: add cider/piggieback dependency and update nREPL middleware configuration to silence warnings
* ensure pnpm setup prior to node setup
* fix: update logseq/bb-tasks git SHA
* feat: add pnpm configuration for onlyBuiltDependencies in package.json
* feat: add onlyBuiltDependencies configuration for better-sqlite3 in pnpm settings
* chore: update pnpm lockfile
* fix: resolve merge conflicts
* fix: remove invisible characters from markdown headers
* fix: update .npmrc comments for clarity on lockfile usage
* Revert "feat: add cider/piggieback dependency and update nREPL middleware configuration to silence warnings"
This reverts commit 70a111936f .
* fix: remove invisible characters from various README files and add .editorconfig
* fix: clarify lockfile resolution process in SKILL.md
---------
Co-authored-by: Tienson Qin <tiensonqin@gmail.com >
2026-04-24 23:40:25 +08:00
Tienson Qin
fc76192631
fix: stabilize uuid-based outliner ops and undo/redo replay
2026-04-14 22:11:51 +08:00
Tienson Qin
9baeee6e49
simplify transact ops
2026-04-12 15:41:22 +08:00
Tienson Qin
4a35692a50
tooling(db): add sqlite sync replay script
2026-04-09 22:46:32 +08:00
Tienson Qin
8e0114a793
chore(sync-tools): add checksum drift and replay diagnostics tooling
2026-04-09 03:28:00 +08:00
Gabriel Horner
f28e001b5a
enhance: ensure export EDN is idempotent across import and export
...
An EDN export should consistently produce the same EDN when imported
into a new graph and re-exported. This adds initial fn, cli option and
test to ensure this. There are some known TODOs. diff-graphs script was
removed as it was being used as a subset of the workflow provided by the
--roundtrip option
2026-02-18 15:23:41 -05:00
Gabriel Horner
ed805f039f
chore: cleanup bb tasks after file graph removal
...
Remove needless 'db-' prefix for several dev tasks. Remove linter for
file and db graph separation. It served us well :)
2026-01-22 13:19:58 -05:00
Gabriel Horner
37af8f690e
fix: remove remaining uses of file graph specific attributes
...
Removed all file graph uses of :block/namespace, :block/file, :block/type and
:block/properties except for graph-parser which still uses them for db
importer.
Removed all uses of :block/format except for graph-parser and
src/main/frontend
2026-01-22 13:19:58 -05:00
Gabriel Horner
ef96a8d031
chore: remove db scripts made redundant by CLI
2025-12-12 10:17:12 -05:00
Gabriel Horner
8fc56bfaa3
refactor: Update importer to use validate-local-db
...
Also update validation in DB scripts:
* replace alternative validate-db impl with standard CLI one
* Add validation to import script
* Choose to decouple other DB scripts from validate-db as it may go away
later
2025-12-04 10:30:56 -05:00
Gabriel Horner
7bb8655d71
chore: remove unused errors-by-type
2025-11-19 23:31:04 -05:00
Gabriel Horner
79e75060d6
enhance(cli): Add validate command for local graph(s)
...
Improves :errors of invalid errors to be more user friendly.
Also enable closed-value validation optionally as it is useful
to have higher data quality for non RTC graphs
2025-11-19 17:51:45 -05:00
Tienson Qin
7ed7fb4f31
enhance: prefer ldb/transact! than d/transact!
2025-10-13 19:03:11 +08:00
Gabriel Horner
32a29f5f3d
enhance(dev): CLI can diff other export types
2025-06-26 17:02:14 -04:00
Gabriel Horner
0cb5c99502
enhance(dev): CLI can export other types e.g. graph-ontology
2025-06-26 12:12:50 -04:00
Tienson Qin
92ec65d61d
Merge branch 'master' into refactor/page-parent
2025-06-15 08:27:33 +08:00
Gabriel Horner
3fe790d4d7
enhance(dev): scripts can read or write db graphs as full path files
...
This allows for easier use of debugging graphs as they are exported by
users as a file. Also DRYed up duplicated helper
2025-05-23 13:59:02 -04:00
Gabriel Horner
691b8866ef
refactor: mv another common ns out of db dir
...
Allows for more improved separate linting
2025-04-28 11:27:49 -04:00
Gabriel Horner
6ce701ccc3
fix: remove clj-kondo/ignore
...
that was moved to incorrect location. Also fix clj-kondo config
so those ignores aren't needed anymore
2025-04-08 13:36:17 -04:00
Tienson Qin
1aca680ae4
Merge branch 'feat/db' into perf/app-start
2025-03-31 21:53:37 +08:00
Gabriel Horner
dd4b68a140
fix: export for overlapping property+class
...
overlapping entity with blocks was exporting duplicate blocks
2025-03-28 10:39:20 -04:00
Gabriel Horner
9dfb6713ca
enhance: export+import supports properties
...
that double/overlap as classes
2025-03-27 17:02:32 -04:00
Gabriel Horner
e5061f1504
enhance: add export option to exclude-files
...
Useful for demo graphs as it's noisy and not useful to include since
imported graphs already have it. Also added descriptions for properties
graph to share it
2025-03-27 09:13:14 -04:00
Gabriel Horner
17acbbc8d4
enhance(dev): option to catch export validation errors
...
to write invalid edn and debug issues quicker
2025-03-26 10:25:54 -04:00
Gabriel Horner
f99a89f9b3
enhance: add :logseq.kv data to graph export
...
Addresses
https://github.com/logseq/logseq/pull/11784#pullrequestreview-2697690952 .
Also improves :set option and removes outdated code in a test
2025-03-19 15:41:12 -04:00
Gabriel Horner
210f583cae
enhance(dev): add set option for diff script
2025-03-18 13:00:43 -04:00
Gabriel Horner
332b7a0825
fix: lints and new scripts having same path bugs as feat/db
2025-03-17 12:08:44 -04:00
Gabriel Horner
9b9c22933f
fix: built-in pages option
...
also renamed option and fixed a sorting bug
2025-03-17 11:59:16 -04:00
Gabriel Horner
c215617a0f
fix extra exported property for graph
...
and add import option to diff script
2025-03-17 11:59:16 -04:00
Gabriel Horner
5c07ff3fe7
enhance: option to ignore built-ins for graph export
...
useful for lambda which has buggy built-in pages
2025-03-17 11:59:16 -04:00
Gabriel Horner
d7721981af
enhance: add :exclude-namespaces export option
...
Useful for graphs with existing ontologies to avoid noisy
and needless exporting. Also update related scripts and noted
that create script has always been able to also update
2025-03-17 11:59:16 -04:00
Gabriel Horner
c344f4a577
CLI can create graphs from exported sqlite.build EDN
2025-03-17 11:59:13 -04:00
Gabriel Horner
ab9796ae60
Add scripts for exporting and diffing graphs
...
Allows for quick export<->import QA of more complex graphs
and any examples made in app
2025-03-17 11:58:30 -04:00
Gabriel Horner
fecb42f49d
fix(dev): deps scripts not handling relative and absolute paths for graphs
...
transact and create didn't handle relative paths. All scripts except
import didn't handle absolute paths
2025-03-17 11:09:44 -04:00
Gabriel Horner
0cc9205e99
enhance(dev): option to query multiple graphs
2025-03-13 16:00:01 -04:00
Tienson Qin
5d2ab65d7c
Merge branch 'feat/db' into feat/blocks-action-bar
2025-03-08 13:55:33 +08:00
Gabriel Horner
7917afaa45
chore: update nbb scripts to be repl friendly
...
With https://github.com/babashka/nbb/issues/95 done, this allows
all nbb script namespaces to required or used from a repl
2025-03-07 11:49:28 -05:00
Gabriel Horner
1ccdcab8a9
enhance(dev): optionally validate after creating a db
...
Doing this enough that an option makes this faster to invoke
and faster (no re-open) on large graphs
2025-03-07 11:45:17 -05:00
Gabriel Horner
c6a2ea6959
fix(dev): script fails on -h
...
Also minor db scripts cleanup
2025-03-06 16:21:21 -05:00
Gabriel Horner
8b8055dd72
refactor: use namespaced keyword for block export
...
instead of confusing :build/block. Also improved related tests,
simplified import steps, added some missing sqlite.build docs,
and fixed :build/uuid not working for some existing journals.
2025-02-10 15:18:45 -05:00
Gabriel Horner
455ccec296
chore: rename sqlite.build edn to remove mention
...
of schema. schema concept no longer exists and these old
names would be confusing
2025-01-21 14:22:16 -05:00
Gabriel Horner
68896c257f
Merge branch 'feat/db' into refactor/block-schema
2025-01-16 17:11:53 -05:00
Gabriel Horner
769e68a3c6
enhance(dev): add :dispatch-key to validate-db! errors
...
so it's available to tests and to app
2025-01-15 18:04:47 -05:00
Tienson Qin
a7e9d073cd
chore: rename :property/* to :logseq.property/*
2025-01-15 14:59:08 +08:00
Tienson Qin
93a7034249
Remove more cases of :block/schema
2025-01-13 10:00:00 +08:00
Gabriel Horner
b113967c9c
enhance(dev): cli validation includes dispatch key
...
use dispatch-key to immediately find invalid schema
2025-01-10 10:06:43 -05:00
Tienson Qin
68f758cdc9
fix: invalid data
...
/Validate current graph will try to fix those errors.
fixes https://github.com/logseq/db-test/issues/205 .
2025-01-09 21:15:12 +08:00
Tienson Qin
8a0a05183e
refactor: remove :block/format for db graphs ( #11667 )
2025-01-05 12:10:47 +08:00
Gabriel Horner
1bba10c266
fix: graph counts after validation are wrong
...
after type->tags migration. Also update recommended validate cli options
to default to true. Also clean up graph counts spread across two
validators and importer. The property-pairs count in the UI were way off
because they were only counting pairs that are validated by malli-schema
2025-01-04 02:14:39 -05:00
rcmerci
b0379811c0
fix: fix validate db test (2)
2024-12-02 13:59:06 +08:00