Commit Graph

1926 Commits

Author SHA1 Message Date
Gabriel Horner
c85ce5b17c fix: page property values that are uuids weren't exported
causes more complex schema graph to fail to export
2025-03-17 11:59:16 -04:00
Gabriel Horner
c344f4a577 CLI can create graphs from exported sqlite.build EDN 2025-03-17 11:59:13 -04:00
Gabriel Horner
9232d10ac2 Provide consistent sort for graph's pages-and-blocks
Also allow full timestamp test now that all timestamp issues are fixed
2025-03-17 11:58:30 -04:00
Gabriel Horner
3dd196d8f8 fix duplicate pages in imported graph for page property values
Don't use :build/page for graph exports as it leads to needless
complexity when reconciling referenced nodes
2025-03-17 11:58:30 -04:00
Gabriel Horner
ab9796ae60 Add scripts for exporting and diffing graphs
Allows for quick export<->import QA of more complex graphs
and any examples made in app
2025-03-17 11:58:30 -04:00
Gabriel Horner
25efc164c6 add graph export support for property + class refs
Also fixed class + property refs forgetting keep-uuid?.
Also moved test helpers
2025-03-17 11:58:30 -04:00
Gabriel Horner
fae1e8a6cb graph export optionally exports timestamps 2025-03-17 11:58:30 -04:00
Gabriel Horner
5d1e532122 fix: graph exports with pvalue classes or properties failed 2025-03-17 11:58:30 -04:00
Gabriel Horner
c67745c4fa refactor: sqlite.build was adding noisy
uuid indices for every block. uuid indices are only needed
for referenced uuids
2025-03-17 11:58:30 -04:00
Gabriel Horner
29eff25887 fix: property closed values were not importing correctly from graph export
They need their uuids to import for blocks
2025-03-17 11:58:30 -04:00
Gabriel Horner
e0a7418ad2 Add pvalue uuid support to graph export 2025-03-17 11:58:30 -04:00
Gabriel Horner
a7b586b2b0 add export+import support for files 2025-03-17 11:58:30 -04:00
Gabriel Horner
e896641f6e add block/link support for graphs and
confirm views and favorites work
2025-03-17 11:58:30 -04:00
Gabriel Horner
27f81c3325 enhance: basic graph export of pages and blocks
Still doing redundant properties and classes. Content refs partially
work and uuid refs are todo
2025-03-17 11:58:30 -04:00
Tienson Qin
36b5778bf2 don't include block property values for all pages 2025-03-17 23:31:16 +08:00
Gabriel Horner
fecb42f49d fix(dev): deps scripts not handling relative and absolute paths for graphs
transact and create didn't handle relative paths. All scripts except
import didn't handle absolute paths
2025-03-17 11:09:44 -04:00
Tienson Qin
b7d3bc58b0 no need to paginate data for views 2025-03-17 20:11:30 +08:00
Tienson Qin
5d623b453c limit properties to be queried from <get-block 2025-03-17 18:16:13 +08:00
Tienson Qin
515feee0aa wip: query data only if it's needed to be displayed 2025-03-17 10:28:28 +08:00
Tienson Qin
05054f0c4b Merge branch 'feat/db' into perf/app-start 2025-03-16 12:18:55 +08:00
Tienson Qin
38e4b0d9b2 Merge branch 'feat/db' into feat/hnswlib+transformer-js 2025-03-16 11:52:32 +08:00
rcmerci
a5db52bf37 feat(embedding): text-embedding graph blocks and query hnsw
new properties:
:logseq.property.embedding/hnsw-label,
:logseq.property.embedding/hnsw-label-updated-at

add ns frontend.worker.embedding
2025-03-15 20:56:22 +08:00
Gabriel Horner
0cc9205e99 enhance(dev): option to query multiple graphs 2025-03-13 16:00:01 -04:00
Gabriel Horner
14091b42d8 fix: properties with closed value have incorrect title
was using ident instead of :block/title
2025-03-13 15:52:18 -04:00
rcmerci
95c0f2ef1c feat: init add frontend.inference-worker.text-embedding 2025-03-13 22:08:23 +08:00
Tienson Qin
2dce5eefd3 reduce <get-block calls
Other things:
1. remove tag/property ref from `get-block-refs`.
2. pre-fetch property values
2025-03-13 09:07:59 +08:00
Tienson Qin
b87c43e697 Merge branch 'feat/db' into perf/app-start 2025-03-13 04:35:52 +08:00
Tienson Qin
c76a537d1c fix: lint 2025-03-12 01:39:52 +08:00
Tienson Qin
9eaacef657 fix: lint 2025-03-11 23:26:27 +08:00
Tienson Qin
b5746364c5 set limit to 100 2025-03-11 23:20:39 +08:00
Gabriel Horner
99c89ec3be chore: bump nbb-logseq to include tc/to-date 2025-03-10 15:32:29 -04:00
Tienson Qin
726de5917a view pagination 2025-03-10 10:14:12 +08:00
Tienson Qin
5abdfca0ec unify data loading for class/property objects and all pages 2025-03-10 09:16:34 +08:00
Tienson Qin
555c2d92f3 fix: lint 2025-03-10 08:45:26 +08:00
Tienson Qin
b28e02f5f9 Filter data on the worker to reduce data that're sent to main thread 2025-03-10 08:43:06 +08:00
Tienson Qin
c1fdfe5915 perf: sort using d/datoms when sorting by single property 2025-03-10 08:20:30 +08:00
Tienson Qin
89c7abfae1 wip: view perf improvement 2025-03-10 06:17:12 +08:00
Tienson Qin
005fc881d3 fix: load recently updated page into memory db 2025-03-09 09:09:21 +08:00
Tienson Qin
fd5757e0c7 Preload pages to avoid slow open at all pages 2025-03-09 07:44:51 +08:00
Tienson Qin
55622659e1 Don't load all pages when app starts 2025-03-09 07:44:51 +08:00
Tienson Qin
5d2ab65d7c Merge branch 'feat/db' into feat/blocks-action-bar 2025-03-08 13:55:33 +08:00
Tienson Qin
22743b4952 Merge branch 'feat/db' into feat/text-template 2025-03-08 07:03:02 +08:00
Gabriel Horner
db8cd0eed1 fix: export+import of page timestamps 2025-03-07 15:34:06 -05:00
Gabriel Horner
7917afaa45 chore: update nbb scripts to be repl friendly
With https://github.com/babashka/nbb/issues/95 done, this allows
all nbb script namespaces to required or used from a repl
2025-03-07 11:49:28 -05:00
Gabriel Horner
1ccdcab8a9 enhance(dev): optionally validate after creating a db
Doing this enough that an option makes this faster to invoke
and faster (no re-open) on large graphs
2025-03-07 11:45:17 -05:00
Tienson Qin
d3dc57022b enhance: no need to set logseq.class/Root for class type properties 2025-03-07 22:32:44 +08:00
Tienson Qin
796c744be1 property word tweak
Co-authored-by: Gabriel Horner <97210743+logseq-cldwalker@users.noreply.github.com>
2025-03-07 21:04:30 +08:00
Gabriel Horner
c6a2ea6959 fix(dev): script fails on -h
Also minor db scripts cleanup
2025-03-06 16:21:21 -05:00
Gabriel Horner
9828b15b51 fix: export+import preserve property timestamps 2025-03-06 10:18:51 -05:00
Gabriel Horner
9720976d63 fix: invalid uuid detection
referenced uuids weren't being picked up
2025-03-04 14:58:54 -05:00