385 Commits

Author	SHA1	Message	Date
Gabriel Horner	2ff0cc1702	enhance: import whiteboards ... Fixes LOG-2981. Also start setting up block properties for LOG-2985	2024-02-13 15:41:56 -05:00
Gabriel Horner	48b974d64e	enhance: all page refs in imported content are special ids ... close LOG-3055. Also fix graph-parser errors being ignored	2024-02-12 22:02:54 -05:00
Gabriel Horner	6dc1272bf2	fix: lint and remove unused ast in file graph exporter ... Also remove unused options on d/transact!	2024-02-12 15:52:52 -05:00
Gabriel Horner	06ad57efff	fix: page tags causing invalid properties on larger graphs ... Tags that had their own pages were resulting in invalid properties. This is because we were re-transacting existing pages as new pages with new uuids which resulted in invalid properties. Fixes LOG-2984. Also moved graph-parser export (import from db perspective) to its own ns	2024-02-12 12:33:13 -05:00
Gabriel Horner	26bc6f0d1d	chore: mv logseq.graph-parser.util.db to db dep ... This ns is more appropriate in db and was only in graph-parser because the date-time-util lib wasn't accessible to db until #10933 landed. graph-parser dep is specific to file graphs and as much as possible anything unrelated to this should not be in this dep	2024-02-09 16:16:33 -05:00
Tienson Qin	62b90b7ae7	Merge branch 'feat/db' into perf/lazy-load-data	2024-02-09 09:28:36 +08:00
Gabriel Horner	dab6b5aff4	enhance: add support for importing page and block tags ... Allows users to specify which tags are tag classes and the rest are just normal pages. Fixes LOG-2984	2024-02-08 16:49:27 -05:00
Tienson Qin	6f90958e4b	Merge branch 'feat/db' into perf/lazy-load-data	2024-02-03 12:52:35 +08:00
Gabriel Horner	ca752834c1	enhance: basic block tags for import - part of LOG-2984	2024-02-02 17:39:08 -05:00
Gabriel Horner	b6a952fd7d	fix: assets not copied for import ... Caused by a commit yesterday. Also removed unused import-file-to-db-graph options	2024-02-02 16:16:18 -05:00
Gabriel Horner	5b4bfd9089	enhance: file graph import ignores hidden files	2024-01-31 15:01:39 -05:00
Tienson Qin	c1a15c0708	Merge branch 'feat/db' into perf/lazy-load-data	2024-02-01 03:58:04 +08:00
Gabriel Horner	bf56cd3252	chore: move legacy fns to legacy ns ... title property is for file graphs and should be kept with its ns to avoid confusion	2024-01-31 11:11:14 -05:00
Tienson Qin	99b6d543f0	fix: more async queries and export to roam	2024-01-30 20:03:06 +08:00
Tienson Qin	3addb5905b	perf: load partial data when loading a graph ... Instead of all the datoms	2024-01-29 13:17:37 +08:00
Gabriel Horner	77bc1d5d6b	chore: update better-sqlite3 and mldoc in deps to match app	2024-01-23 11:36:32 -05:00
Gabriel Horner	689cf34cc3	fix: lints and a test ... nbb test was failing b/c outliner had graph-parser as a dependency but we hadn't manually added the npm dependency	2024-01-23 09:38:16 -05:00
Gabriel Horner	f573b8e821	fix: file graph import not persisting to disk	2024-01-17 12:57:16 -05:00
Gabriel Horner	0168ef0082	fix: 2 bugs with file import ... These were silently failing and causing a number of pages to not import	2024-01-16 17:01:23 -05:00
Tienson Qin	cea105cc34	fix: wrong ns import	2024-01-16 16:01:18 +08:00
Tienson Qin	a619850998	Merge branch 'feat/db' into refactor/pipeline-worker	2024-01-16 15:42:18 +08:00
Gabriel Horner	34222b3436	chore: bump nbb-logseq that points to upstream nbb	2024-01-15 18:07:49 -05:00
Gabriel Horner	2305d09cc8	chore: DRY up duplicated vars and needless/confusing aliases	2024-01-15 16:51:27 -05:00
Gabriel Horner	ca020fcdb3	fix: loading all new deps namespaces in nbb ... - bb test:load-all-namespaces-with-nbb now passes for all deps - Updated nbb-logseq to support cljs.core/Atom - Adjusted datascript.impl.entity with previous datascript.db require so that correct loading occurs in nbb - fixed missing deps in logseq.outliner - Converted a minor cljs.spec to malli since malli is nbb compatible - Changed exists? to some? since they are functionally equivalent for the given arg and some? is nbb compatible	2024-01-15 12:43:16 -05:00
Tienson Qin	b55e4e7380	fix: db requests could be dropped if some requests not finished yet	2024-01-14 12:55:55 +08:00
Gabriel Horner	951e7cc841	fix: ns-docstring and large-var deps lints ... Also fixed db-and-file-graphs-separate lint and moved gp-property tests that should be moved since their source code has moved from frontend to gp-property	2024-01-12 17:03:09 -05:00
Gabriel Horner	690764aa52	fix: unused time dep and duplicated time-ms fns ... cljs-time shouldn't be added to nbb.edn since it's already included in nbb-logseq (since parts of it aren't nbb compatible). duplicated time-ms fns can now be removed since they are available to all deps from common dep	2024-01-12 10:41:22 -05:00
Gabriel Horner	cdddce0120	fix deps db test and most lints ... Also deleted duplicated gp-util.{page-ref,block-ref} files that were moved to common and moved a related test to common dep	2024-01-11 14:35:04 -05:00
Gabriel Horner	a81e18e9a6	fix: update nbb-logseq and make entity-plus nbb compatible ... deps can now load in nbb and all nbb tests pass except for db	2024-01-11 13:10:06 -05:00
Gabriel Horner	a2bb7e4479	fix: adding timestamps to imports shouldn't change updated-at	2024-01-10 16:06:20 -05:00
Tienson Qin	9ee04feeb5	Merge branch 'feat/db' into refactor/pipeline-worker	2024-01-10 16:13:56 +08:00
Tienson Qin	271f34838a	fix: page property test	2024-01-10 05:29:52 +08:00
Gabriel Horner	3cb980bf91	fix: invalid pages and whiteboard pages from import ... - some pages are missing block/journal? and block/original-name - removed another file graph only attribute - fixed whiteboard block schema missing :block/path-refs - pulled out importing block to its own fn Part of LOG-2990	2024-01-09 16:03:49 -05:00
Tienson Qin	16f8beefaf	fix: model and page ref test	2024-01-10 04:47:18 +08:00
Gabriel Horner	e1ad1fd9c8	fix: invalid blocks in import created by tags and refs ... Also make :block/format valid. Part of LOG-2990	2024-01-09 13:43:00 -05:00
Gabriel Horner	e715881a4f	fix: macro blocks and remove file-graph only attributes for import ... Also disable properties until it's ready. Part of LOG-2990	2024-01-09 12:48:27 -05:00
Tienson Qin	501c06c44f	fix: whiteboard redundancy	2024-01-09 16:53:49 +08:00
Gabriel Horner	6ad5fb2dd4	fix: db graphs not adding :block/content for whiteboard shape ... Caused by hopefully one of the last incorrect lookups of :block/properties	2024-01-08 16:16:07 -05:00
Gabriel Horner	0957cb15b3	fix: built-in props weren't persisted to opfs ... and didn't show up in new graphs. Fixes LOG-2998. Issue was that e6a464e64f introduced transacting built-in properties twice. Since the first transaction doesn't send tx-data to the db-worker (an issue with pipeline/invoke-hooks it seems), the 2nd tx results in missing property info including name. Removing this incorrectly setup first tx allows the original one to successfully send initial property data to db-worker	2024-01-08 11:26:22 -05:00
Gabriel Horner	6e911798e7	fix: Make bare graph valid for file graph import ... Fixed blocks, pages and config.edn as part of LOG-2990	2024-01-05 17:03:35 -05:00
Tienson Qin	fa2892cef6	use ldb/transact! instead of d/transact!	2024-01-05 06:42:10 +08:00
Tienson Qin	086a052ee7	Move page-create to worker	2024-01-05 01:02:22 +08:00
Tienson Qin	f3e7f8b66b	remove handler.whiteboard dependency for rtc.core	2024-01-04 17:30:04 +08:00
Tienson Qin	7258cf48da	fix deps	2024-01-03 18:12:12 +08:00
Tienson Qin	9194a671fd	Move outliner core to its own dep	2024-01-03 18:02:48 +08:00
Tienson Qin	faf2d8116a	Move worker.mldoc and worker.file.property.util to graph parser dep	2024-01-03 17:35:12 +08:00
Tienson Qin	a6f83c2445	Move worker.util fns to common.util	2024-01-03 17:08:24 +08:00
Tienson Qin	b7d9098e80	Move gp-util and gp-config to the common dep	2024-01-03 16:38:05 +08:00
Gabriel Horner	4fd0b65639	bump nbb-logseq to use datascript with dirty flag fix	2024-01-02 17:07:11 -05:00
Gabriel Horner	5afbfce4a0	fix: graph-parser lints and tests from #10770	2024-01-02 16:22:04 -05:00