Commit Graph

76 Commits

Author SHA1 Message Date
Mega Yu
371b1d5301 feat(exporter): support template import 2026-03-11 15:44:12 -04:00
Mega Yu
ecad45531d feat: add support for Template, Math blocks and Cards in exporter 2026-03-11 15:44:12 -04:00
Mega Yu
309070fda0 fix typo 2026-03-11 15:44:12 -04:00
Mega Yu
1c351aebff feat: add code snippet extraction functionality in exporter and UI options 2026-03-11 15:44:12 -04:00
Gabriel Horner
3d88cd1fd6 fix: import of multi word tags
Also fixes quirky editor bug for inline multi word tags. Both bugs
reported in https://github.com/logseq/db-test/issues/724
2026-02-16 14:35:53 -05:00
megayu
40c9c86129 Fix issues related to importing Zotero (#12313)
* Fix import Zotero not recognized as asset

* Fix the inconsistency between imported Zotero label and actual filename

* Import support for zotero linked file like using zotfile

* Fix zotero highlighting block error after importing from file

* compatible with old configuration

* fix zotero picture highlight block does not consider as asset after importing

* Reconstructed to meet bb requirements

* empty datascript to avoid Conflicting upsert error after importing file to db graph

* use external-file-name instead of adding new property

* fix zotero link file can't open in asset page

* compatible with commit 33db791

* compatible with windows path & support zotero path can be relative for ci testing

* add zotero importing test

* remove prn log

* remove useless line

* Revert commit 45ebb9e

Future imports will be performed in the worker, will no longer encounter these issues

* refactor: update today page check to use async block retrieval

* Revert "refactor: update today page check to use async block retrieval"

This reverts commit 6750333df1.
2026-02-11 17:43:04 +08:00
Gabriel Horner
4cc8ef3ce4 fix: importing property value that changes
from :date to :node. Should fix
https://github.com/logseq/db-test/issues/748
2026-02-10 14:10:04 -05:00
Gabriel Horner
5f34b04faa chore: add test for / property page fix from #12353 2026-02-02 11:23:32 -05:00
megayu
60297778a8 Fix issues related to importing file to db (#12353)
* fix multiline block containing attributes will be truncated and lose data after importing

* fix the issues with block attribute name contains "/" after importing

* standardize eol, all files except .bat files use lf

* compatible with windows path

* fix multiple line importing issues
2026-01-30 17:36:12 +08:00
Gabriel Horner
e7bfd53a7c fix: import of namespace tags
w/ 2+ levels of namespaces. This should fix
https://github.com/logseq/db-test/issues/679
2026-01-27 16:01:25 -05:00
Gabriel Horner
538d10a20a fix: rm whiteboard and tldraw from graph-parser
Also disable test block which is causing an intermittent ref issue
to investigate later
2026-01-22 13:19:58 -05:00
Gabriel Horner
98ab051328 fix: importing journals with tags
Fixes https://github.com/logseq/db-test/issues/588
2026-01-20 10:24:19 -05:00
Gabriel Horner
045cd5f537 enhance: import block tags that are
specified via tags property. Fixes
https://github.com/logseq/db-test/issues/434
2025-12-18 13:35:42 -05:00
Gabriel Horner
c91661f022 fix: import code block inside quote block
Fixes https://github.com/logseq/db-test/issues/523
2025-11-04 10:48:09 -05:00
Gabriel Horner
a81274cd0d fix: import quoted math blocks
and lists in quote blocks. Addresses main issue in https://github.com/logseq/db-test/issues/434
2025-09-02 13:52:32 -04:00
Gabriel Horner
f4a8b9438e fix: block references to annotations
Don't rewrite annotation uuids as we don't do that for other existing blocks
2025-07-22 08:57:21 -04:00
Gabriel Horner
536f39cbbd enhance: import basic pdf text annotation
Only read edn for now. Works in UI and CLI.
Also correctly keeps annotation edn from being copied since
it's no longer used
2025-07-22 08:57:21 -04:00
Gabriel Horner
42f0519797 fix: import property that changes from :node to :default
on same page :as :node property is defined. Also affects :date ->
:default. Fixes https://github.com/logseq/db-test/issues/340
2025-06-23 14:02:28 -04:00
Gabriel Horner
58d3abbafb fix: use ast blocks for simple queries conversions
Fixes cases where {{query nested in BEGIN_* blocks were incorrectly
being converted to queries. Also made ast block handling faster
by only doing one prewalk and cleaned up handling of queries
2025-06-23 19:04:03 +08:00
Gabriel Horner
cc05518ea5 fix: use ast blocks for advanced queries conversion
Fixes cases where BEGIN_QUERY nested in BEGIN_SRC were incorrectly
being converted to queries e.g. most queries in
https://docs.logseq.com/#/page/advanced%20queries
2025-06-23 19:04:03 +08:00
Gabriel Horner
507ff3ce29 enhance: import page and block embeds
One embed per block as that's what DB version supports.
Fixes https://github.com/logseq/db-test/issues/198
2025-06-23 19:04:03 +08:00
Gabriel Horner
fdff75cdf8 fix: import not handling scheduled and deadline property
on same block. Fixes https://github.com/logseq/db-test/issues/318
2025-06-20 17:06:52 -04:00
Gabriel Horner
8c6146a00d enhance: import markdown quotes
Went ahead and implemented ast block to string
as regex version of this would've been to buggy
2025-06-18 13:54:48 -04:00
Gabriel Horner
5b4f43d6f4 enhance: import quotes as #Quote
Can only support one quote per block so text around quotes
and multiple quotes aren't possible
Fixes https://github.com/logseq/db-test/issues/195
2025-06-18 13:54:48 -04:00
Gabriel Horner
ace71b2b25 enhance: asset import supports multiple assets
per block and preserves text around assets.
These were both enabled by moving asset blocks to Asset page
2025-06-17 19:36:05 +08:00
Gabriel Horner
501063e625 fix: importing assets for more complex blocks like paragraphs with links
Used extract-blocks to group ast blocks for each block instead of
previous buggy version. Also renamed bindings that were all confusingly
`block`
2025-06-17 19:36:05 +08:00
Gabriel Horner
f318d68530 enhance: import assets handles
unused assets by still copying them by name and handles
existing assets
2025-06-17 19:36:05 +08:00
Gabriel Horner
bb31c4e6f1 fix: importing assets in subdirectories
Also fix lint
2025-06-17 19:36:05 +08:00
Gabriel Horner
38734bde40 enhance: CLI imports assets as #Asset
Had to split assets into two steps now that asset naming is dependent
on uuids. Also add explicit asserts in exporter to catch silent
failure in tests
2025-06-17 19:36:05 +08:00
Gabriel Horner
f34a8d57a0 fix: whitespace on advanced query string import
Fixes https://github.com/logseq/db-test/issues/193
2025-05-14 16:06:23 -04:00
Gabriel Horner
04aa88b43e fix: importer fails when misconfigure journal ref is a property value
Fixes failure Ramses graph is seeing. Also fix typo in test graph
causing blank journal ref
2025-01-14 11:58:37 -05:00
Gabriel Horner
0cffd64d44 fix: importer failing hard on page ref when
page name has same name as a task. Importer failed because of invalid
refs coming from gp-block/with-page-refs-and-tags which were caused
by get-first-page-by-title returning blocks. In 4f368d5c79,
get-first-page-by-title started returning blocks instead of only pages
so this was undone.  Fixes part of logseq/db-test#191
2025-01-10 16:41:25 -05:00
Gabriel Horner
b8c569f1c4 fix: importer failing and invalid on two page to class conversion cases
Failed for edge case when page converts to class via -p or -P. Page to
class conversions sometimes resulted in invalid :block/tags. Also
cleaned up last of class or page tx that were embedded in db attributes
2025-01-09 20:57:40 -05:00
Gabriel Horner
409107f385 fix: duplicate journal pages when deadline is on same day
as block's page. Switched to using page-names-to-uuids instead
of db since it has the uuids of current page. Fixes logseq/db-test#192
2024-12-19 14:27:37 -05:00
Gabriel Horner
a987826a48 enhance: import cards correctly regardless of tag options
and also ignore card properties which can't be applied in db version.
Fixes LOG-3062
2024-11-26 16:03:12 -05:00
Gabriel Horner
99bf950bd1 fix: import with journal refs result in invalid blocks 2024-11-22 16:07:38 -05:00
Gabriel Horner
2569488493 fix: db import of namespaced tags across multiple pages
Fixes conflicting upserts seen in
https://github.com/logseq/db-test/issues/7#issuecomment-2480564898
2024-11-18 11:40:55 -05:00
Gabriel Horner
d4caacce3d fix: tags and refs on same page should have same uuid
Fixes identity issue in 1st section of
https://github.com/logseq/db-test/issues/7#issuecomment-2463162620
2024-11-14 17:21:06 -05:00
Gabriel Horner
f1624fb20c fix: import namespaced tag correctly
Fixes db graphs being invalid and some of
https://github.com/logseq/db-test/issues/7#issuecomment-2463162620
2024-11-12 14:10:06 -05:00
Gabriel Horner
90d1b7261f fix: import bug with aliased namespace pages
Was also failing docs graph. Part of logseq/db-test#136 and part of
LOG-3230
2024-10-18 11:54:39 -04:00
Gabriel Horner
3e05347379 fix: db import failing on namespace pages with built-in name
e.g. term/alias in docs graph. Also added some basic namespace import
tests. Part of logseq/db-test#136 and part of LOG-3230
2024-10-18 11:46:05 -04:00
Gabriel Horner
28457cd02b enhance: import namespaces to db graph
Working for basic graph but failing on edge case for docs graph.
Part of logseq/db-test#136 and part of LOG-3230
2024-10-18 08:24:45 -04:00
Gabriel Horner
bc4f121572 enhance: add import support for linked ref filters
Fixes LOG-3201. Also refactor and fix page-names-to-uuids to include
all existing user page names, not just ones from current file
2024-10-09 14:54:46 -04:00
Gabriel Horner
e74912c850 enhance: import advanced queries as query objects
Fixes LOG-3247. Handles migrating deprecated options and string and non-string titles
2024-10-02 16:19:52 -04:00
Gabriel Horner
9531811b68 fix: simple queries without properties not importing
Also handle query title for simple queries. Also loosened page-tags to
allow for future logseq class importing. Fixes LOG-3243
2024-10-02 12:23:22 -04:00
Gabriel Horner
de14dbe800 enhance: import query properties to use new tables
Allows imported queries to use new query tables. Fixes LOG-3232
2024-09-13 18:33:53 -04:00
Gabriel Horner
3a4cc55cda fix: graph-parser test and lint
Removed test as no error handling is needed for ident generation. Also
removed all related downstream uses of catch for
db-ident/create-db-ident-from-name that are no longer needed
2024-08-19 15:40:28 -04:00
Gabriel Horner
dcb73b1003 fix: db import of advanced queries
Fixes LOG-3082
2024-08-07 16:30:20 -04:00
Gabriel Horner
66439dde68 fix: db import of markdown tables and multiline blocks
Fixes LOG-3072 and fixes LOG-3070
2024-08-07 12:33:13 -04:00
Gabriel Horner
6093462555 fix: db import after changes from #11433 2024-07-30 14:47:35 -04:00