Commit Graph

937 Commits

Author SHA1 Message Date
Gabriel Horner
208b4bc205 fix: remove whiteboards and tldraw from rest of codebase
Also remove some old excalidraw refs that should've been removed awhile
back
2026-01-22 13:19:58 -05:00
Gabriel Horner
538d10a20a fix: rm whiteboard and tldraw from graph-parser
Also disable test block which is causing an intermittent ref issue
to investigate later
2026-01-22 13:19:58 -05:00
Gabriel Horner
c77ccc8827 fix: remove org mode everywhere except graph-parser 2026-01-22 13:19:58 -05:00
Gabriel Horner
05ffa3eeb6 chore: remove fns made unused by OG removal
Found unused ones in deps/common, from unused frontend.db aliases
and from fns that only existed for their corresponding tests
2026-01-22 13:19:58 -05:00
Gabriel Horner
173898240e fix: remove most file graph uses in deps
except for graph-parser and publish deps

- Removed most mentions of 'repo' in deps, which cleaned up a lot related
  to export cli and worker
- Removed db-based-graph? checks in deps except for unknown use
  in entity-plus?
- Removing db-based-graph? checks resulted in deleting unused file graph
  code paths e.g. get-pid
- Removed file graph handling in cli list command
- Remove file-based-graph? checks from deps
2026-01-22 13:19:58 -05:00
Gabriel Horner
4bb7430682 fix: rm the last file-based namespaces in db dep
Also remove the following related file schema
attributes and their dependent code:
:block/marker, :block/priority, :block/scheduled,
:block/deadline,:block/repeated?, :block/pre-block?,
:block/properties-order, :block/properties-text-values, :block/macros,
:block/invalid-properties
2026-01-22 13:19:58 -05:00
Gabriel Horner
ab137a962a fix: remove file graph imports
Remove mention of removed JSON import in descriptions. Also mv frontend.util.fs
to where they are used instead of keeping an outdated file ns
2026-01-22 13:19:58 -05:00
Gabriel Horner
1d15e1f85d fix: rm file graph config from user config
Also remove unused helpers for file config keys and file graph code in
mobile.intent.  These removals also result in removing
frontend.common.file.util as it's no longer used
2026-01-22 13:19:57 -05:00
Gabriel Horner
37d9ebda1f chore: remove file-specific graph-parser code
Also removed file graph code for markdown export as a prereq
2026-01-22 13:19:57 -05:00
Gabriel Horner
e07ff6dd88 chore: convert query-dsl tests to db graphs
Able to remove some dead code and add :build.test/title which
is reusable for future tests
2026-01-22 13:19:57 -05:00
Gabriel Horner
20cbb626a0 fix: frontend and graph-parser tests and lints
Removed file specific test
2026-01-22 13:19:57 -05:00
Gabriel Horner
2bcc331916 fix: remove gp-db ns, especially since it's unused
or incorrect in case of graph-view. Removed file graph
specific tests that depended on gp-db
2026-01-22 13:19:57 -05:00
Gabriel Horner
b91b892181 chore: remove unused file ns graph-parser.cli 2026-01-22 13:19:57 -05:00
Gabriel Horner
3e0d57bc32 chore: prefix deps workflows with 'deps-'
to organize workflow files better
2026-01-21 14:16:38 -05:00
Gabriel Horner
98ab051328 fix: importing journals with tags
Fixes https://github.com/logseq/db-test/issues/588
2026-01-20 10:24:19 -05:00
Tienson Qin
b2497c0cc5 fix: pages starting with "@" fail to import from markdown
related to https://github.com/logseq/db-test/issues/680
2025-12-24 22:30:10 +08:00
Tienson Qin
1ae9e2c496 fix: extends tags query and support eid|title|db-ident
Previously `tags` doesn't return blocks that have children tag(s).

Also, `tags` support both db/ident and block/title to make it easy
to use:
(tags ?b #{144})
(tags ?b #{"Task"})
(tags ?b #{:logseq.class/Task})
2025-12-24 14:37:57 +08:00
Gabriel Horner
045cd5f537 enhance: import block tags that are
specified via tags property. Fixes
https://github.com/logseq/db-test/issues/434
2025-12-18 13:35:42 -05:00
Gabriel Horner
b4f3e364e6 fix: duplication of exporter config leads to bugs
in script and test. Also fix <export-file not being waited on and new docs
after #12260
2025-12-15 12:15:48 -05:00
Tienson Qin
33db791ac0 fix: import Zotero pdf blocks (#12260)
fix: support zotero files when importing pdf annotations
2025-12-15 23:28:58 +08:00
Tienson Qin
270f13f11a fix: support external pdf files when importing from file graphs 2025-12-15 23:02:33 +08:00
Tienson Qin
81cbc1e701 fix: pages don't have #Page tag when importing from markdown files
related to https://github.com/logseq/db-test/issues/641
2025-12-15 14:49:17 +08:00
Tienson Qin
f594e2034f fix(rtc): batch store and validate db (#12249)
* fix(rtc): batch store and validate db

* fix: logseq.db/transact! shouldn't distinct tx-data

since move-op include 2 steps:
1. insert-block
2. update-attrs

This results in db invalid after step 1.

* refactor: add transact-with-temp-conn!

* bump nbb-logseq and add tests for ldb/transact* fns

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: rcmerci <rcmerci@gmail.com>
2025-12-09 20:47:37 +08:00
Gabriel Horner
8fc56bfaa3 refactor: Update importer to use validate-local-db
Also update validation in DB scripts:
* replace alternative validate-db impl with standard CLI one
* Add validation to import script
* Choose to decouple other DB scripts from validate-db as it may go away
  later
2025-12-04 10:30:56 -05:00
Gabriel Horner
f8064253a2 fix: remove misplaced ignore 2025-12-02 10:11:11 -05:00
Tienson Qin
38baa56286 fix: lint 2025-11-26 18:36:16 +08:00
Tienson Qin
73d4ee7caa Merge branch 'master' into enhance/ios-native-navigation 2025-11-24 22:36:50 +08:00
charlie
49407d561a refactor(assets): rename local-asset? to local-relative-asset? and update references 2025-11-21 18:02:06 +08:00
Tienson Qin
a18626283b fix: graph parser tests 2025-11-21 03:09:25 +08:00
Tienson Qin
055a5cf6ca fix: parse inline tag as page 2025-11-21 01:46:35 +08:00
Gabriel Horner
43b09095ac fix: graph-parser lint 2025-11-20 12:13:04 -05:00
Tienson Qin
c488335f9d fix: typo 2025-11-21 01:09:13 +08:00
Tienson Qin
20aecdb27c fix: inline tag resolved as page when saving block 2025-11-21 00:52:43 +08:00
Tienson Qin
e311e1b85c fix: don't create child tags when saving inline 2025-11-21 00:33:34 +08:00
Gabriel Horner
c91661f022 fix: import code block inside quote block
Fixes https://github.com/logseq/db-test/issues/523
2025-11-04 10:48:09 -05:00
rcmerci
6ffa6ab5d6 enhance: upgrade com.lambdaisland/glogi, add timestamp to log 2025-10-31 18:04:37 +08:00
Tienson Qin
ace82d7151 fix: don't create new card page when importing file graph
fix https://github.com/logseq/db-test/issues/521
2025-10-30 01:34:43 +08:00
Tienson Qin
7dc155b28b fix: file graph import 2025-10-29 21:28:27 +08:00
Gabriel Horner
2500fe888a fix: dev import can't import
All CLI imports were failing with "Maximum call stack size exceeded".
2025-10-22 10:37:25 -04:00
Tienson Qin
999618a406 refactor: compute pipeline tx-data before d/transact! 2025-10-15 15:31:42 +08:00
Gabriel Horner
27d5a369fd fix: bump to latest nbb-logseq to fix most logseq.db dependent ns 2025-10-13 21:34:00 -04:00
Tienson Qin
7ed7fb4f31 enhance: prefer ldb/transact! than d/transact! 2025-10-13 19:03:11 +08:00
Gabriel Horner
846f9307c3 enhance: notify users when assets exceed max size
so they are aware why asset was ignored. Also if asset ids are not
present we should fail loudly like we everywhere else in the importer.
Users should know when data is missing instead of hiding it in the
console. Also refactor confusing usage of :block/uuid to :asset-created?
as it was only used to track the first time an asset is built to be
transacted
2025-09-29 17:37:04 -04:00
Tienson Qin
91657bfcce fix: rpath may not be provided 2025-09-29 17:37:04 -04:00
Tienson Qin
248fdeb422 fix: tests 2025-09-29 17:37:04 -04:00
Tienson Qin
971cec54bc fix(import): remove asset byte-array usage to prevent OOM
This commit also combine read-asset and copy-asset to read-and-copy-asset
2025-09-29 17:37:04 -04:00
Gabriel Horner
f93f889f8a chore: bump to latest nbb w/ datascript update 2025-09-03 10:00:45 -04:00
Tienson Qin
248d8c33f2 refactor: remove block/path-refs (#12081)
1. refactor: use :block/refs and has-ref rule instead of path-refs
2. remove block/path-refs
3. removes :block-parent rule since there's already :parent
4. enhance: skip pipeline calculation for rtc initial download tx
5. refactor(rtc): remove memoize

---------

Co-authored-by: rcmerci <rcmerci@gmail.com>
2025-09-03 20:33:33 +08:00
Gabriel Horner
a81274cd0d fix: import quoted math blocks
and lists in quote blocks. Addresses main issue in https://github.com/logseq/db-test/issues/434
2025-09-02 13:52:32 -04:00
Gabriel Horner
6a84e56984 enhance: working spike for export md command
export namespaces aren't reused yet. Fixed bug w/ get-block-and-children
not invoking correctly in nbb. Bumped all deps to use latest nbb-logseq
2025-08-26 11:27:34 -04:00