Commit Graph

524 Commits

Author SHA1 Message Date
Tienson Qin
adff65c6bc support unencrypted graph 2026-02-12 02:15:14 +08:00
Tienson Qin
448d125f90 fix: assets import on web 2026-02-11 18:03:09 +08:00
Tienson Qin
10a8e3c491 fix: integrate large graph fixes from ulcaefna
Discord link: https://discord.com/channels/725182569297215569/1400122537744007198/1470853605753094288

1. Added snapshot streaming endpoint on worker:

  - deps/db-sync/src/logseq/db_sync/worker/routes/sync.cljs
  - deps/db-sync/src/logseq/db_sync/worker/handler/sync.cljs
      - Added :sync/snapshot-stream
      - Increased snapshot-download-batch-size to 5000
      - Added schema-init fallback probing (kvs, tx_log, sync_meta)
      - Improved HTTP error responses with debug fields

2. Switched frontend graph download from R2 URL flow to direct stream:

  - src/main/frontend/handler/db_based/sync.cljs
      - Removed /snapshot/download + cleanup DELETE flow
      - Uses direct GET /snapshot/stream

3. Applied large-graph upload stability fixes:

  - src/main/frontend/worker/sync.cljs
      - upload-kvs-batch-size changed 2000 -> 500
      - Reworked offload-large-titles-in-datoms to avoid deep promise chains
      - Fixed upload progress message to use updated loaded count
  - src/main/frontend/worker/sync/crypt.cljs
      - Batched <encrypt-datoms in chunks of 5000
  - src/main/frontend/worker/sync/client_op.cljs
      - update-graph-uuid now retracts old :graph-uuid datoms before add

4. Applied worker-side error visibility and catch hardening:

  - deps/db-sync/src/logseq/db_sync/worker.cljs
  - deps/db-sync/src/logseq/db_sync/worker/dispatch.cljs
  - deps/db-sync/src/logseq/db_sync/worker/coerce.cljs
  - deps/db-sync/src/logseq/db_sync/worker/http.cljs
  - deps/db-sync/src/logseq/db_sync/worker/handler/index.cljs

5. Added/updated tests for these behaviors:
2026-02-11 14:41:26 +08:00
Tienson Qin
cb57234881 fix: lint 2026-02-06 16:39:11 +08:00
Tienson Qin
8bbc0fede8 enhance: gzip download graph 2026-02-06 16:30:01 +08:00
Tienson Qin
94b2d5018d fix: no UX feedback when downloading a large graph from 'Graphs' screen 2026-02-06 15:07:09 +08:00
Tienson Qin
ee30d51c46 fix: show user doesn't exist error when inviting wrong email 2026-02-06 14:57:35 +08:00
Tienson Qin
276c66f0de don't reload app after importing zip 2026-02-01 17:29:04 +08:00
Tienson Qin
6759c4c206 debug asset import 2026-02-01 17:19:13 +08:00
Tienson Qin
24fc5cd8ba fix: asset not fully imported 2026-02-01 17:02:15 +08:00
Tienson Qin
256355c356 fix: lint 2026-02-01 16:39:02 +08:00
Tienson Qin
267587a551 enhance(ux): add progress bar when exporting zip 2026-02-01 16:29:28 +08:00
Tienson Qin
199ecb6bbd support zip import 2026-02-01 15:55:01 +08:00
Tienson Qin
4c85d8ff26 enhance: presence debounce 2026-01-30 17:27:49 +08:00
Tienson Qin
d46b66c228 enhance: trigger sync after creating new remote graph 2026-01-30 03:35:33 +08:00
Tienson Qin
e00a037624 fix: don't run sync for local graphs that's detached from server 2026-01-30 03:00:28 +08:00
Tienson Qin
8472d03826 remove legacy rtc implementation and tests 2026-01-29 19:42:29 +08:00
Tienson Qin
1c4dd7cf7c enhance(ux): graph download && upload log 2026-01-28 17:14:27 +08:00
Tienson Qin
1b4ad6a416 fix: large graph download OOM 2026-01-28 11:58:54 +08:00
Tienson Qin
41a020a17e fix: lint 2026-01-26 20:17:41 +08:00
Tienson Qin
94c6f698e4 fix: lint 2026-01-26 19:39:43 +08:00
Tienson Qin
729ca7fcbf Merge branch 'master' into feat/worker-sync 2026-01-26 18:52:12 +08:00
Tienson Qin
59e1cd9af9 enhance(ux): able to remove graph access or leave a graph 2026-01-26 15:54:25 +08:00
Gabriel Horner
c77ccc8827 fix: remove org mode everywhere except graph-parser 2026-01-22 13:19:58 -05:00
Gabriel Horner
01426fd244 fix: editing global config.edn and export.css in desktop app
Only enable export.css for desktop since it doesn't work
for browser and db graphs. Also remove a related and
unused db-graph? flag
2026-01-22 13:19:58 -05:00
Tienson Qin
2ea6a290a6 fix: leaf node encrypt/decrypt 2026-01-22 23:37:02 +08:00
Tienson Qin
0f3ec8c4eb fix: db row keys encrypt/decrypt 2026-01-22 19:32:48 +08:00
Tienson Qin
1f71f9e78e e2ee 2026-01-22 18:50:05 +08:00
Tienson Qin
3f4685f862 fix: graph role 2026-01-21 23:05:28 +08:00
Tienson Qin
83a3a7cdf9 use R2 for both graph upload/download 2026-01-21 22:43:09 +08:00
Tienson Qin
36c5afeece enhance(ux): editing user avatar presence 2026-01-21 19:29:34 +08:00
Tienson Qin
cc95768288 Switched API-facing map keys to hyphenated keywords 2026-01-21 18:21:00 +08:00
Tienson Qin
d181b1bfa9 online user presense 2026-01-21 15:55:10 +08:00
Tienson Qin
35d28a976e invite 2026-01-21 15:16:22 +08:00
rcmerci
fcc24fff20 feat(db-sync): add schemas for all client&server ws&http requests&responses 2026-01-10 22:56:11 +08:00
rcmerci
0864b485f4 refactor(db-sync): rename worker-sync to db-sync 2026-01-10 17:52:33 +08:00
Tienson Qin
3fbd1c842e fix: set local tx when downloading graph 2026-01-10 10:57:34 +08:00
Tienson Qin
b9d6f472c3 authorization 2026-01-09 03:01:10 +08:00
Tienson Qin
e8f2d2d7e1 increase download batch size 2026-01-08 23:06:18 +08:00
Tienson Qin
274e7b63ef fix: both upload and download graph
tested for 4k movies
2026-01-08 22:19:48 +08:00
Tienson Qin
5a89200138 fix: download 2026-01-08 18:45:55 +08:00
Tienson Qin
e89fdb92b6 download use sqlite rows 2026-01-08 17:37:28 +08:00
Tienson Qin
dcff007590 fix: prefer server graph id 2026-01-08 17:10:27 +08:00
Tienson Qin
36488b5a2d upload graph 2026-01-08 14:39:47 +08:00
Tienson Qin
4670a67bdc able to download remote graph 2026-01-07 23:57:35 +08:00
Tienson Qin
b08860bf3b fix: http api 2026-01-07 23:57:35 +08:00
Tienson Qin
3090074fff handle 3 cases 2026-01-07 23:57:35 +08:00
Tienson Qin
f1d15f5c64 integrate worker sync 2026-01-07 23:57:35 +08:00
Tienson Qin
bcc478b5f7 refactor: separate og and db version (#12276)
separate og and new version apps

remove file sync, tldraw, excalidraw and zotero
2025-12-29 15:39:32 +08:00
Tienson Qin
e5982b678d enhance: run db validation before graph EDN export 2025-12-24 16:25:33 +08:00