Commit Graph

727 Commits

Author SHA1 Message Date
Gabriel Horner
eecb510ccb enhance: built-in properties are indexed by :db/ident
built-in-properties are identified by their :db/ident instead
of :block/name. This removes reliance on :block/name and allows
us to consistently use namespaces when identifying built-in properties

:visible was renamed to :public? and is now included in :block/schema to
allow for querying. Also added a couple more new graph tests and tweaked
CI for db dep
2024-03-27 15:03:18 -04:00
Gabriel Horner
9b8540921e enhance: more property helper fns uses db-ident
instead of name
2024-03-25 16:34:51 -04:00
Tienson Qin
eae35d60e4 fix: rebuild block refs & path-refs after downloading a remote graph
Fixes LOG-3115
2024-03-21 16:45:00 +08:00
Gabriel Horner
67a7a0a3e9 enhance: Add default namespace of :logseq.property
for db/ident of built-in-properties. Namespacing block identities will
be important for future features. Adding namespacing also fixed some
hidden coupling between identity and name. Also converted a couple more
related :block/name queries to use :db/ident to slowly get us closer to
named blocks
2024-03-15 18:37:15 -04:00
Gabriel Horner
345fd96e2a enhance: full file graph import works from CLI
Also cleaned up naming, added docstrings and fixed a bug that
failed import hard when user didn't input any tag-classes or
property-classes
2024-03-13 16:23:49 -04:00
Gabriel Horner
2f599919fb fix: favorites not importing
Also made underlying fns reusable from UI and nbb compatible.
Fixes LOG-3031
2024-03-12 17:57:47 -04:00
Gabriel Horner
96b35c0252 Update nbb-logseq to stub in cljs-bean.transit 2024-03-11 15:19:50 -04:00
Andelf
329818e4c4 fix(db): css assets loading
- move make-asset-url to assets-handler
- handle assets for db-based graph in add-style-if-exists!
2024-03-11 18:38:48 +08:00
Gabriel Horner
c6e358c983 fix: outliner test failing b/c not nbb compatible
bumped to latest nbb-logseq which is
2024-03-06 11:06:18 -05:00
Gabriel Horner
09816b6427 enhance: assets can be imported on CLI
Also add individual asset error handling, like is done for doc files
2024-03-05 17:05:18 -05:00
Gabriel Horner
9669755cab enhance: detect and add properties to imported classes
fixes LOG-3069
2024-03-04 23:05:06 -05:00
Gabriel Horner
b34325be77 fix: two bugs with updating tags during import
fixes LOG-3073
2024-03-01 15:51:19 -05:00
Gabriel Horner
487c86ac83 enhance: import float values with type :number
They were imported as :default b/c graph-parser didn't handle them.
Part of LOG-2985
2024-03-01 12:07:45 -05:00
Gabriel Horner
0b0299b28f fix: more import fixes after testing more graphs
- collapsed:: false was failing an import
- ignore more attributes for existing pages
- also fixed import script not handling macros and absolute paths
  correctly
2024-02-29 15:06:49 -05:00
Gabriel Horner
49cc17dea5 fix: update property values for any type to :default change
that occur within same file. Also made importing behavior reproducible
across runs and made import script script less verbose by default.
Part of LOG-2985
2024-02-29 13:01:09 -05:00
Gabriel Horner
31b344d3c1 enhance: ignore blank property values from templates
to improves property type detection. Also fixed a bug in
upstream-properties detection and added more docs + better names related
to it. Part of LOG-2985
2024-02-29 11:18:18 -05:00
Gabriel Horner
b32eb7e9be enhance: automatically handle properties that change to :default
docs graph :platforms property now imports correctly rather than
ignored 30 times. Also allow import script to import multiple files
for testing purposes. Part of LOG-2985
2024-02-28 17:16:09 -05:00
Gabriel Horner
9569bed720 fix: property value with mixed refs not imported
correctly. Also fixed lints
2024-02-28 11:08:53 -05:00
Gabriel Horner
44d60808c1 fix: correctly detect property type
for property values containing text and refs.
Also allow import script to only import a file for testing.
Part of LOG-2985
2024-02-27 16:27:26 -05:00
Gabriel Horner
13439ed699 enhance: port two more import steps to be script compatible
also fix save-file! not waiting on async transact before post-save
2024-02-27 12:07:25 -05:00
Gabriel Horner
3e3e9a303b fix graph-parser lints 2024-02-26 16:30:12 -05:00
Gabriel Horner
e3cc4bad36 enhance: speed up import of doc files and make them scriptable
Refactored the largest part of the import to used promesa which made it
nbb compatible and made large imports like docs 10-25% faster.  Also
updated db-import script to use this work
2024-02-26 16:20:03 -05:00
Gabriel Horner
d8f41f22c2 fix: class page schemas have a new optional attribute 2024-02-26 11:11:01 -05:00
Tienson Qin
b1aae957e0 fix: esc doesn't save tags 2024-02-24 16:21:03 +08:00
Gabriel Horner
02ba0b3c87 enhance: configurable logging and user notification during import
Don't need to sprinkle prn's anymore or hide errors that shouldn't
be happening while developing
2024-02-24 00:55:14 -05:00
Gabriel Horner
a61ee21e25 enhance: add basic script to test db graph import
also tweaked query script to work with db graphs by relative path
2024-02-24 00:42:46 -05:00
Gabriel Horner
356657d36b fix: adding uuids on imported classes causes multiple bugs
Caused invalid blocks as properties that were on the same block
as new class had invalid uuids. Also caused content to have
incorrect mangled uuids. Part of LOG-2985
2024-02-23 15:23:47 -05:00
Gabriel Horner
eb994662a6 enhance: user can choose properties' values to import as classes
The user specified properties are then no longer needed since the
concept is built-in. Part of LOG-2985
2024-02-23 12:42:16 -05:00
Gabriel Horner
dad848fa73 enhance: improve property type detection
with macros. This improves :url property detection in docs
graph and other similar graphs. part of LOG-2985
2024-02-22 16:00:03 -05:00
Gabriel Horner
531a8ef533 enhance: import :filters and helpfully ignore :icon
Better to ignore :icon and explain to user than import them as broken with no explanation.
part of LOG-2985
2024-02-22 10:12:09 -05:00
Gabriel Horner
37135fd242 enhance: import tags for existing pages - LOG-2985
also fixed namespaces and aliases missing from existing pages
2024-02-21 17:16:21 -05:00
Gabriel Horner
a010298fc6 enhance: handle invalid property value changes
Ignore invalid property values and notify user, rather than
import them as broken. Part of LOG-2985
2024-02-21 15:30:27 -05:00
Gabriel Horner
95a43e24a3 clean up property importing - part of LOG-2985
- infer block property values by properties, not refs
- remove unnecessary property-changes state
- centralize property-change logging and handling
2024-02-21 11:45:40 -05:00
Gabriel Horner
9591c51997 enhance: import properties of existing pages
including property pages. part of LOG-2985
2024-02-20 23:02:44 -05:00
Gabriel Horner
ddefb677f2 enhance: import most page properties - part of LOG-2985
Also fix validation and bugs with built-in props. Add additional info
on parent-left conflicts as I encountered a couple while testing
pre-block removal
2024-02-20 14:50:49 -05:00
Gabriel Horner
4f3c4c9e03 fix: handle a property :default to :page change
Part of LOG-2985. :page property values would just be references so
use properties-text-values over `str`. Also added import timing
2024-02-19 11:34:42 -05:00
Gabriel Horner
7734bc8791 enhance: import can detect property type changes
and handle auto-converting a value changing from :default to any prop type
2024-02-17 00:24:50 -05:00
Gabriel Horner
04e5c79ee0 fix: invalid property values by unsupported template blocks
Correctly ignore template properties until it's supported
2024-02-16 12:36:27 -05:00
Gabriel Horner
3bf7ee5645 enhance: import support for :page and infer :date properties 2024-02-16 11:36:06 -05:00
Gabriel Horner
0bba0a2ca9 enhance: import built-in logseq.* props - part of LOG-2977 2024-02-15 15:01:01 -05:00
Gabriel Horner
18d3c87016 enhance: support built-in property imports. part of LOG-2985
:query-properties and :query-sort-by need translating. Don't
override block/schema of built-in properties. Also display
property closed values in block data cmd
2024-02-15 12:27:36 -05:00
Gabriel Horner
3b745ac035 enhance: first pass at importing block properties
part of LOG-2985. Still somethings failing for docs graph
2024-02-14 17:16:36 -05:00
Gabriel Horner
2ff0cc1702 enhance: import whiteboards
Fixes LOG-2981. Also start setting up block properties for LOG-2985
2024-02-13 15:41:56 -05:00
Gabriel Horner
48b974d64e enhance: all page refs in imported content are special ids
close LOG-3055. Also fix graph-parser errors being ignored
2024-02-12 22:02:54 -05:00
Gabriel Horner
6dc1272bf2 fix: lint and remove unused ast in file graph exporter
Also remove unused options on d/transact!
2024-02-12 15:52:52 -05:00
Gabriel Horner
06ad57efff fix: page tags causing invalid properties on larger graphs
Tags that had their own pages were resulting in invalid properties. This
is because we were re-transacting existing pages as new pages
with new uuids which resulted in invalid properties. Fixes LOG-2984.
Also moved graph-parser export (import from db perspective) to its own
ns
2024-02-12 12:33:13 -05:00
Gabriel Horner
26bc6f0d1d chore: mv logseq.graph-parser.util.db to db dep
This ns is more appropriate in db and was only in graph-parser because
the date-time-util lib wasn't accessible to db until #10933 landed.
graph-parser dep is specific to file graphs and as much as possible
anything unrelated to this should not be in this dep
2024-02-09 16:16:33 -05:00
Tienson Qin
62b90b7ae7 Merge branch 'feat/db' into perf/lazy-load-data 2024-02-09 09:28:36 +08:00
Gabriel Horner
dab6b5aff4 enhance: add support for importing page and block tags
Allows users to specify which tags are tag classes and
the rest are just normal pages. Fixes LOG-2984
2024-02-08 16:49:27 -05:00
Tienson Qin
6f90958e4b Merge branch 'feat/db' into perf/lazy-load-data 2024-02-03 12:52:35 +08:00