Commit Graph

43 Commits

Author SHA1 Message Date
rcmerci
b0379811c0 fix: fix validate db test (2) 2024-12-02 13:59:06 +08:00
rcmerci
d2c877b484 fix: fix validate db test 2024-12-02 13:51:27 +08:00
Gabriel Horner
e231192cda enhance: add import metadata
Useful for debugging different types of imports and knowing
when import was done, especially since it can differ from when
graph was created
2024-10-17 13:23:30 -04:00
Gabriel Horner
fbcaeb5e20 fix: example edn uses outdated property type 2024-08-20 17:10:28 -04:00
Tienson Qin
f46372b346 chore: keep using class instead of tag for internal usage 2024-08-06 07:15:41 +08:00
Tienson Qin
411b05e7ba Prefer to use ldb/{type}? check when possible 2024-08-05 17:51:24 +08:00
Tienson Qin
4083a2d0a0 enhance: prefer tag instead of class on UI
Some users are confused with Classes/Objects, so on UI it'll be
Tags/Nodes.
2024-08-05 15:06:54 +08:00
Tienson Qin
d26e620a82 refactor: update :block/type to cardinality one instead of many 2024-07-31 19:35:26 +08:00
Tienson Qin
d847023dc1 Refactor: rename :block/content to :block/title 2024-07-10 22:33:44 +08:00
Tienson Qin
a1f352773b refactor: rename :block/original-name to :block/title 2024-07-10 21:43:03 +08:00
Gabriel Horner
9a8c91c0cc chore: mv logseq.db.sqlite.db into sqlite.cli
for more explicit name and purpose. Also updated outdated db readme
and removed unused fns in logseq.db.sqlite.db
2024-06-14 16:53:19 -04:00
Gabriel Horner
95db811f55 fix: frontend tests shouldn't depend on sqlite3
frontend.test.helper was accidentally coupled to sqlite3 via
logseq.outliner.db-pipeline. Split out sqlite3 dependent fns to
logseq.outliner.cli so it's clear this shouldn't be coupled to frontend
2024-06-14 14:41:24 -04:00
Gabriel Horner
0f122e9a7e fix: schema graph generation
Regressed with property value change. Also updated debug file and
fixed a missing built-in property ns which caused an invalid debug file
2024-06-14 11:38:14 -04:00
Gabriel Horner
0e1ada2ef6 enhance: bb task for creating graphs from EDN file
Converted inferred graph to an EDN file now that this task exists. Also
merge last of tasks.create-graph to relevant ns so that external users
can also create such tasks
2024-06-11 10:09:37 -04:00
Gabriel Horner
32ca012635 enhance: pretty print + colorize query script by default 2024-05-23 14:58:55 -04:00
Gabriel Horner
670b46f221 fix: validate property values again
caused by property pair revert 5d4ae66d86
2024-04-30 12:25:12 -04:00
Gabriel Horner
2f0fc3c18c fix: large graph creation having blank and incorrect block counts
large graph chunking assumed a certain tx order which isn't guaranteed.
There are also some edge cases where blocks could get separated from
each other which are now fixed. Also fixed a bug with validating user
properties and made small enhancement for query script
2024-04-23 09:25:07 -04:00
Gabriel Horner
0853940a34 fix: closed :default values validate correctly
and values can be selected from UI. Also tweak query to expand
properties if available
2024-04-16 11:59:04 -04:00
Gabriel Horner
8ec360759a enhance(dev): humanize option for validation script
also fix nil entity query results
2024-04-15 09:36:09 -04:00
Gabriel Horner
8cbc0ac32a fix: validate property values 2024-04-12 15:27:26 -04:00
Gabriel Horner
4f3b7e7687 fix: ref checks in schema
attribute in the wrong schema and db graph only vars had file graph
keys. Also temp fix to avoid crashing ui with props
2024-04-12 12:15:59 -04:00
Gabriel Horner
b2a22498ea fix: closed validation with new properties
Also fix group error reporting incorrectly and improve it by adding
:db/id
2024-04-12 11:32:03 -04:00
Gabriel Horner
354c0c1e42 fix: built-in? helper and most deps tests
Also fix validate script's count
2024-04-12 10:04:43 -04:00
Gabriel Horner
cbcff4bae8 fix: schema graph creation for previous properties schema
Also add db/id to query script and fix outdated case insensitive
constraint on property db idents
2024-04-11 17:46:49 -04:00
Gabriel Horner
608d627544 fix: add back properties validation
and fix closed validation. Also temporarily comment out properties graph parts
that are still invalid
2024-04-04 21:09:28 -04:00
Gabriel Horner
a8a2afbf4a chore: allow query script to fetch by entity 2024-04-03 09:00:38 -04:00
Gabriel Horner
3d49585078 fix: create properties graph and validate graph script 2024-04-02 13:58:52 -04:00
Gabriel Horner
5d915de2e2 enhance: add more useful counts to validation script
helpful for checking a new/imported db graph hasn't regressed
2024-02-26 11:52:46 -05:00
Gabriel Horner
a61ee21e25 enhance: add basic script to test db graph import
also tweaked query script to work with db graphs by relative path
2024-02-24 00:42:46 -05:00
Gabriel Horner
f28cf73ef4 enhance: validate db once for an import
and notify if there are invalid blocks. Removed validating per tx during
import which speeds up import 5-10% on small graphs and more on larger
graphs. Also print some useful stats in the console
2024-02-19 15:34:58 -05:00
Gabriel Horner
72f5218b39 dev: add tasks for saving and diffing datoms
part of LOG-2974
2023-12-19 13:19:10 -05:00
Gabriel Horner
ffa6aaae29 fix: remove unused db.sqlite related fns
- remove sqlite-db/close! as its not used and didn't make sense to be
  used in other electron ns
- remove sqlite-db/connections atom as its not needed
- remove read-graph as its not necessary
- rename cli.persist-graph as its primary purpose has changed
- update effected scripts
2023-12-13 12:06:24 -05:00
Gabriel Horner
1117ad3cb4 fix lint
also comment out print that prevented chaining query results with bb
2023-11-29 10:14:53 -05:00
Gabriel Horner
e5e25bb403 update schema for new hidden page attributes
part of LOG-2854. Also update --closed-maps to use library fn
2023-10-26 12:05:12 -04:00
Gabriel Horner
4fd591620b validate entities that are changed per transact!
This should help us catch bugs due to invalid data fairly quickly.
This only runs when in dev?
part of LOG-2818
2023-10-20 16:57:00 -04:00
Gabriel Horner
edaf9b286a chore: move frontend db namespaces to a dedicated parent ns
Moved these namespaces to logseq.db.frontend.* to make their purpose
explicit and make the namespaces easier to maintain
2023-10-16 17:24:51 -04:00
Gabriel Horner
8756600fd7 Add CI job to test creating and validating a db graph
also update older actions
2023-10-13 10:53:01 -04:00
Gabriel Horner
82bcd01525 simplify :map declarations in db schema
Make :closed opt in rather than required in order for --closed-maps
to work
2023-10-12 10:02:45 -04:00
Gabriel Horner
fe7a46eac9 Move db malli schema into db dep since it's stable
Also add a validate-db task. Part of LOG-2739
2023-10-11 08:40:26 -04:00
Gabriel Horner
172ee0ae24 Provide sqlite.cli for reusable sqlite fns
Already had to do read-graph 3 times and will soon need to it outside
logseq so worth putting this behind an api ns
2023-08-15 18:08:44 -04:00
Gabriel Horner
3f52860cf1 Fix perf issue with property rules for db graphs
Use multiple clauses instead as confirmed by perf test.
Using multiple clauses made rule preparation for d/q more complex
so introduced extract-rules
2023-07-25 17:20:17 -04:00
Gabriel Horner
e9fecfa280 Fix property rules for advanced queries with db graphs
and provide a rules var just for db graphs.
Also simplify query-dsl db-graph support as query-dsl/parse-query
doesn't need to know about db graphs for how it's used
2023-07-25 13:53:18 -04:00
Gabriel Horner
671453aadb Add nbb script to demonstrate datascript querying a sqlite db
Also give test vars more appropriate name
2023-07-08 16:20:42 -04:00