Compare commits
15 Commits
ebb97b3509
...
main
| Author | SHA1 | Date | |
|---|---|---|---|
| e19e1921e5 | |||
| 94d011e729 | |||
| 263cf04ffb | |||
| 00375c2926 | |||
| 885b9b5e44 | |||
| 298645ffdb | |||
| 330280ba48 | |||
| 02e661d219 | |||
| f7163e2689 | |||
| 091007006d | |||
| 3d66a7fc3c | |||
| e1314496dd | |||
| 70a27b430d | |||
| e078b8a74b | |||
| c2c0e62c2d |
5
.vscode/extensions.json
vendored
Normal file
5
.vscode/extensions.json
vendored
Normal file
@ -0,0 +1,5 @@
|
|||||||
|
{
|
||||||
|
"recommendations": [
|
||||||
|
"rust-lang.rust-analyzer"
|
||||||
|
]
|
||||||
|
}
|
||||||
@ -39,10 +39,6 @@ crate-type = ["cdylib", "lib"]
|
|||||||
name = "pgrx_embed_jspg"
|
name = "pgrx_embed_jspg"
|
||||||
path = "src/bin/pgrx_embed.rs"
|
path = "src/bin/pgrx_embed.rs"
|
||||||
|
|
||||||
[[bin]]
|
|
||||||
name = "ast_explore"
|
|
||||||
path = "src/bin/ast_explore.rs"
|
|
||||||
|
|
||||||
[features]
|
[features]
|
||||||
default = ["pg18"]
|
default = ["pg18"]
|
||||||
pg18 = ["pgrx/pg18", "pgrx-tests/pg18" ]
|
pg18 = ["pgrx/pg18", "pgrx-tests/pg18" ]
|
||||||
|
|||||||
@ -43,7 +43,7 @@ JSPG implements specific extensions to the Draft 2020-12 standard to support the
|
|||||||
#### A. Polymorphism & Referencing (`$ref`, `$family`, and Native Types)
|
#### A. Polymorphism & Referencing (`$ref`, `$family`, and Native Types)
|
||||||
* **Native Type Discrimination (`variations`)**: Schemas defined inside a Postgres `type` are Entities. The validator securely and implicitly manages their `"type"` property. If an entity inherits from `user`, incoming JSON can safely define `{"type": "person"}` without errors, thanks to `compiled_variations` inheritance.
|
* **Native Type Discrimination (`variations`)**: Schemas defined inside a Postgres `type` are Entities. The validator securely and implicitly manages their `"type"` property. If an entity inherits from `user`, incoming JSON can safely define `{"type": "person"}` without errors, thanks to `compiled_variations` inheritance.
|
||||||
* **Structural Inheritance & Viral Infection (`$ref`)**: `$ref` is used exclusively for structural inheritance, *never* for union creation. A Punc request schema that `$ref`s an Entity virally inherits all physical database polymorphism rules for that target.
|
* **Structural Inheritance & Viral Infection (`$ref`)**: `$ref` is used exclusively for structural inheritance, *never* for union creation. A Punc request schema that `$ref`s an Entity virally inherits all physical database polymorphism rules for that target.
|
||||||
* **Shape Polymorphism (`$family`)**: Auto-expands polymorphic API lists based on an abstract Descendants Graph. If `{"$family": "widget"}` is used, JSPG evaluates the JSON against every schema that `$ref`s widget.
|
* **Shape Polymorphism (`$family`)**: Auto-expands polymorphic API lists based on an abstract **Descendants Graph**. If `{"$family": "widget"}` is used, the Validator dynamically identifies *every* schema in the registry that `$ref`s `widget` (e.g., `stock.widget`, `task.widget`) and evaluates the JSON against all of them.
|
||||||
* **Strict Matches & Depth Heuristic**: Polymorphic structures MUST match exactly **one** schema permutation. If multiple inherited struct permutations pass, JSPG applies the **Depth Heuristic Tie-Breaker**, selecting the candidate deepest in the inheritance tree.
|
* **Strict Matches & Depth Heuristic**: Polymorphic structures MUST match exactly **one** schema permutation. If multiple inherited struct permutations pass, JSPG applies the **Depth Heuristic Tie-Breaker**, selecting the candidate deepest in the inheritance tree.
|
||||||
|
|
||||||
#### B. Dot-Notation Schema Resolution & Database Mapping
|
#### B. Dot-Notation Schema Resolution & Database Mapping
|
||||||
@ -103,6 +103,10 @@ The Queryer transforms Postgres into a pre-compiled Semantic Query Engine via th
|
|||||||
* **Array Inclusion**: `{"$in": [values]}`, `{"$nin": [values]}` use native `jsonb_array_elements_text()` bindings to enforce `IN` and `NOT IN` logic without runtime SQL injection risks.
|
* **Array Inclusion**: `{"$in": [values]}`, `{"$nin": [values]}` use native `jsonb_array_elements_text()` bindings to enforce `IN` and `NOT IN` logic without runtime SQL injection risks.
|
||||||
* **Text Matching (ILIKE)**: Evaluates `$eq` or `$ne` against string fields containing the `%` character natively into Postgres `ILIKE` and `NOT ILIKE` partial substring matches.
|
* **Text Matching (ILIKE)**: Evaluates `$eq` or `$ne` against string fields containing the `%` character natively into Postgres `ILIKE` and `NOT ILIKE` partial substring matches.
|
||||||
* **Type Casting**: Safely resolves dynamic combinations by casting values instantly into the physical database types mapped in the schema (e.g. parsing `uuid` bindings to `::uuid`, formatting DateTimes to `::timestamptz`, and numbers to `::numeric`).
|
* **Type Casting**: Safely resolves dynamic combinations by casting values instantly into the physical database types mapped in the schema (e.g. parsing `uuid` bindings to `::uuid`, formatting DateTimes to `::timestamptz`, and numbers to `::numeric`).
|
||||||
|
* **Polymorphic SQL Generation (`$family`)**: Compiles `$family` properties by analyzing the **Physical Database Variations**, *not* the schema descendants.
|
||||||
|
* **The Dot Convention**: When a schema requests `$family: "target.schema"`, the compiler extracts the base type (e.g. `schema`) and looks up its Physical Table definition.
|
||||||
|
* **Multi-Table Branching**: If the Physical Table is a parent to other tables (e.g. `organization` has variations `["organization", "bot", "person"]`), the compiler generates a dynamic `CASE WHEN type = '...' THEN ...` query, expanding into `JOIN`s for each variation.
|
||||||
|
* **Single-Table Bypass**: If the Physical Table is a leaf node with only one variation (e.g. `person` has variations `["person"]`), the compiler cleanly bypasses `CASE` generation and compiles a simple `SELECT` across the base table, as all schema extensions (e.g. `light.person`, `full.person`) are guaranteed to reside in the exact same physical row.
|
||||||
|
|
||||||
### The Stem Engine
|
### The Stem Engine
|
||||||
|
|
||||||
|
|||||||
File diff suppressed because it is too large
Load Diff
@ -1,17 +0,0 @@
|
|||||||
use sqlparser::dialect::PostgreSqlDialect;
|
|
||||||
use sqlparser::parser::Parser;
|
|
||||||
use std::env;
|
|
||||||
|
|
||||||
fn main() {
|
|
||||||
let sql = "SELECT t1_obj_t1_addresses_t1_target_t2.archived, t1.id FROM person t1 JOIN address t1_obj_t1_addresses ON true";
|
|
||||||
let dialect = PostgreSqlDialect {};
|
|
||||||
|
|
||||||
match Parser::parse_sql(&dialect, sql) {
|
|
||||||
Ok(ast) => {
|
|
||||||
println!("{:#?}", ast);
|
|
||||||
}
|
|
||||||
Err(e) => {
|
|
||||||
println!("Error: {:?}", e);
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
@ -32,7 +32,7 @@ pub struct Database {
|
|||||||
pub enums: HashMap<String, Enum>,
|
pub enums: HashMap<String, Enum>,
|
||||||
pub types: HashMap<String, Type>,
|
pub types: HashMap<String, Type>,
|
||||||
pub puncs: HashMap<String, Punc>,
|
pub puncs: HashMap<String, Punc>,
|
||||||
pub relations: HashMap<String, Relation>,
|
pub relations: Vec<Relation>,
|
||||||
pub schemas: HashMap<String, Schema>,
|
pub schemas: HashMap<String, Schema>,
|
||||||
// Map of Schema ID -> { Entity Type -> Target Subschema Arc }
|
// Map of Schema ID -> { Entity Type -> Target Subschema Arc }
|
||||||
pub stems: HashMap<String, HashMap<String, Arc<Stem>>>,
|
pub stems: HashMap<String, HashMap<String, Arc<Stem>>>,
|
||||||
@ -46,7 +46,7 @@ impl Database {
|
|||||||
let mut db = Self {
|
let mut db = Self {
|
||||||
enums: HashMap::new(),
|
enums: HashMap::new(),
|
||||||
types: HashMap::new(),
|
types: HashMap::new(),
|
||||||
relations: HashMap::new(),
|
relations: Vec::new(),
|
||||||
puncs: HashMap::new(),
|
puncs: HashMap::new(),
|
||||||
schemas: HashMap::new(),
|
schemas: HashMap::new(),
|
||||||
stems: HashMap::new(),
|
stems: HashMap::new(),
|
||||||
@ -78,7 +78,11 @@ impl Database {
|
|||||||
for item in arr {
|
for item in arr {
|
||||||
match serde_json::from_value::<Relation>(item.clone()) {
|
match serde_json::from_value::<Relation>(item.clone()) {
|
||||||
Ok(def) => {
|
Ok(def) => {
|
||||||
db.relations.insert(def.constraint.clone(), def);
|
if db.types.contains_key(&def.source_type)
|
||||||
|
&& db.types.contains_key(&def.destination_type)
|
||||||
|
{
|
||||||
|
db.relations.push(def);
|
||||||
|
}
|
||||||
}
|
}
|
||||||
Err(e) => println!("DATABASE RELATION PARSE FAILED: {:?}", e),
|
Err(e) => println!("DATABASE RELATION PARSE FAILED: {:?}", e),
|
||||||
}
|
}
|
||||||
@ -137,7 +141,6 @@ impl Database {
|
|||||||
self.executor.timestamp()
|
self.executor.timestamp()
|
||||||
}
|
}
|
||||||
|
|
||||||
/// Organizes the graph of the database, compiling regex, format functions, and caching relationships.
|
|
||||||
pub fn compile(&mut self) -> Result<(), crate::drop::Drop> {
|
pub fn compile(&mut self) -> Result<(), crate::drop::Drop> {
|
||||||
self.collect_schemas();
|
self.collect_schemas();
|
||||||
self.collect_depths();
|
self.collect_depths();
|
||||||
@ -226,6 +229,79 @@ impl Database {
|
|||||||
self.descendants = descendants;
|
self.descendants = descendants;
|
||||||
}
|
}
|
||||||
|
|
||||||
|
pub fn get_relation(
|
||||||
|
&self,
|
||||||
|
parent_type: &str,
|
||||||
|
child_type: &str,
|
||||||
|
prop_name: &str,
|
||||||
|
relative_keys: Option<&Vec<String>>,
|
||||||
|
) -> Option<(&Relation, bool)> {
|
||||||
|
if parent_type == "entity" && child_type == "entity" {
|
||||||
|
return None; // Ignore entity <-> entity generic fallbacks, they aren't useful edges
|
||||||
|
}
|
||||||
|
|
||||||
|
let p_def = self.types.get(parent_type)?;
|
||||||
|
let c_def = self.types.get(child_type)?;
|
||||||
|
|
||||||
|
let mut matching_rels = Vec::new();
|
||||||
|
let mut directions = Vec::new();
|
||||||
|
|
||||||
|
for rel in &self.relations {
|
||||||
|
let is_forward = p_def.hierarchy.contains(&rel.source_type)
|
||||||
|
&& c_def.hierarchy.contains(&rel.destination_type);
|
||||||
|
let is_reverse = p_def.hierarchy.contains(&rel.destination_type)
|
||||||
|
&& c_def.hierarchy.contains(&rel.source_type);
|
||||||
|
|
||||||
|
if is_forward {
|
||||||
|
matching_rels.push(rel);
|
||||||
|
directions.push(true);
|
||||||
|
} else if is_reverse {
|
||||||
|
matching_rels.push(rel);
|
||||||
|
directions.push(false);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
if matching_rels.is_empty() {
|
||||||
|
return None;
|
||||||
|
}
|
||||||
|
|
||||||
|
if matching_rels.len() == 1 {
|
||||||
|
return Some((matching_rels[0], directions[0]));
|
||||||
|
}
|
||||||
|
|
||||||
|
let mut chosen_idx = 0;
|
||||||
|
let mut resolved = false;
|
||||||
|
|
||||||
|
// Reduce ambiguity with prefix
|
||||||
|
for (i, rel) in matching_rels.iter().enumerate() {
|
||||||
|
if let Some(prefix) = &rel.prefix {
|
||||||
|
if prefix == prop_name {
|
||||||
|
chosen_idx = i;
|
||||||
|
resolved = true;
|
||||||
|
break;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// Reduce ambiguity by checking if relative payload OMITS the prefix (M:M heuristic)
|
||||||
|
if !resolved && relative_keys.is_some() {
|
||||||
|
let keys = relative_keys.unwrap();
|
||||||
|
let mut missing_prefix_ids = Vec::new();
|
||||||
|
for (i, rel) in matching_rels.iter().enumerate() {
|
||||||
|
if let Some(prefix) = &rel.prefix {
|
||||||
|
if !keys.contains(prefix) {
|
||||||
|
missing_prefix_ids.push(i);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
if missing_prefix_ids.len() == 1 {
|
||||||
|
chosen_idx = missing_prefix_ids[0];
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
Some((matching_rels[chosen_idx], directions[chosen_idx]))
|
||||||
|
}
|
||||||
|
|
||||||
fn collect_descendants_recursively(
|
fn collect_descendants_recursively(
|
||||||
target: &str,
|
target: &str,
|
||||||
direct_refs: &HashMap<String, Vec<String>>,
|
direct_refs: &HashMap<String, Vec<String>>,
|
||||||
@ -335,17 +411,14 @@ impl Database {
|
|||||||
if let (Some(pt), Some(prop)) = (&parent_type, &property_name) {
|
if let (Some(pt), Some(prop)) = (&parent_type, &property_name) {
|
||||||
let expected_col = format!("{}_id", prop);
|
let expected_col = format!("{}_id", prop);
|
||||||
let mut found = false;
|
let mut found = false;
|
||||||
for rel in db.relations.values() {
|
|
||||||
if (rel.source_type == *pt && rel.destination_type == entity_type)
|
if let Some((rel, _)) = db.get_relation(pt, &entity_type, prop, None) {
|
||||||
|| (rel.source_type == entity_type && rel.destination_type == *pt)
|
if rel.source_columns.contains(&expected_col) {
|
||||||
{
|
relation_col = Some(expected_col.clone());
|
||||||
if rel.source_columns.contains(&expected_col) {
|
found = true;
|
||||||
relation_col = Some(expected_col.clone());
|
|
||||||
found = true;
|
|
||||||
break;
|
|
||||||
}
|
|
||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
if !found {
|
if !found {
|
||||||
relation_col = Some(expected_col);
|
relation_col = Some(expected_col);
|
||||||
}
|
}
|
||||||
|
|||||||
@ -70,7 +70,7 @@ pub struct ErrorDetails {
|
|||||||
#[serde(skip_serializing_if = "Option::is_none")]
|
#[serde(skip_serializing_if = "Option::is_none")]
|
||||||
pub cause: Option<String>,
|
pub cause: Option<String>,
|
||||||
#[serde(skip_serializing_if = "Option::is_none")]
|
#[serde(skip_serializing_if = "Option::is_none")]
|
||||||
pub context: Option<Vec<String>>,
|
pub context: Option<Value>,
|
||||||
#[serde(skip_serializing_if = "Option::is_none")]
|
#[serde(skip_serializing_if = "Option::is_none")]
|
||||||
pub schema: Option<String>,
|
pub schema: Option<String>,
|
||||||
}
|
}
|
||||||
|
|||||||
@ -21,15 +21,12 @@ impl Merger {
|
|||||||
}
|
}
|
||||||
|
|
||||||
pub fn merge(&self, data: Value) -> crate::drop::Drop {
|
pub fn merge(&self, data: Value) -> crate::drop::Drop {
|
||||||
let mut val_resolved = Value::Null;
|
|
||||||
let mut notifications_queue = Vec::new();
|
let mut notifications_queue = Vec::new();
|
||||||
|
|
||||||
let result = self.merge_internal(data, &mut notifications_queue);
|
|
||||||
|
|
||||||
match result {
|
let result = self.merge_internal(data.clone(), &mut notifications_queue);
|
||||||
Ok(val) => {
|
|
||||||
val_resolved = val;
|
let val_resolved = match result {
|
||||||
}
|
Ok(val) => val,
|
||||||
Err(msg) => {
|
Err(msg) => {
|
||||||
return crate::drop::Drop::with_errors(vec![crate::drop::Error {
|
return crate::drop::Drop::with_errors(vec![crate::drop::Error {
|
||||||
code: "MERGE_FAILED".to_string(),
|
code: "MERGE_FAILED".to_string(),
|
||||||
@ -37,14 +34,14 @@ impl Merger {
|
|||||||
details: crate::drop::ErrorDetails {
|
details: crate::drop::ErrorDetails {
|
||||||
path: "".to_string(),
|
path: "".to_string(),
|
||||||
cause: None,
|
cause: None,
|
||||||
context: None,
|
context: Some(data),
|
||||||
schema: None,
|
schema: None,
|
||||||
},
|
},
|
||||||
}]);
|
}]);
|
||||||
}
|
}
|
||||||
};
|
};
|
||||||
|
|
||||||
// Execute the globally collected, pre-ordered notifications last!
|
// Execute the globally collected, pre-ordered notifications last!
|
||||||
for notify_sql in notifications_queue {
|
for notify_sql in notifications_queue {
|
||||||
if let Err(e) = self.db.execute(¬ify_sql, None) {
|
if let Err(e) = self.db.execute(¬ify_sql, None) {
|
||||||
return crate::drop::Drop::with_errors(vec![crate::drop::Error {
|
return crate::drop::Drop::with_errors(vec![crate::drop::Error {
|
||||||
@ -88,7 +85,11 @@ impl Merger {
|
|||||||
crate::drop::Drop::success_with_val(stripped_val)
|
crate::drop::Drop::success_with_val(stripped_val)
|
||||||
}
|
}
|
||||||
|
|
||||||
pub(crate) fn merge_internal(&self, data: Value, notifications: &mut Vec<String>) -> Result<Value, String> {
|
pub(crate) fn merge_internal(
|
||||||
|
&self,
|
||||||
|
data: Value,
|
||||||
|
notifications: &mut Vec<String>,
|
||||||
|
) -> Result<Value, String> {
|
||||||
match data {
|
match data {
|
||||||
Value::Array(items) => self.merge_array(items, notifications),
|
Value::Array(items) => self.merge_array(items, notifications),
|
||||||
Value::Object(map) => self.merge_object(map, notifications),
|
Value::Object(map) => self.merge_object(map, notifications),
|
||||||
@ -96,7 +97,11 @@ impl Merger {
|
|||||||
}
|
}
|
||||||
}
|
}
|
||||||
|
|
||||||
fn merge_array(&self, items: Vec<Value>, notifications: &mut Vec<String>) -> Result<Value, String> {
|
fn merge_array(
|
||||||
|
&self,
|
||||||
|
items: Vec<Value>,
|
||||||
|
notifications: &mut Vec<String>,
|
||||||
|
) -> Result<Value, String> {
|
||||||
let mut resolved_items = Vec::new();
|
let mut resolved_items = Vec::new();
|
||||||
for item in items {
|
for item in items {
|
||||||
let resolved = self.merge_internal(item, notifications)?;
|
let resolved = self.merge_internal(item, notifications)?;
|
||||||
@ -105,7 +110,11 @@ impl Merger {
|
|||||||
Ok(Value::Array(resolved_items))
|
Ok(Value::Array(resolved_items))
|
||||||
}
|
}
|
||||||
|
|
||||||
fn merge_object(&self, obj: serde_json::Map<String, Value>, notifications: &mut Vec<String>) -> Result<Value, String> {
|
fn merge_object(
|
||||||
|
&self,
|
||||||
|
obj: serde_json::Map<String, Value>,
|
||||||
|
notifications: &mut Vec<String>,
|
||||||
|
) -> Result<Value, String> {
|
||||||
let queue_start = notifications.len();
|
let queue_start = notifications.len();
|
||||||
|
|
||||||
let type_name = match obj.get("type").and_then(|v| v.as_str()) {
|
let type_name = match obj.get("type").and_then(|v| v.as_str()) {
|
||||||
@ -164,10 +173,23 @@ impl Merger {
|
|||||||
_ => continue,
|
_ => continue,
|
||||||
};
|
};
|
||||||
|
|
||||||
let relative_relation = self.get_entity_relation(type_def, &relative, &relation_name)?;
|
// Attempt to extract relative object type name
|
||||||
|
let relative_type_name = match relative.get("type").and_then(|v| v.as_str()) {
|
||||||
|
Some(t) => t,
|
||||||
|
None => continue,
|
||||||
|
};
|
||||||
|
|
||||||
if let Some(relation) = relative_relation {
|
let relative_keys: Vec<String> = relative.keys().cloned().collect();
|
||||||
let parent_is_source = type_def.hierarchy.contains(&relation.source_type);
|
|
||||||
|
// Call central Database O(1) graph logic
|
||||||
|
let relative_relation = self.db.get_relation(
|
||||||
|
&type_def.name,
|
||||||
|
relative_type_name,
|
||||||
|
&relation_name,
|
||||||
|
Some(&relative_keys),
|
||||||
|
);
|
||||||
|
|
||||||
|
if let Some((relation, parent_is_source)) = relative_relation {
|
||||||
|
|
||||||
if parent_is_source {
|
if parent_is_source {
|
||||||
// Parent holds FK to Child. Child MUST be generated FIRST.
|
// Parent holds FK to Child. Child MUST be generated FIRST.
|
||||||
@ -253,9 +275,23 @@ impl Merger {
|
|||||||
_ => continue,
|
_ => continue,
|
||||||
};
|
};
|
||||||
|
|
||||||
let relative_relation = self.get_entity_relation(type_def, first_relative, &relation_name)?;
|
// Attempt to extract relative object type name
|
||||||
|
let relative_type_name = match first_relative.get("type").and_then(|v| v.as_str()) {
|
||||||
|
Some(t) => t,
|
||||||
|
None => continue,
|
||||||
|
};
|
||||||
|
|
||||||
if let Some(relation) = relative_relation {
|
let relative_keys: Vec<String> = first_relative.keys().cloned().collect();
|
||||||
|
|
||||||
|
// Call central Database O(1) graph logic
|
||||||
|
let relative_relation = self.db.get_relation(
|
||||||
|
&type_def.name,
|
||||||
|
relative_type_name,
|
||||||
|
&relation_name,
|
||||||
|
Some(&relative_keys),
|
||||||
|
);
|
||||||
|
|
||||||
|
if let Some((relation, _)) = relative_relation {
|
||||||
let mut relative_responses = Vec::new();
|
let mut relative_responses = Vec::new();
|
||||||
for relative_item_val in relative_arr {
|
for relative_item_val in relative_arr {
|
||||||
if let Value::Object(mut relative_item) = relative_item_val {
|
if let Value::Object(mut relative_item) = relative_item_val {
|
||||||
@ -272,10 +308,11 @@ impl Merger {
|
|||||||
&entity_fields,
|
&entity_fields,
|
||||||
);
|
);
|
||||||
|
|
||||||
let merged_relative = match self.merge_internal(Value::Object(relative_item), notifications)? {
|
let merged_relative =
|
||||||
Value::Object(m) => m,
|
match self.merge_internal(Value::Object(relative_item), notifications)? {
|
||||||
_ => continue,
|
Value::Object(m) => m,
|
||||||
};
|
_ => continue,
|
||||||
|
};
|
||||||
|
|
||||||
relative_responses.push(Value::Object(merged_relative));
|
relative_responses.push(Value::Object(merged_relative));
|
||||||
}
|
}
|
||||||
@ -766,101 +803,7 @@ impl Merger {
|
|||||||
changes
|
changes
|
||||||
}
|
}
|
||||||
|
|
||||||
fn reduce_entity_relations(
|
// Helper Functions
|
||||||
&self,
|
|
||||||
mut matching_relations: Vec<crate::database::relation::Relation>,
|
|
||||||
relative: &serde_json::Map<String, Value>,
|
|
||||||
relation_name: &str,
|
|
||||||
) -> Result<Option<crate::database::relation::Relation>, String> {
|
|
||||||
if matching_relations.is_empty() {
|
|
||||||
return Ok(None);
|
|
||||||
}
|
|
||||||
if matching_relations.len() == 1 {
|
|
||||||
return Ok(Some(matching_relations.pop().unwrap()));
|
|
||||||
}
|
|
||||||
|
|
||||||
let exact_match: Vec<_> = matching_relations
|
|
||||||
.iter()
|
|
||||||
.filter(|r| r.prefix.as_deref() == Some(relation_name))
|
|
||||||
.cloned()
|
|
||||||
.collect();
|
|
||||||
if exact_match.len() == 1 {
|
|
||||||
return Ok(Some(exact_match.into_iter().next().unwrap()));
|
|
||||||
}
|
|
||||||
|
|
||||||
matching_relations.retain(|r| {
|
|
||||||
if let Some(prefix) = &r.prefix {
|
|
||||||
!relative.contains_key(prefix)
|
|
||||||
} else {
|
|
||||||
true
|
|
||||||
}
|
|
||||||
});
|
|
||||||
|
|
||||||
if matching_relations.len() == 1 {
|
|
||||||
Ok(Some(matching_relations.pop().unwrap()))
|
|
||||||
} else {
|
|
||||||
let constraints: Vec<_> = matching_relations
|
|
||||||
.iter()
|
|
||||||
.map(|r| r.constraint.clone())
|
|
||||||
.collect();
|
|
||||||
Err(format!(
|
|
||||||
"AMBIGUOUS_TYPE_RELATIONS: Could not reduce ambiguous type relations: {}",
|
|
||||||
constraints.join(", ")
|
|
||||||
))
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
fn get_entity_relation(
|
|
||||||
&self,
|
|
||||||
entity_type: &crate::database::r#type::Type,
|
|
||||||
relative: &serde_json::Map<String, Value>,
|
|
||||||
relation_name: &str,
|
|
||||||
) -> Result<Option<crate::database::relation::Relation>, String> {
|
|
||||||
let relative_type_name = match relative.get("type").and_then(|v| v.as_str()) {
|
|
||||||
Some(t) => t,
|
|
||||||
None => return Ok(None),
|
|
||||||
};
|
|
||||||
|
|
||||||
let relative_type = match self.db.types.get(relative_type_name) {
|
|
||||||
Some(t) => t,
|
|
||||||
None => return Ok(None),
|
|
||||||
};
|
|
||||||
|
|
||||||
let mut relative_relations: Vec<crate::database::relation::Relation> = Vec::new();
|
|
||||||
|
|
||||||
for r in self.db.relations.values() {
|
|
||||||
if r.source_type != "entity" && r.destination_type != "entity" {
|
|
||||||
let condition1 = relative_type.hierarchy.contains(&r.source_type)
|
|
||||||
&& entity_type.hierarchy.contains(&r.destination_type);
|
|
||||||
let condition2 = entity_type.hierarchy.contains(&r.source_type)
|
|
||||||
&& relative_type.hierarchy.contains(&r.destination_type);
|
|
||||||
|
|
||||||
if condition1 || condition2 {
|
|
||||||
relative_relations.push(r.clone());
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
let mut relative_relation =
|
|
||||||
self.reduce_entity_relations(relative_relations, relative, relation_name)?;
|
|
||||||
|
|
||||||
if relative_relation.is_none() {
|
|
||||||
let mut poly_relations: Vec<crate::database::relation::Relation> = Vec::new();
|
|
||||||
for r in self.db.relations.values() {
|
|
||||||
if r.destination_type == "entity" {
|
|
||||||
let condition1 = relative_type.hierarchy.contains(&r.source_type);
|
|
||||||
let condition2 = entity_type.hierarchy.contains(&r.source_type);
|
|
||||||
|
|
||||||
if condition1 || condition2 {
|
|
||||||
poly_relations.push(r.clone());
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
relative_relation = self.reduce_entity_relations(poly_relations, relative, relation_name)?;
|
|
||||||
}
|
|
||||||
|
|
||||||
Ok(relative_relation)
|
|
||||||
}
|
|
||||||
|
|
||||||
fn apply_entity_relation(
|
fn apply_entity_relation(
|
||||||
source_entity: &mut serde_json::Map<String, Value>,
|
source_entity: &mut serde_json::Map<String, Value>,
|
||||||
|
|||||||
File diff suppressed because it is too large
Load Diff
@ -36,7 +36,7 @@ impl Queryer {
|
|||||||
details: crate::drop::ErrorDetails {
|
details: crate::drop::ErrorDetails {
|
||||||
path: "".to_string(), // filters apply to the root query
|
path: "".to_string(), // filters apply to the root query
|
||||||
cause: Some(msg),
|
cause: Some(msg),
|
||||||
context: filters.map(|f| vec![f.to_string()]),
|
context: filters.cloned(),
|
||||||
schema: Some(schema_id.to_string()),
|
schema: Some(schema_id.to_string()),
|
||||||
},
|
},
|
||||||
}]);
|
}]);
|
||||||
@ -97,7 +97,13 @@ impl Queryer {
|
|||||||
return Ok(cached_sql.value().clone());
|
return Ok(cached_sql.value().clone());
|
||||||
}
|
}
|
||||||
|
|
||||||
let compiler = compiler::SqlCompiler::new(self.db.clone());
|
let compiler = compiler::Compiler {
|
||||||
|
db: &self.db,
|
||||||
|
filter_keys: filter_keys,
|
||||||
|
is_stem_query: stem_opt.is_some(),
|
||||||
|
alias_counter: 0,
|
||||||
|
};
|
||||||
|
|
||||||
match compiler.compile(schema_id, stem_opt, filter_keys) {
|
match compiler.compile(schema_id, stem_opt, filter_keys) {
|
||||||
Ok(compiled_sql) => {
|
Ok(compiled_sql) => {
|
||||||
self
|
self
|
||||||
@ -138,7 +144,7 @@ impl Queryer {
|
|||||||
details: crate::drop::ErrorDetails {
|
details: crate::drop::ErrorDetails {
|
||||||
path: "".to_string(),
|
path: "".to_string(),
|
||||||
cause: Some(format!("Expected array, got {}", other)),
|
cause: Some(format!("Expected array, got {}", other)),
|
||||||
context: Some(vec![sql.to_string()]),
|
context: Some(serde_json::json!([sql])),
|
||||||
schema: Some(schema_id.to_string()),
|
schema: Some(schema_id.to_string()),
|
||||||
},
|
},
|
||||||
}]),
|
}]),
|
||||||
@ -148,7 +154,7 @@ impl Queryer {
|
|||||||
details: crate::drop::ErrorDetails {
|
details: crate::drop::ErrorDetails {
|
||||||
path: "".to_string(),
|
path: "".to_string(),
|
||||||
cause: Some(format!("SPI error in queryer: {}", e)),
|
cause: Some(format!("SPI error in queryer: {}", e)),
|
||||||
context: Some(vec![sql.to_string()]),
|
context: Some(serde_json::json!([sql])),
|
||||||
schema: Some(schema_id.to_string()),
|
schema: Some(schema_id.to_string()),
|
||||||
},
|
},
|
||||||
}]),
|
}]),
|
||||||
|
|||||||
@ -2,7 +2,6 @@ use crate::*;
|
|||||||
pub mod runner;
|
pub mod runner;
|
||||||
pub mod types;
|
pub mod types;
|
||||||
use serde_json::json;
|
use serde_json::json;
|
||||||
pub mod sql_validator;
|
|
||||||
|
|
||||||
// Database module tests moved to src/database/executors/mock.rs
|
// Database module tests moved to src/database/executors/mock.rs
|
||||||
|
|
||||||
|
|||||||
@ -1,19 +1,10 @@
|
|||||||
|
use crate::tests::types::Suite;
|
||||||
use serde::Deserialize;
|
use serde::Deserialize;
|
||||||
|
use serde_json::Value;
|
||||||
use std::collections::HashMap;
|
use std::collections::HashMap;
|
||||||
use std::fs;
|
use std::fs;
|
||||||
use std::sync::{Arc, OnceLock, RwLock};
|
use std::sync::{Arc, OnceLock, RwLock};
|
||||||
|
|
||||||
#[derive(Debug, Deserialize)]
|
|
||||||
pub struct TestSuite {
|
|
||||||
#[allow(dead_code)]
|
|
||||||
pub description: String,
|
|
||||||
pub database: serde_json::Value,
|
|
||||||
pub tests: Vec<TestCase>,
|
|
||||||
}
|
|
||||||
|
|
||||||
use crate::tests::types::TestCase;
|
|
||||||
use serde_json::Value;
|
|
||||||
|
|
||||||
pub fn deserialize_some<'de, D>(deserializer: D) -> Result<Option<Value>, D::Error>
|
pub fn deserialize_some<'de, D>(deserializer: D) -> Result<Option<Value>, D::Error>
|
||||||
where
|
where
|
||||||
D: serde::Deserializer<'de>,
|
D: serde::Deserializer<'de>,
|
||||||
@ -23,7 +14,7 @@ where
|
|||||||
}
|
}
|
||||||
|
|
||||||
// Type alias for easier reading
|
// Type alias for easier reading
|
||||||
type CompiledSuite = Arc<Vec<(TestSuite, Arc<crate::database::Database>)>>;
|
type CompiledSuite = Arc<Vec<(Suite, Arc<crate::database::Database>)>>;
|
||||||
|
|
||||||
// Global cache mapping filename -> Vector of (Parsed JSON suite, Compiled Database)
|
// Global cache mapping filename -> Vector of (Parsed JSON suite, Compiled Database)
|
||||||
static CACHE: OnceLock<RwLock<HashMap<String, CompiledSuite>>> = OnceLock::new();
|
static CACHE: OnceLock<RwLock<HashMap<String, CompiledSuite>>> = OnceLock::new();
|
||||||
@ -46,7 +37,7 @@ fn get_cached_file(path: &str) -> CompiledSuite {
|
|||||||
} else {
|
} else {
|
||||||
let content =
|
let content =
|
||||||
fs::read_to_string(path).unwrap_or_else(|_| panic!("Failed to read file: {}", path));
|
fs::read_to_string(path).unwrap_or_else(|_| panic!("Failed to read file: {}", path));
|
||||||
let suites: Vec<TestSuite> = serde_json::from_str(&content)
|
let suites: Vec<Suite> = serde_json::from_str(&content)
|
||||||
.unwrap_or_else(|e| panic!("Failed to parse JSON in {}: {}", path, e));
|
.unwrap_or_else(|e| panic!("Failed to parse JSON in {}: {}", path, e));
|
||||||
|
|
||||||
let mut compiled_suites = Vec::new();
|
let mut compiled_suites = Vec::new();
|
||||||
|
|||||||
@ -1,156 +0,0 @@
|
|||||||
use sqlparser::ast::{
|
|
||||||
Expr, Join, JoinConstraint, JoinOperator, Query, Select, SelectItem, SetExpr, Statement,
|
|
||||||
TableFactor, TableWithJoins, Ident,
|
|
||||||
};
|
|
||||||
use sqlparser::dialect::PostgreSqlDialect;
|
|
||||||
use sqlparser::parser::Parser;
|
|
||||||
use std::collections::HashSet;
|
|
||||||
|
|
||||||
pub fn validate_semantic_sql(sql: &str) -> Result<(), String> {
|
|
||||||
let dialect = PostgreSqlDialect {};
|
|
||||||
let statements = match Parser::parse_sql(&dialect, sql) {
|
|
||||||
Ok(s) => s,
|
|
||||||
Err(e) => return Err(format!("SQL Syntax Error: {}\nSQL: {}", e, sql)),
|
|
||||||
};
|
|
||||||
|
|
||||||
for statement in statements {
|
|
||||||
validate_statement(&statement, sql)?;
|
|
||||||
}
|
|
||||||
|
|
||||||
Ok(())
|
|
||||||
}
|
|
||||||
|
|
||||||
fn validate_statement(stmt: &Statement, original_sql: &str) -> Result<(), String> {
|
|
||||||
match stmt {
|
|
||||||
Statement::Query(query) => validate_query(query, original_sql)?,
|
|
||||||
Statement::Insert(insert) => {
|
|
||||||
if let Some(query) = &insert.source {
|
|
||||||
validate_query(query, original_sql)?
|
|
||||||
}
|
|
||||||
}
|
|
||||||
Statement::Update(update) => {
|
|
||||||
if let Some(expr) = &update.selection {
|
|
||||||
validate_expr(expr, &HashSet::new(), original_sql)?;
|
|
||||||
}
|
|
||||||
}
|
|
||||||
Statement::Delete(delete) => {
|
|
||||||
if let Some(expr) = &delete.selection {
|
|
||||||
validate_expr(expr, &HashSet::new(), original_sql)?;
|
|
||||||
}
|
|
||||||
}
|
|
||||||
_ => {}
|
|
||||||
}
|
|
||||||
Ok(())
|
|
||||||
}
|
|
||||||
|
|
||||||
fn validate_query(query: &Query, original_sql: &str) -> Result<(), String> {
|
|
||||||
if let SetExpr::Select(select) = &*query.body {
|
|
||||||
validate_select(select, original_sql)?;
|
|
||||||
}
|
|
||||||
Ok(())
|
|
||||||
}
|
|
||||||
|
|
||||||
fn validate_select(select: &Select, original_sql: &str) -> Result<(), String> {
|
|
||||||
let mut available_aliases = HashSet::new();
|
|
||||||
|
|
||||||
// 1. Collect all declared table aliases in the FROM clause and JOINs
|
|
||||||
for table_with_joins in &select.from {
|
|
||||||
collect_aliases_from_table_factor(&table_with_joins.relation, &mut available_aliases);
|
|
||||||
for join in &table_with_joins.joins {
|
|
||||||
collect_aliases_from_table_factor(&join.relation, &mut available_aliases);
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
// 2. Validate all SELECT projection fields
|
|
||||||
for projection in &select.projection {
|
|
||||||
if let SelectItem::UnnamedExpr(expr) | SelectItem::ExprWithAlias { expr, .. } = projection {
|
|
||||||
validate_expr(expr, &available_aliases, original_sql)?;
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
// 3. Validate ON conditions in joins
|
|
||||||
for table_with_joins in &select.from {
|
|
||||||
for join in &table_with_joins.joins {
|
|
||||||
if let JoinOperator::Inner(JoinConstraint::On(expr))
|
|
||||||
| JoinOperator::LeftOuter(JoinConstraint::On(expr))
|
|
||||||
| JoinOperator::RightOuter(JoinConstraint::On(expr))
|
|
||||||
| JoinOperator::FullOuter(JoinConstraint::On(expr))
|
|
||||||
| JoinOperator::Join(JoinConstraint::On(expr)) = &join.join_operator
|
|
||||||
{
|
|
||||||
validate_expr(expr, &available_aliases, original_sql)?;
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
// 4. Validate WHERE conditions
|
|
||||||
if let Some(selection) = &select.selection {
|
|
||||||
validate_expr(selection, &available_aliases, original_sql)?;
|
|
||||||
}
|
|
||||||
|
|
||||||
Ok(())
|
|
||||||
}
|
|
||||||
|
|
||||||
fn collect_aliases_from_table_factor(tf: &TableFactor, aliases: &mut HashSet<String>) {
|
|
||||||
match tf {
|
|
||||||
TableFactor::Table { name, alias, .. } => {
|
|
||||||
if let Some(table_alias) = alias {
|
|
||||||
aliases.insert(table_alias.name.value.clone());
|
|
||||||
} else if let Some(last) = name.0.last() {
|
|
||||||
match last {
|
|
||||||
sqlparser::ast::ObjectNamePart::Identifier(i) => {
|
|
||||||
aliases.insert(i.value.clone());
|
|
||||||
}
|
|
||||||
_ => {}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
TableFactor::Derived { alias: Some(table_alias), .. } => {
|
|
||||||
aliases.insert(table_alias.name.value.clone());
|
|
||||||
}
|
|
||||||
_ => {}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
fn validate_expr(expr: &Expr, available_aliases: &HashSet<String>, sql: &str) -> Result<(), String> {
|
|
||||||
match expr {
|
|
||||||
Expr::CompoundIdentifier(idents) => {
|
|
||||||
if idents.len() == 2 {
|
|
||||||
let alias = &idents[0].value;
|
|
||||||
if !available_aliases.is_empty() && !available_aliases.contains(alias) {
|
|
||||||
return Err(format!(
|
|
||||||
"Semantic Error: Orchestrated query referenced table alias '{}' but it was not declared in the query's FROM/JOIN clauses.\nAvailable aliases: {:?}\nSQL: {}",
|
|
||||||
alias, available_aliases, sql
|
|
||||||
));
|
|
||||||
}
|
|
||||||
} else if idents.len() > 2 {
|
|
||||||
let alias = &idents[1].value; // In form schema.table.column, 'table' is idents[1]
|
|
||||||
if !available_aliases.is_empty() && !available_aliases.contains(alias) {
|
|
||||||
return Err(format!(
|
|
||||||
"Semantic Error: Orchestrated query referenced table '{}' but it was not mapped.\nAvailable aliases: {:?}\nSQL: {}",
|
|
||||||
alias, available_aliases, sql
|
|
||||||
));
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
Expr::BinaryOp { left, right, .. } => {
|
|
||||||
validate_expr(left, available_aliases, sql)?;
|
|
||||||
validate_expr(right, available_aliases, sql)?;
|
|
||||||
}
|
|
||||||
Expr::IsFalse(e) | Expr::IsNotFalse(e) | Expr::IsTrue(e) | Expr::IsNotTrue(e)
|
|
||||||
| Expr::IsNull(e) | Expr::IsNotNull(e) | Expr::InList { expr: e, .. }
|
|
||||||
| Expr::Nested(e) | Expr::UnaryOp { expr: e, .. } | Expr::Cast { expr: e, .. }
|
|
||||||
| Expr::Like { expr: e, .. } | Expr::ILike { expr: e, .. } | Expr::AnyOp { left: e, .. }
|
|
||||||
| Expr::AllOp { left: e, .. } => {
|
|
||||||
validate_expr(e, available_aliases, sql)?;
|
|
||||||
}
|
|
||||||
Expr::Function(func) => {
|
|
||||||
if let sqlparser::ast::FunctionArguments::List(args) = &func.args {
|
|
||||||
if let Some(sqlparser::ast::FunctionArg::Unnamed(sqlparser::ast::FunctionArgExpr::Expr(e))) = args.args.get(0) {
|
|
||||||
validate_expr(e, available_aliases, sql)?;
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
_ => {}
|
|
||||||
}
|
|
||||||
Ok(())
|
|
||||||
}
|
|
||||||
@ -1,11 +1,11 @@
|
|||||||
use super::expect::ExpectBlock;
|
use super::expect::Expect;
|
||||||
use crate::database::Database;
|
use crate::database::Database;
|
||||||
use serde::Deserialize;
|
use serde::Deserialize;
|
||||||
use serde_json::Value;
|
use serde_json::Value;
|
||||||
use std::sync::Arc;
|
use std::sync::Arc;
|
||||||
|
|
||||||
#[derive(Debug, Deserialize)]
|
#[derive(Debug, Deserialize)]
|
||||||
pub struct TestCase {
|
pub struct Case {
|
||||||
pub description: String,
|
pub description: String,
|
||||||
|
|
||||||
#[serde(default = "default_action")]
|
#[serde(default = "default_action")]
|
||||||
@ -30,14 +30,14 @@ pub struct TestCase {
|
|||||||
#[serde(default)]
|
#[serde(default)]
|
||||||
pub mocks: Option<serde_json::Value>,
|
pub mocks: Option<serde_json::Value>,
|
||||||
|
|
||||||
pub expect: Option<ExpectBlock>,
|
pub expect: Option<Expect>,
|
||||||
}
|
}
|
||||||
|
|
||||||
fn default_action() -> String {
|
fn default_action() -> String {
|
||||||
"validate".to_string()
|
"validate".to_string()
|
||||||
}
|
}
|
||||||
|
|
||||||
impl TestCase {
|
impl Case {
|
||||||
pub fn run_compile(&self, db: Arc<Database>) -> Result<(), String> {
|
pub fn run_compile(&self, db: Arc<Database>) -> Result<(), String> {
|
||||||
let expected_success = self.expect.as_ref().map(|e| e.success).unwrap_or(false);
|
let expected_success = self.expect.as_ref().map(|e| e.success).unwrap_or(false);
|
||||||
|
|
||||||
@ -138,6 +138,7 @@ impl TestCase {
|
|||||||
))
|
))
|
||||||
} else if let Some(expect) = &self.expect {
|
} else if let Some(expect) = &self.expect {
|
||||||
let queries = db.executor.get_queries();
|
let queries = db.executor.get_queries();
|
||||||
|
expect.assert_pattern(&queries)?;
|
||||||
expect.assert_sql(&queries)
|
expect.assert_sql(&queries)
|
||||||
} else {
|
} else {
|
||||||
Ok(())
|
Ok(())
|
||||||
@ -176,6 +177,7 @@ impl TestCase {
|
|||||||
))
|
))
|
||||||
} else if let Some(expect) = &self.expect {
|
} else if let Some(expect) = &self.expect {
|
||||||
let queries = db.executor.get_queries();
|
let queries = db.executor.get_queries();
|
||||||
|
expect.assert_pattern(&queries)?;
|
||||||
expect.assert_sql(&queries)
|
expect.assert_sql(&queries)
|
||||||
} else {
|
} else {
|
||||||
Ok(())
|
Ok(())
|
||||||
|
|||||||
22
src/tests/types/expect/mod.rs
Normal file
22
src/tests/types/expect/mod.rs
Normal file
@ -0,0 +1,22 @@
|
|||||||
|
pub mod pattern;
|
||||||
|
pub mod sql;
|
||||||
|
|
||||||
|
use serde::Deserialize;
|
||||||
|
use std::collections::HashMap;
|
||||||
|
|
||||||
|
#[derive(Debug, Deserialize)]
|
||||||
|
#[serde(untagged)]
|
||||||
|
pub enum SqlExpectation {
|
||||||
|
Single(String),
|
||||||
|
Multi(Vec<String>),
|
||||||
|
}
|
||||||
|
|
||||||
|
#[derive(Debug, Deserialize)]
|
||||||
|
pub struct Expect {
|
||||||
|
pub success: bool,
|
||||||
|
pub result: Option<serde_json::Value>,
|
||||||
|
pub errors: Option<Vec<serde_json::Value>>,
|
||||||
|
pub stems: Option<HashMap<String, HashMap<String, serde_json::Value>>>,
|
||||||
|
#[serde(default)]
|
||||||
|
pub sql: Option<Vec<SqlExpectation>>,
|
||||||
|
}
|
||||||
@ -1,30 +1,13 @@
|
|||||||
|
use super::Expect;
|
||||||
use regex::Regex;
|
use regex::Regex;
|
||||||
use serde::Deserialize;
|
|
||||||
use std::collections::HashMap;
|
use std::collections::HashMap;
|
||||||
|
|
||||||
#[derive(Debug, Deserialize)]
|
impl Expect {
|
||||||
#[serde(untagged)]
|
|
||||||
pub enum SqlExpectation {
|
|
||||||
Single(String),
|
|
||||||
Multi(Vec<String>),
|
|
||||||
}
|
|
||||||
|
|
||||||
#[derive(Debug, Deserialize)]
|
|
||||||
pub struct ExpectBlock {
|
|
||||||
pub success: bool,
|
|
||||||
pub result: Option<serde_json::Value>,
|
|
||||||
pub errors: Option<Vec<serde_json::Value>>,
|
|
||||||
pub stems: Option<HashMap<String, HashMap<String, serde_json::Value>>>,
|
|
||||||
#[serde(default)]
|
|
||||||
pub sql: Option<Vec<SqlExpectation>>,
|
|
||||||
}
|
|
||||||
|
|
||||||
impl ExpectBlock {
|
|
||||||
/// Advanced SQL execution assertion algorithm ported from `assert.go`.
|
/// Advanced SQL execution assertion algorithm ported from `assert.go`.
|
||||||
/// This compares two arrays of strings, one containing {{uuid:name}} or {{timestamp}} placeholders,
|
/// This compares two arrays of strings, one containing {{uuid:name}} or {{timestamp}} placeholders,
|
||||||
/// and the other containing actual executed database queries. It ensures that placeholder UUIDs
|
/// and the other containing actual executed database queries. It ensures that placeholder UUIDs
|
||||||
/// are consistently mapped to the same actual UUIDs across all lines, and strictly validates line-by-line sequences.
|
/// are consistently mapped to the same actual UUIDs across all lines, and strictly validates line-by-line sequences.
|
||||||
pub fn assert_sql(&self, actual: &[String]) -> Result<(), String> {
|
pub fn assert_pattern(&self, actual: &[String]) -> Result<(), String> {
|
||||||
let patterns = match &self.sql {
|
let patterns = match &self.sql {
|
||||||
Some(s) => s,
|
Some(s) => s,
|
||||||
None => return Ok(()),
|
None => return Ok(()),
|
||||||
@ -39,12 +22,6 @@ impl ExpectBlock {
|
|||||||
));
|
));
|
||||||
}
|
}
|
||||||
|
|
||||||
for query in actual {
|
|
||||||
if let Err(e) = crate::tests::sql_validator::validate_semantic_sql(query) {
|
|
||||||
return Err(e);
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
let ws_re = Regex::new(r"\s+").unwrap();
|
let ws_re = Regex::new(r"\s+").unwrap();
|
||||||
|
|
||||||
let types = HashMap::from([
|
let types = HashMap::from([
|
||||||
@ -82,8 +59,8 @@ impl ExpectBlock {
|
|||||||
let aline = clean_str(aline_raw);
|
let aline = clean_str(aline_raw);
|
||||||
|
|
||||||
let pattern_str_raw = match pattern_expect {
|
let pattern_str_raw = match pattern_expect {
|
||||||
SqlExpectation::Single(s) => s.clone(),
|
super::SqlExpectation::Single(s) => s.clone(),
|
||||||
SqlExpectation::Multi(m) => m.join(" "),
|
super::SqlExpectation::Multi(m) => m.join(" "),
|
||||||
};
|
};
|
||||||
|
|
||||||
let pattern_str = clean_str(&pattern_str_raw);
|
let pattern_str = clean_str(&pattern_str_raw);
|
||||||
206
src/tests/types/expect/sql.rs
Normal file
206
src/tests/types/expect/sql.rs
Normal file
@ -0,0 +1,206 @@
|
|||||||
|
use super::Expect;
|
||||||
|
use sqlparser::ast::{Expr, Query, SelectItem, Statement, TableFactor};
|
||||||
|
use sqlparser::dialect::PostgreSqlDialect;
|
||||||
|
use sqlparser::parser::Parser;
|
||||||
|
use std::collections::HashSet;
|
||||||
|
|
||||||
|
impl Expect {
|
||||||
|
pub fn assert_sql(&self, actual: &[String]) -> Result<(), String> {
|
||||||
|
for query in actual {
|
||||||
|
if let Err(e) = Self::validate_semantic_sql(query) {
|
||||||
|
return Err(e);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
|
||||||
|
pub fn validate_semantic_sql(sql: &str) -> Result<(), String> {
|
||||||
|
let dialect = PostgreSqlDialect {};
|
||||||
|
let statements = match Parser::parse_sql(&dialect, sql) {
|
||||||
|
Ok(s) => s,
|
||||||
|
Err(e) => return Err(format!("SQL Syntax Error: {}\nSQL: {}", e, sql)),
|
||||||
|
};
|
||||||
|
|
||||||
|
for statement in statements {
|
||||||
|
Self::validate_statement(&statement, sql)?;
|
||||||
|
}
|
||||||
|
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
|
||||||
|
fn validate_statement(stmt: &Statement, original_sql: &str) -> Result<(), String> {
|
||||||
|
match stmt {
|
||||||
|
Statement::Query(query) => Self::validate_query(query, &HashSet::new(), original_sql)?,
|
||||||
|
Statement::Insert(insert) => {
|
||||||
|
if let Some(query) = &insert.source {
|
||||||
|
Self::validate_query(query, &HashSet::new(), original_sql)?
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Statement::Update(update) => {
|
||||||
|
if let Some(expr) = &update.selection {
|
||||||
|
Self::validate_expr(expr, &HashSet::new(), original_sql)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Statement::Delete(delete) => {
|
||||||
|
if let Some(expr) = &delete.selection {
|
||||||
|
Self::validate_expr(expr, &HashSet::new(), original_sql)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
_ => {}
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
|
||||||
|
fn validate_query(
|
||||||
|
query: &Query,
|
||||||
|
available_aliases: &HashSet<String>,
|
||||||
|
original_sql: &str,
|
||||||
|
) -> Result<(), String> {
|
||||||
|
if let sqlparser::ast::SetExpr::Select(select) = &*query.body {
|
||||||
|
Self::validate_select(&select, available_aliases, original_sql)?;
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
|
||||||
|
fn validate_select(
|
||||||
|
select: &sqlparser::ast::Select,
|
||||||
|
parent_aliases: &HashSet<String>,
|
||||||
|
original_sql: &str,
|
||||||
|
) -> Result<(), String> {
|
||||||
|
let mut available_aliases = parent_aliases.clone();
|
||||||
|
|
||||||
|
// 1. Collect all declared table aliases in the FROM clause and JOINs
|
||||||
|
for table_with_joins in &select.from {
|
||||||
|
Self::collect_aliases_from_table_factor(&table_with_joins.relation, &mut available_aliases);
|
||||||
|
for join in &table_with_joins.joins {
|
||||||
|
Self::collect_aliases_from_table_factor(&join.relation, &mut available_aliases);
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// 2. Validate all SELECT projection fields
|
||||||
|
for projection in &select.projection {
|
||||||
|
if let SelectItem::UnnamedExpr(expr) | SelectItem::ExprWithAlias { expr, .. } = projection {
|
||||||
|
Self::validate_expr(expr, &available_aliases, original_sql)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// 3. Validate ON conditions in joins
|
||||||
|
for table_with_joins in &select.from {
|
||||||
|
for join in &table_with_joins.joins {
|
||||||
|
if let sqlparser::ast::JoinOperator::Inner(sqlparser::ast::JoinConstraint::On(expr))
|
||||||
|
| sqlparser::ast::JoinOperator::LeftOuter(sqlparser::ast::JoinConstraint::On(expr))
|
||||||
|
| sqlparser::ast::JoinOperator::RightOuter(sqlparser::ast::JoinConstraint::On(expr))
|
||||||
|
| sqlparser::ast::JoinOperator::FullOuter(sqlparser::ast::JoinConstraint::On(expr))
|
||||||
|
| sqlparser::ast::JoinOperator::Join(sqlparser::ast::JoinConstraint::On(expr)) =
|
||||||
|
&join.join_operator
|
||||||
|
{
|
||||||
|
Self::validate_expr(expr, &available_aliases, original_sql)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
// 4. Validate WHERE conditions
|
||||||
|
if let Some(selection) = &select.selection {
|
||||||
|
Self::validate_expr(selection, &available_aliases, original_sql)?;
|
||||||
|
}
|
||||||
|
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
|
||||||
|
fn collect_aliases_from_table_factor(tf: &TableFactor, aliases: &mut HashSet<String>) {
|
||||||
|
match tf {
|
||||||
|
TableFactor::Table { name, alias, .. } => {
|
||||||
|
if let Some(table_alias) = alias {
|
||||||
|
aliases.insert(table_alias.name.value.clone());
|
||||||
|
} else if let Some(last) = name.0.last() {
|
||||||
|
match last {
|
||||||
|
sqlparser::ast::ObjectNamePart::Identifier(i) => {
|
||||||
|
aliases.insert(i.value.clone());
|
||||||
|
}
|
||||||
|
_ => {}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
TableFactor::Derived {
|
||||||
|
subquery,
|
||||||
|
alias: Some(table_alias),
|
||||||
|
..
|
||||||
|
} => {
|
||||||
|
aliases.insert(table_alias.name.value.clone());
|
||||||
|
// A derived table is technically a nested scope which is opaque outside, but for pure semantic checks
|
||||||
|
// its internal contents should be validated purely within its own scope (not leaking external aliases in, usually)
|
||||||
|
// but Postgres allows lateral correlation. We will validate its interior with an empty scope.
|
||||||
|
let _ = Self::validate_query(subquery, &HashSet::new(), "");
|
||||||
|
}
|
||||||
|
_ => {}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
|
||||||
|
fn validate_expr(
|
||||||
|
expr: &Expr,
|
||||||
|
available_aliases: &HashSet<String>,
|
||||||
|
sql: &str,
|
||||||
|
) -> Result<(), String> {
|
||||||
|
match expr {
|
||||||
|
Expr::CompoundIdentifier(idents) => {
|
||||||
|
if idents.len() == 2 {
|
||||||
|
let alias = &idents[0].value;
|
||||||
|
if !available_aliases.is_empty() && !available_aliases.contains(alias) {
|
||||||
|
return Err(format!(
|
||||||
|
"Semantic Error: Orchestrated query referenced table alias '{}' but it was not declared in the query's FROM/JOIN clauses.\nAvailable aliases: {:?}\nSQL: {}",
|
||||||
|
alias, available_aliases, sql
|
||||||
|
));
|
||||||
|
}
|
||||||
|
} else if idents.len() > 2 {
|
||||||
|
let alias = &idents[1].value; // In form schema.table.column, 'table' is idents[1]
|
||||||
|
if !available_aliases.is_empty() && !available_aliases.contains(alias) {
|
||||||
|
return Err(format!(
|
||||||
|
"Semantic Error: Orchestrated query referenced table '{}' but it was not mapped.\nAvailable aliases: {:?}\nSQL: {}",
|
||||||
|
alias, available_aliases, sql
|
||||||
|
));
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
Expr::Subquery(subquery) => Self::validate_query(subquery, available_aliases, sql)?,
|
||||||
|
Expr::Exists { subquery, .. } => Self::validate_query(subquery, available_aliases, sql)?,
|
||||||
|
Expr::InSubquery {
|
||||||
|
expr: e, subquery, ..
|
||||||
|
} => {
|
||||||
|
Self::validate_expr(e, available_aliases, sql)?;
|
||||||
|
Self::validate_query(subquery, available_aliases, sql)?;
|
||||||
|
}
|
||||||
|
Expr::BinaryOp { left, right, .. } => {
|
||||||
|
Self::validate_expr(left, available_aliases, sql)?;
|
||||||
|
Self::validate_expr(right, available_aliases, sql)?;
|
||||||
|
}
|
||||||
|
Expr::IsFalse(e)
|
||||||
|
| Expr::IsNotFalse(e)
|
||||||
|
| Expr::IsTrue(e)
|
||||||
|
| Expr::IsNotTrue(e)
|
||||||
|
| Expr::IsNull(e)
|
||||||
|
| Expr::IsNotNull(e)
|
||||||
|
| Expr::InList { expr: e, .. }
|
||||||
|
| Expr::Nested(e)
|
||||||
|
| Expr::UnaryOp { expr: e, .. }
|
||||||
|
| Expr::Cast { expr: e, .. }
|
||||||
|
| Expr::Like { expr: e, .. }
|
||||||
|
| Expr::ILike { expr: e, .. }
|
||||||
|
| Expr::AnyOp { left: e, .. }
|
||||||
|
| Expr::AllOp { left: e, .. } => {
|
||||||
|
Self::validate_expr(e, available_aliases, sql)?;
|
||||||
|
}
|
||||||
|
Expr::Function(func) => {
|
||||||
|
if let sqlparser::ast::FunctionArguments::List(args) = &func.args {
|
||||||
|
if let Some(sqlparser::ast::FunctionArg::Unnamed(
|
||||||
|
sqlparser::ast::FunctionArgExpr::Expr(e),
|
||||||
|
)) = args.args.get(0)
|
||||||
|
{
|
||||||
|
Self::validate_expr(e, available_aliases, sql)?;
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
|
_ => {}
|
||||||
|
}
|
||||||
|
Ok(())
|
||||||
|
}
|
||||||
|
}
|
||||||
@ -2,6 +2,6 @@ pub mod case;
|
|||||||
pub mod expect;
|
pub mod expect;
|
||||||
pub mod suite;
|
pub mod suite;
|
||||||
|
|
||||||
pub use case::TestCase;
|
pub use case::Case;
|
||||||
pub use expect::ExpectBlock;
|
pub use expect::Expect;
|
||||||
pub use suite::TestSuite;
|
pub use suite::Suite;
|
||||||
|
|||||||
@ -1,10 +1,10 @@
|
|||||||
use super::case::TestCase;
|
use super::case::Case;
|
||||||
use serde::Deserialize;
|
use serde::Deserialize;
|
||||||
|
|
||||||
#[derive(Debug, Deserialize)]
|
#[derive(Debug, Deserialize)]
|
||||||
pub struct TestSuite {
|
pub struct Suite {
|
||||||
#[allow(dead_code)]
|
#[allow(dead_code)]
|
||||||
pub description: String,
|
pub description: String,
|
||||||
pub database: serde_json::Value,
|
pub database: serde_json::Value,
|
||||||
pub tests: Vec<TestCase>,
|
pub tests: Vec<Case>,
|
||||||
}
|
}
|
||||||
|
|||||||
@ -68,11 +68,11 @@ impl Validator {
|
|||||||
code: e.code,
|
code: e.code,
|
||||||
message: e.message,
|
message: e.message,
|
||||||
details: crate::drop::ErrorDetails {
|
details: crate::drop::ErrorDetails {
|
||||||
path: e.path,
|
path: e.path,
|
||||||
cause: None,
|
cause: None,
|
||||||
context: None,
|
context: None,
|
||||||
schema: None,
|
schema: None,
|
||||||
},
|
},
|
||||||
})
|
})
|
||||||
.collect();
|
.collect();
|
||||||
crate::drop::Drop::with_errors(errors)
|
crate::drop::Drop::with_errors(errors)
|
||||||
|
|||||||
Reference in New Issue
Block a user