Skip to content

fix(F19): harden SQL transform engine - #93

Merged
lekhrocks merged 2 commits into
mainfrom
fix/f19-sql-transform-issues
Sep 14, 2026
Merged

lekhrocks merged 2 commits into
mainfrom
fix/f19-sql-transform-issues

Conversation

@lekhrocks

Copy link
Copy Markdown
Owner

Changes

SqlRowTransformProcessor (syncflow-core)

  • Reuse H2 connection across chained queries — was N connections per row, now 1
  • Add DROP TABLE IF EXISTS before CREATE TABLE so chained queries don't fail
  • Cap chained queries at MAX_CHAINED_QUERIES=10 guardrail
  • Fix Javadoc — remove false MODE=MySQL claim, correct H2 URL description
  • Add test sqlQueryMaxChainedQueriesGuardrail

SyncOrchestrator (syncflow-api)

  • Cache processing chains per TableMapping via chainCache.computeIfAbsent() — avoids re-creating 3 objects per CDC event when the same mapping handles many events

Documentation

  • Move F17/F18/F19 from Upcoming to Completed in wiki/Roadmap.md
  • Update ARCHITECTURE_ANALYSIS.md with accurate F17/F18/F19 status

…drail, fix docs

SqlRowTransformProcessor:
- Reuse single H2 connection across chained queries (was N per row)
- Add DROP TABLE IF EXISTS before CREATE TABLE for chained query support
- Cap chained queries at MAX_CHAINED_QUERIES=10
- Fix Javadoc: remove false MODE=MySQL claim, correct H2 URL description
- Add sqlQueryMaxChainedQueriesGuardrail test

SyncOrchestrator:
- Cache processing chains per TableMapping via chainCache.computeIfAbsent
  to avoid re-creating 3 objects per CDC event

Docs:
- Move F17/F18/F19 from Upcoming to Completed in wiki/Roadmap.md
- Update ARCHITECTURE_ANALYSIS.md with accurate F17/F18/F19 status
@lekhrocks
lekhrocks merged commit e184563 into main Sep 14, 2026
18 of 19 checks passed
@lekhrocks
lekhrocks deleted the fix/f19-sql-transform-issues branch September 14, 2026 13:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant