feat: v0.9.0 — Multi-tab editor, schema designer pro, analytics engine, and SSH tunnel#23
Open
Peter-L-SVK wants to merge 116 commits into
Open
feat: v0.9.0 — Multi-tab editor, schema designer pro, analytics engine, and SSH tunnel#23Peter-L-SVK wants to merge 116 commits into
Peter-L-SVK wants to merge 116 commits into
Conversation
- Generates realistic supermarket data using Faker library - Creates supermarket table with 8 columns - Batch inserts 100 rows per execution - Useful for testing Auto-Vacuum Advisor and Schema Anomaly Detector
- Three data presets: Supermarket, Users, E-Commerce - Configurable row count via dialog with dropdown preset selector - Option to drop existing table before generation - Uses Faker library for realistic test data - Lazy import pattern for robustness
- ProcessPoolExecutor splits work across N-1 cores for >1000 rows - Tested on 1M rows with 31 workers on R9 5950X (~125k rows/sec) - Checkbox in generator dialog to enable multi-CPU mode - Drop existing table checkbox for clean regeneration - _generate_chunk as module-level function for ProcessPoolExecutor - Automatic fallback to single-CPU for small datasets
- Debounce search-as-you-type with 300ms delay - Skip highlighting for files larger than 500KB - Limit to 5000 highlighted matches maximum - Prevents UI freezes on large files with many matches
…ight - 8 predefined colors from config.py - Color buttons in designer toolbar with visual preview - Click table to select, then click color to apply - Active color button highlighted with suggested-action CSS class - FK lines inherit color from source table - Table borders and selection highlight match table color
- FK direction toggle button (→ forward, ← reverse) - Arrow and cardinality labels swap based on direction - Line always connects source and target tables - ForeignKey.direction attribute stores current direction
- Zoom with Ctrl+Scroll, Ctrl+/-, Ctrl+0, and 1:1 reset button - Pan with middle mouse drag and arrow keys - Canvas background color from config.py (theme-aware) - Fix FK line selection: closest-distance algorithm with 15px threshold - Prevents wrong FK selection when multiple lines overlap
- ToggleButton opens popover with FlowBox preset colors - Custom colors section (last 16 picked via GTK ColorDialog) - Pick Custom Color button uses Gtk.ColorDialog (GTK 4.10+) - Color button updates when table selection changes - Proper closure capture for lambda callbacks in loops - Fix: use set_can_target(False) so clicks pass through DrawingArea
- Each direction has its own arrowhead calculation and label placement - Forward: arrow from source to target, 1 at source, N at target - Reverse: arrow from target to source, 1 at target, N at source - Labels offset based on direction to avoid line overlap - Removes broken arrow_x1/arrow_y1 swap logic
- Pan: subtract previous cumulative offset to get per-frame delta - Zoom: natural scroll direction (up=zoom in, down=zoom out) - Add explanatory comments for non-obvious design decisions - FK arrowhead and labels now inherit line color from FK object
- from_table = child = N (many) - to_table = parent = 1 (one) - Labels now correct regardless of arrow direction
- Undo/redo buttons in toolbar with Ctrl+Z/Ctrl+Y shortcuts - State saved before add/delete/drag/color/FK operations - Deep copy of tables and relationships for each state - Max 50 states, redo stack cleared on new action - Table index rebuilt on state restore
- EditorTabs container with GtkNotebook for multiple SQL files - EditorTab with GtkSourceView, SQL syntax highlighting - Tab close buttons and drag-reorder support - Ctrl+T new tab, Ctrl+W close tab - File > New Tab / Close Tab menu items - Replaces single SQLEditor in MainWindow
- Line jumps (bridges) at FK line intersections with background-colored circles and semicircle arcs — cleaner than DBeaver Community - Waypoint support: drag to reposition, double-click to delete - Multi-core path computation via ProcessPoolExecutor with spawn context - _draw_segment_styled for consistent curve/ortho/straight rendering - Iterative collision avoidance with corner-based detour routing - Debounced async path scheduling to prevent UI lag during drag - Arrowhead labels corrected to 1->N (parent->child) - Worker pool margin unified to 10px, spawn context prevents GTK fork issues
- Add _on_close() to invalidate in-flight worker callbacks by incrementing _path_serial before the designer widget is destroyed - Connect dialog close-request to _on_close() in _on_designer_clicked - Prevents idle_add calls on destroyed canvas when workers return late
- WorkerBridgeMixin: async path computation via ProcessPoolExecutor - 31 workers with spawn context for full CPU utilization - Line jumps (bridges) at FK intersections - Corner-based detour routing around obstacles - Stable 1/N labels anchored to table positions - Split into package: models, routing, drawing, worker_bridge, designer - Fix: _on_close prevents crash when reopening designer
…es visual style - Add is_detour detection: only first/last segment gets curve/ortho style - Middle detour segments always render as straight lines - _visual_approach_angle computes correct arrowhead direction for curve (horizontal) and ortho (last segment horizontal) styles - Prevents crazy line artefacts from double-bending detour segments
- Add WorkerPool.restart() to recycle worker processes after batch completion - Call restart() when all FK paths are computed or on timeout - Shutdown pool in _on_close() when designer dialog is destroyed - Cancel futures after reading results to free callback references - Limit path points to 50 to prevent runaway memory usage - Prevents OOM crash when importing large schemas
- ssh_tunnel.py: paramiko-based local port forwarding via direct-tcpip - Support RSA, Ed25519, ECDSA keys with ~ expansion - SSHTunnelConfig dataclass for clean parameter passing - ConnectionProfile extended with SSH fields and keyring storage - Connection dialog with SSH tab (host, port, user, auth toggle) - Auth switch between password, key file (with file browser), agent - DatabaseConnector reuses active tunnel instead of creating new ones - Tunnel cleanup on disconnect - Tested and working with localhost SSH + PostgreSQL
Polars Engine: - AnalyticsEngine class replacing pandas with Rust-backed Polars - table_stats, table_stats_safe, column_profile, correlation_matrix - compare_tables: schema diff between two tables - Export methods prepared for CSV, JSON, Parquet - Safe defaults for UI consumption via table_stats_safe AI Tools (extracted to src/ui/ai_tools.py): - AIToolsPopover class with 9 analysis tools - Index Advisor: FK + naming pattern recommendations (HIGH/MEDIUM/LOW) - Missing FKs: detect *_id columns without foreign key constraints - Duplicate Rows: find duplicate data across all tables via Polars - Unused Indexes: find indexes with zero scans from pg_stat_user_indexes - Slow Queries: pg_stat_statements with auto-enable, falls back to pg_stat_activity - Table Growth: sizes, dead rows, vacuum status, index/data ratio - Column Statistics: min, max, null %, unique % for all columns via Polars - Query Analyzer: table stats with null detection via table_stats_safe - Performance Insights: cache hit ratio, top 10 largest tables - All tools show results in results table with status bar messages - English docstrings on all public methods - toolbar.py simplified to UI layout only
Schema Parser: - Remove inline comments before parsing to prevent column confusion - Handle NUMERIC(precision,scale) without spaces - Support SERIAL types with auto PK detection - Parse inline REFERENCES in CREATE TABLE bodies - Skip CHECK, UNIQUE, EXCLUDE constraint lines - Deduplicate foreign keys by (from->to) pair Table Growth: - Fix column name: tablename -> relname in pg_stat_user_tables - Consistent MB formatting for all size columns (0.0 MB) - Show last vacuum/autovacuum/analyze timestamps
- Replace GtkSource.CompletionWords with custom Gtk.Popover autocomplete - Case-insensitive matching via word.upper() comparison - Popover appears after 2+ characters typed with 100ms debounce - Arrow keys navigate popover list, Enter/Tab apply selection - Escape closes popover without applying - 80+ SQL keywords including PostgreSQL-specific extensions - Popover positioned at cursor location via buffer_to_window_coords - ListBox with flat style for native look - No Gio.Task, GObject, or CompletionProvider — avoids PyGObject crashes - Completing flag prevents recursive buffer change triggers
- Preferences dialog now has 'Enable SQL keyword autocomplete' checkbox - Setting saved persistently via Settings manager - EditorTab._autocomplete_enabled class flag controls all tabs globally - _on_buffer_changed skips completion when disabled - Setting applied immediately on Apply button click
- Hide popover when deleting characters (shrinking text) - Require minimum 3 characters before showing suggestions - Limit to 15 suggestions to avoid overwhelming the user - Track text length to detect typing vs deleting
- KebolaNormalizerHook: CSV data validation and quality checks - Validators: email, date, payment method, order status, category, price, quantity - Local mode for offline validation without cloud upload - Optional upload to Keboola Storage via kbcstorage client - KeboolaConfigDialog: GUI configuration for API token, bucket, tables - Test connection button to verify Keboola credentials - Recommendations generated based on validation results - Hook metadata for discovery and scheduling - Configuration persisted to ~/.config/sql-schema-studio/keboola_config.json - English docstrings and comments throughout
…g, and Debian deps - terminal: add missing child_setup_data parameter to Vte.Terminal.spawn_async() fixing "Argument 9 does not allow None as a value" TypeError - hooks: wrap triggers metadata in a list so registry iterates triggers, not individual characters from a bare string - packaging: replace libvte-2.91-gtk4-dev with gir1.2-vte-3.91 runtime binding, add python3-gi-cairo dependency, move pip-only kbcstorage to Suggests
- Fixed incorrect package names in installation instructions (python3-sklearn → python3-scikit-learn, python3-psycopg → python3-psycopg2) - Added pipx as recommended installation method for optional Python packages - Separated required vs optional dependencies with clear documentation - Improved WSL2 setup instructions with proper GUI and PostgreSQL configuration - Added dependency breakdown section explaining purpose of each package - Added installation troubleshooting guide for common issues - Added development installation section for contributors - Added quick start section for users preferring pre-built DEB packages - Aligned README with updated DEB package dependencies structure - Enhanced user guidance for optional features (faker, kbcstorage)
- Fixed incorrect package names in installation instructions - Aligned README with updated DEB package dependencies structure
Owner
Author
Tested on VMsUpdated section for Ubuntu/Debian steps now works properly. Tested also on Mint 22.2 MATE 
Tested with white scheme on Zorin 18 |
- removed pip from intsall steps, Ubuntu distros now using apt for py3 deps - fixed blank space error in build-deb.sh
Adds 8 pre-defined color themes and font selection for the terminal in Preferences. Settings are persisted across sessions. - Added TERMINAL_THEMES with Dark, Light, Tango, Solarized, Monokai, Nord - Added terminal font selection - Terminal applies theme/font on initialization and live update
Owner
Author
Showcase of new Terminal setting tab |
… module Extract TERMINAL_THEMES into its own module (terminal_themes.py) and move ResultsPanel to panels.py under src/ui/results/ package. - Add # fmt: off/on block to preserve multiline palette formatting - Re-export TERMINAL_THEMES as ResultsPanel class attribute for backward compatibility
Preferences "Warn when closing with unsaved changes" checkbox was saved but never read — the close dialog always appeared regardless of the setting. Now _on_close_request reads the setting and silently discards unsaved tabs when the warning is disabled.
- Add file_path attribute to EditorTab, set on save/open - Save list of tab file paths to settings on window close - On startup, if "Restore last session" enabled, reopen saved files - Remove obsolete _current_file, replace with per-tab file_path
…nalysis Add ForecastingHook (GPLv3+) providing data scientist tools operating on Polars DataFrames for zero-copy integration: • trend_forecast: linear regression — slope, intercept, R^2 • moving_average: rolling window smoothing • exponential_forecast: ETS exponential smoothing • percentile_bands: P10/P25/P50/P75/P90/IQR distribution • anomaly_detect: IQR and z-score outlier detection Add right-click context menu on browser tree tables/views with all five forecasting functions, running async and displaying formatted results directly in the Results panel. Fix Hook Manager _show_result to detect and display forecasting output (percentile bands, trend info, anomaly counts) alongside the existing recommendation format.
Both the Hook Manager (execute_sync) and browser right-click forecasting now skip surrogate key columns (id, serial, *_id) and prefer numeric/real/double precision types over integers when auto-discovering which column to analyze. Trend forecast now uses a synthetic row index as the x-axis when only one column is available, eliminating the y=x tautology that produced slope=1.0, R²=1.0 on all inputs. Forecasting is still under construction — "Analyze Last Query Result" integration (respecting WHERE filters from the editor) will be added in a follow-up commit.
…aping, column detection - Fix phantom grab / "Broken accounting" warnings: claim event sequence after popup() and drop stale _active_popover references without calling unparent(), which corrupts GTK4's widget tree. - Fix IndexError in psycopg2 parameter parser: double-escape percent in NOT LIKE '%%\\_id' so the LIKE pattern reaches PostgreSQL as '%\_id' instead of being misinterpreted as a parameter placeholder. - Fix left-click gesture firing on right-clicks: set_button(1) on the click gesture controller. - Fix popover not dismissable by clicking outside: set_autohide(True). - Fix lambda late-binding across GLib.idle_add boundary: store schema/table/func_id as plain Python attributes on each button widget instead of relying on nested-lambda closure capture. - Fix surrogate-key column selection: skip id/serial/*_id columns and prefer real/numeric types over plain integers via CASE data_type ordering. - Defensive fetchall: guard against malformed (None / zero-width) cursor rows before indexing r[0].
Add "📊 Correlation Matrix" as a new right-click option (below a separator from the single-column forecast functions). Unlike the existing hooks that pick the "best" numeric column, this fetches ALL numeric columns (excluding id/serial/*_id), builds a multi-column Polars DataFrame, computes the Pearson correlation via .corr(), and pretty-prints a grid with column headers and 4-decimal values. Changes in browser.py: - _on_right_click: add separator + "📊 Correlation Matrix" button - do_analysis: add func_id == "correlation_matrix" branch — queries all numeric columns, fetches data with null handling - on_loaded: add func_id == "correlation_matrix" branch — corr_df.corr(), pretty-print grid, early return before single-column code path - Type-annotate vals: list[float | None] to satisfy mypy
Peter-L-SVK
changed the title
…ce-all When whole-word matching was enabled (toggle active), the highlight pass correctly used \b<word>\b regex but the navigation pass used GTK's forward_search/backward_search which only filtered by case and text-only, ignoring word boundaries entirely. This caused the cursor to jump to partial matches (e.g. "ordering" when searching "order") while only the substring was highlighted, creating visual inconsistency. Fix: - _search_text: when whole-word is active, use Python re.search() with \b boundaries instead of GTK's forward_search/backward_search, maintaining wrap-around behavior. - _on_replace_all: wrap pattern with \b boundaries when whole-word is active so replacement also respects the toggle.
Reformat with black (default config) — no logic changes.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
v0.9.0 is the largest release to date. Major new subsystems include a
multi-tab SQL editor, a significantly upgraded schema designer with
undo/redo and bidirectional relationships, a Polars-based analytics
engine with 9 AI analyzers, full SSH tunnel support, and an integrated
terminal.
New Features
Multi-Tab SQL Editor
Schema Designer Pro
asynchronously across multiple CPU cores using the worker pool's
ProcessPoolExecutor. The UI remains responsive during routing
because the computation runs in background processes, bypassing
Python's GIL. Results stream back via GLib.idle_add for smooth
canvas updates without blocking the GTK main loop.
around other lines. Waypoints are computed concurrently for each
FK pair, with line jumps (gaps where lines cross) rendered after
all paths are resolved.
schema_designer/with mixinsafter each routing batch
Analytics Engine (Polars + AI Tools)
Right-Click Analytics Menu
Right-click any table or view in the database browser:
SSH Tunnel
Built-in Terminal
Hooks — New Additions
and multi-CPU support for large datasets
Session Restore
Refactoring
results.pysplit into package with separate themes moduleMainWindowsplit into package with modular mixinseditor_tabsseparated into its own packageschema_designerseparated into its own packagewindow.pyandeditor.pyremoved, imports updatedCode Quality & CI/CD
Preferences & Settings
confirm_closepreference wired to actual close behaviorPackaging
vte291-gtk4dependency added for terminal supportDeferred to v1.0.0