Refactored DataFrame JDBC API plus DataSource handling#1487

Merged

zaleslaw merged 26 commits intomasterfrom

jdbc-refactoring

Oct 16, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Refactored DataFrame JDBC API plus DataSource handling#1487

Refactored DataFrame JDBC API plus DataSource handling#1487
zaleslaw merged 26 commits intomasterfrom
jdbc-refactoring

Commits on Oct 9, 2025

Refactored DataFrame JDBC API for enhanced DataSource handling

Refactored schema extraction to use `readSqlTable` and `readSqlQuery` for consistency and improved readability.

Refactored and modularized schema extraction utilities into a dedicated file `readDataFrameSchema.kt`, improving organization and code clarity. Converted several helper functions to `internal` visi…

Commits on Oct 10, 2025

Refactor: Replace `DataFrame` with `DataFrameSchema` for schema-related methods in tests and main codebase

Update logging levels in validation utilities to debug and minor schema interface cleanup

Refactor: support custom `PreparedStatement` configuration, unify query limits, and standardize identifier quoting for various database dialects

Commits on Oct 13, 2025

Refactor: enhance `DbType` with batch size and query timeout properties, improve result set processing, and streamline table metadata handling

Refactor: centralize `makeCommonSqlToKTypeMapping` in `DbType`, streamline SQL type handling and improve readability

Commits on Oct 14, 2025

Refactored query execution logic by introducing `readDataFrameFromDatabase` utility for improved code reuse and clarity.

Refactored ResultSet-processing utilities to use mutable lists for improved post-processing efficiency and reduced copying. Adjusted related functions to accept mutable lists accordingly.

Add `configureStatement` missed parameters

Refactored JDBC utilities: added comprehensive error handling in `readDataFrameFromDatabase`, converted data classes to classes with equality and hashCode implementations, added validation for data…

Update the exception type in the ` read from non-existing table` test for accuracy

Renamed schema extraction functions from `getSchemaFor` to `from` for consistency and clarity across the DataFrame JDBC API. Updated all usages and tests accordingly.

Rename `fromSqlTable` and `fromSqlQuery` to `readSqlTable` and `readSqlQuery` for consistency with updated naming conventions.

Update `GenerateDataSchemaTask` to use `DataFrameSchema` methods for SQL table and query schema generation

Commits on Oct 15, 2025

Refactor: improve code consistency, update parameter documentation, streamline SQL query-related methods, and enhance table schema handling

Commits on Oct 16, 2025

Replace `DEFAULT_LIMIT` with nullable `limit` parameter, defaulting to `null` for unlimited row fetching. Updated all related methods and documentation for clarity.

Add `validateLimit` utility to ensure limit parameter is null or positive; removed redundant exception handling and updated query-building logic.

Add `validateLimit` calls across all JDBC read methods to enforce limit validation.

Clarify "limit" parameter documentation and rename `readDataFrameFromDatabase` to `executeQueryAndBuildDataFrame` across JDBC methods for improved readability and consistency.

Refactor JDBC data handling: relocate and centralize `buildSchemaByTableColumns` and `buildDataColumn` functions, streamline column post-processing logic, and enhance modularity across schema and S…

Ktlint with Junie

Linter with Junie, part 2

Refactor and enhance JDBC: update references for improved consistency, streamline `TableMetadata` class with compact constructor and copy method, and remove unused `columnMetadata` parameter from `…

Add `DataFrameSchema.Companion` class to core API

Refactored DataFrame JDBC API plus DataSource handling#1487zaleslaw merged 26 commits intomasterKotlin/dataframe:masterfrom jdbc-refactoringKotlin/dataframe:jdbc-refactoringCopy head branch name to clipboard

Commits

Commits on Oct 9, 2025

Commits on Oct 10, 2025

Commits on Oct 13, 2025

Commits on Oct 14, 2025

Commits on Oct 15, 2025

Commits on Oct 16, 2025

Refactored DataFrame JDBC API plus DataSource handling#1487
zaleslaw merged 26 commits intomasterfrom
jdbc-refactoring