Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feat: Drizzle-ORM support for Generated columns #1471

Merged
merged 42 commits into from
Jun 27, 2024
Merged
Changes from 10 commits
Commits
Show all changes
42 commits
Select commit Hold shift + click to select a range
434cfe2
[All] Added new `generated` configuration key to columns and column b…
Angelelz Nov 5, 2023
0b2bb5e
[MySql] Added generatedAlwaysAs method to all column builders and fix…
Angelelz Nov 5, 2023
4787fcb
[Pg] Added `generatedAlwaysAs` and `generatedAsIdentity` methods to a…
Angelelz Nov 5, 2023
862fd2f
[SQLite] Added `generatedAlwaysAs` method to all SQLite column builde…
Angelelz Nov 5, 2023
148f1c0
[All] Fixed type tests
Angelelz Nov 5, 2023
e20b29b
[All] fixed update set types and added type tests
Angelelz Nov 5, 2023
7499703
[All] fixed insert that now bypasses the generated columns and added …
Angelelz Nov 6, 2023
3cffb98
[Pg] Completed implementation of generated as identity
Angelelz Nov 6, 2023
6061a63
[Pg] Deleted config param not needed for generated always as
Angelelz Nov 6, 2023
21b48e1
[All] Deleted old debug coments
Angelelz Nov 19, 2023
6cc364f
Merge branch 'beta' into feat-generated-columns
Angelelz Dec 2, 2023
c201bce
Merge branch 'beta' into feat-generated-columns
AndriiSherman Dec 15, 2023
d0d4011
Merge branch 'beta' into feat-generated-columns
Angelelz Jan 2, 2024
933db61
Merge branch 'beta' into feat-generated-columns
AndriiSherman Mar 25, 2024
dbb1fe0
Add pgSequence, move identity to common, fix type-tests
AndriiSherman Mar 27, 2024
43a5ab9
Move to class for using is with sequences
AndriiSherman Mar 28, 2024
23c870c
Fix test setups for new API
AndriiSherman Mar 28, 2024
25f8d88
Fix import
AndriiSherman Mar 28, 2024
451219c
Merge branch 'main' into generated-internal
AndriiSherman Mar 29, 2024
d5cc3ce
Merge branch 'main' of github.com:drizzle-team/drizzle-orm into gener…
AndriiSherman Mar 29, 2024
a658624
Merge branch 'main' of github.com:drizzle-team/drizzle-orm into feat-…
AndriiSherman Mar 29, 2024
18854f0
expose generated identity
AndriiSherman Apr 1, 2024
169dab4
Merge branch 'feat-generated-columns' into generated-internal
AndriiSherman Apr 1, 2024
0c4b492
Merge branch 'main' of github.com:drizzle-team/drizzle-orm into feat-…
AndriiSherman Apr 3, 2024
5f598e2
Fix shouldDisableInsert part
AndriiSherman Apr 3, 2024
e78f396
Merge branch 'main' of github.com:drizzle-team/drizzle-orm into gener…
AndriiSherman Jun 7, 2024
0d48b64
Fixed new typed configs
AndriiSherman Jun 7, 2024
3739dfc
Add isPgSequence
AndriiSherman Jun 11, 2024
a020011
Merge branch 'main' of github.com:drizzle-team/drizzle-orm into gener…
AndriiSherman Jun 11, 2024
857ba54
Update int.common types
AndriiSherman Jun 11, 2024
f4b4750
Update isPgSequence
AndriiSherman Jun 12, 2024
4ed01aa
Fix imports in sequences
AndriiSherman Jun 12, 2024
0055471
Update PgSequence creation
AndriiSherman Jun 12, 2024
0a6885d
Allow numbers ans strings for sequences properties
AndriiSherman Jun 13, 2024
af7ce99
Add callback option to mysql and sqlite generated
AndriiSherman Jun 17, 2024
81cb794
Update identity behavior
AndriiSherman Jun 22, 2024
7721c7c
Remove seq as an option for identity column
AndriiSherman Jun 22, 2024
b3c3f7c
identity columns has default by default
AndriiSherman Jun 24, 2024
85c8008
Make not null for identity
AndriiSherman Jun 24, 2024
0fdaa9e
Update compatibilityVersion to 8
AndriiSherman Jun 25, 2024
e7cf338
Get version 7 back
AndriiSherman Jun 25, 2024
6b0a11e
Merge branch 'generated-internal' into feat-generated-columns
AndriiSherman Jun 27, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 45 additions & 1 deletion drizzle-orm/src/column-builder.ts
Original file line number Diff line number Diff line change
@@ -19,30 +19,43 @@ export type ColumnDataType =

export type Dialect = 'pg' | 'mysql' | 'sqlite' | 'common';

export type GeneratedStorageMode = 'virtual' | 'stored';

export type GeneratedType = 'always' | 'byDefault';

export type GeneratedColumnConfig<TDataType> = {
as: TDataType | SQL;
type?: GeneratedType;
mode?: GeneratedStorageMode;
};

export interface ColumnBuilderBaseConfig<TDataType extends ColumnDataType, TColumnType extends string> {
name: string;
dataType: TDataType;
columnType: TColumnType;
data: unknown;
driverParam: unknown;
enumValues: string[] | undefined;
generated: GeneratedColumnConfig<unknown> | undefined;
}

export type MakeColumnConfig<
T extends ColumnBuilderBaseConfig<ColumnDataType, string>,
TTableName extends string,
TData = T extends { $type: infer U } ? U : T['data'],
> = {
name: T['name'];
tableName: TTableName;
dataType: T['dataType'];
columnType: T['columnType'];
data: T extends { $type: infer U } ? U : T['data'];
data: TData;
driverParam: T['driverParam'];
notNull: T extends { notNull: true } ? true : false;
hasDefault: T extends { hasDefault: true } ? true : false;
enumValues: T['enumValues'];
baseColumn: T extends { baseBuilder: infer U extends ColumnBuilderBase } ? BuildColumn<TTableName, U, 'common'>
: never;
generated: T['generated'] extends object ? T['generated'] : undefined;
} & {};

export type ColumnBuilderTypeConfig<
@@ -60,6 +73,7 @@ export type ColumnBuilderTypeConfig<
notNull: T extends { notNull: infer U } ? U : boolean;
hasDefault: T extends { hasDefault: infer U } ? U : boolean;
enumValues: T['enumValues'];
generated: GeneratedColumnConfig<T['data']> | undefined;
}
& TTypeConfig
>;
@@ -76,6 +90,7 @@ export type ColumnBuilderRuntimeConfig<TData, TRuntimeConfig extends object = ob
uniqueType: string | undefined;
dataType: string;
columnType: string;
generated: GeneratedColumnConfig<TData> | undefined;
} & TRuntimeConfig;

export interface ColumnBuilderExtraConfig {
@@ -100,11 +115,34 @@ export type $Type<T extends ColumnBuilderBase, TType> = T & {
};
};

export type HasGenerated<T extends ColumnBuilderBase, TGenerated extends {} = {}> = T & {
_: {
notNull: true;
hasDefault: true;
generated: TGenerated;
};
};

export type IsIdentityByDefault<
T extends ColumnBuilderBase,
TType extends 'always' | 'byDefault',
> = T & {
_: {
notNull: true;
hasDefault: true;
generated: { as: any; type: TType };
};
};

export interface ColumnBuilderBase<
T extends ColumnBuilderBaseConfig<ColumnDataType, string> = ColumnBuilderBaseConfig<ColumnDataType, string>,
TTypeConfig extends object = object,
> {
_: ColumnBuilderTypeConfig<T, TTypeConfig>;
generatedAlwaysAs(
as: SQL | T['data'],
config?: Partial<GeneratedColumnConfig<unknown>>,
): HasGenerated<this>;
}

// To understand how to use `ColumnBuilder` and `AnyColumnBuilder`, see `Column` and `AnyColumn` documentation.
@@ -132,6 +170,7 @@ export abstract class ColumnBuilder<
uniqueType: undefined,
dataType,
columnType,
generated: undefined,
} as ColumnBuilderRuntimeConfig<T['data'], TRuntimeConfig>;
}

@@ -202,6 +241,11 @@ export abstract class ColumnBuilder<
this.config.notNull = true;
return this as TExtraConfig['primaryKeyHasDefault'] extends true ? HasDefault<NotNull<this>> : NotNull<this>;
}

abstract generatedAlwaysAs(
as: SQL | T['data'],
config?: Partial<GeneratedColumnConfig<unknown>>,
): HasGenerated<this>;
}

export type BuildColumn<
15 changes: 14 additions & 1 deletion drizzle-orm/src/column.ts
Original file line number Diff line number Diff line change
@@ -1,4 +1,9 @@
import type { ColumnBuilderBaseConfig, ColumnBuilderRuntimeConfig, ColumnDataType } from './column-builder.ts';
import type {
ColumnBuilderBaseConfig,
ColumnBuilderRuntimeConfig,
ColumnDataType,
GeneratedColumnConfig,
} from './column-builder.ts';
import { entityKind } from './entity.ts';
import type { DriverValueMapper, SQL, SQLWrapper } from './sql/sql.ts';
import type { Table } from './table.ts';
@@ -25,6 +30,7 @@ export type ColumnTypeConfig<T extends ColumnBaseConfig<ColumnDataType, string>,
hasDefault: T['hasDefault'];
enumValues: T['enumValues'];
baseColumn: T extends { baseColumn: infer U } ? U : unknown;
generated: GeneratedColumnConfig<T['data']> | undefined;
} & TTypeConfig;

export type ColumnRuntimeConfig<TData, TRuntimeConfig extends object> = ColumnBuilderRuntimeConfig<
@@ -67,6 +73,7 @@ export abstract class Column<
readonly dataType: T['dataType'];
readonly columnType: T['columnType'];
readonly enumValues: T['enumValues'] = undefined;
readonly generated: GeneratedColumnConfig<T['data']> | undefined = undefined;

protected config: ColumnRuntimeConfig<T['data'], TRuntimeConfig>;

@@ -86,6 +93,7 @@ export abstract class Column<
this.uniqueType = config.uniqueType;
this.dataType = config.dataType as T['dataType'];
this.columnType = config.columnType;
this.generated = config.generated;
}

abstract getSQLType(): string;
@@ -97,6 +105,11 @@ export abstract class Column<
mapToDriverValue(value: unknown): unknown {
return value;
}

// ** @internal */
shouldDisableInsert(): boolean {
return this.config.generated !== undefined && this.config.generated.type !== 'byDefault';
}
}

export type UpdateColConfig<
2 changes: 2 additions & 0 deletions drizzle-orm/src/mysql-core/columns/bigint.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlBigInt53BuilderInitial<TName extends string> = MySqlBigInt53Bui
data: number;
driverParam: number | string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlBigInt53Builder<T extends ColumnBuilderBaseConfig<'number', 'MySqlBigInt53'>>
@@ -58,6 +59,7 @@ export type MySqlBigInt64BuilderInitial<TName extends string> = MySqlBigInt64Bui
data: bigint;
driverParam: string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlBigInt64Builder<T extends ColumnBuilderBaseConfig<'bigint', 'MySqlBigInt64'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/binary.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlBinaryBuilderInitial<TName extends string> = MySqlBinaryBuilder
data: string;
driverParam: string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlBinaryBuilder<T extends ColumnBuilderBaseConfig<'string', 'MySqlBinary'>> extends MySqlColumnBuilder<
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/boolean.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlBooleanBuilderInitial<TName extends string> = MySqlBooleanBuild
data: boolean;
driverParam: number | boolean;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlBooleanBuilder<T extends ColumnBuilderBaseConfig<'boolean', 'MySqlBoolean'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/char.ts
Original file line number Diff line number Diff line change
@@ -12,6 +12,7 @@ export type MySqlCharBuilderInitial<TName extends string, TEnum extends [string,
data: TEnum[number];
driverParam: number | string;
enumValues: TEnum;
generated: undefined;
}>;

export class MySqlCharBuilder<T extends ColumnBuilderBaseConfig<'string', 'MySqlChar'>> extends MySqlColumnBuilder<
15 changes: 15 additions & 0 deletions drizzle-orm/src/mysql-core/columns/common.ts
Original file line number Diff line number Diff line change
@@ -6,6 +6,7 @@ import type {
ColumnBuilderRuntimeConfig,
ColumnDataType,
HasDefault,
HasGenerated,
MakeColumnConfig,
} from '~/column-builder.ts';
import type { ColumnBaseConfig } from '~/column.ts';
@@ -14,6 +15,7 @@ import { entityKind } from '~/entity.ts';
import type { ForeignKey, UpdateDeleteAction } from '~/mysql-core/foreign-keys.ts';
import { ForeignKeyBuilder } from '~/mysql-core/foreign-keys.ts';
import type { AnyMySqlTable, MySqlTable } from '~/mysql-core/table.ts';
import type { SQL } from '~/sql/sql.ts';
import type { Update } from '~/utils.ts';
import { uniqueKeyName } from '../unique-constraint.ts';

@@ -30,6 +32,10 @@ export interface MySqlColumnBuilderBase<
TTypeConfig extends object = object,
> extends ColumnBuilderBase<T, TTypeConfig & { dialect: 'mysql' }> {}

export interface MySqlGeneratedColumnConfig {
mode?: 'virtual' | 'stored';
}

export abstract class MySqlColumnBuilder<
T extends ColumnBuilderBaseConfig<ColumnDataType, string> = ColumnBuilderBaseConfig<ColumnDataType, string> & {
data: any;
@@ -55,6 +61,15 @@ export abstract class MySqlColumnBuilder<
return this;
}

generatedAlwaysAs(as: SQL | T['data'], config?: MySqlGeneratedColumnConfig): HasGenerated<this> {
this.config.generated = {
as,
type: 'always',
mode: config?.mode ?? 'virtual',
};
return this as any;
}

/** @internal */
buildForeignKeys(column: MySqlColumn, table: MySqlTable): ForeignKey[] {
return this.foreignKeyConfigs.map(({ ref, actions }) => {
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/custom.ts
Original file line number Diff line number Diff line change
@@ -14,6 +14,7 @@ export type ConvertCustomConfig<TName extends string, T extends Partial<CustomTy
data: T['data'];
driverParam: T['driverData'];
enumValues: undefined;
generated: undefined;
}
& (T['notNull'] extends true ? { notNull: true } : {})
& (T['default'] extends true ? { hasDefault: true } : {});
2 changes: 2 additions & 0 deletions drizzle-orm/src/mysql-core/columns/date.ts
Original file line number Diff line number Diff line change
@@ -12,6 +12,7 @@ export type MySqlDateBuilderInitial<TName extends string> = MySqlDateBuilder<{
data: Date;
driverParam: string | number;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlDateBuilder<T extends ColumnBuilderBaseConfig<'date', 'MySqlDate'>> extends MySqlColumnBuilder<T> {
@@ -55,6 +56,7 @@ export type MySqlDateStringBuilderInitial<TName extends string> = MySqlDateStrin
data: string;
driverParam: string | number;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlDateStringBuilder<T extends ColumnBuilderBaseConfig<'string', 'MySqlDateString'>>
3 changes: 2 additions & 1 deletion drizzle-orm/src/mysql-core/columns/datetime.ts
Original file line number Diff line number Diff line change
@@ -12,6 +12,7 @@ export type MySqlDateTimeBuilderInitial<TName extends string> = MySqlDateTimeBui
data: Date;
driverParam: string | number;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlDateTimeBuilder<T extends ColumnBuilderBaseConfig<'date', 'MySqlDateTime'>>
@@ -68,8 +69,8 @@ export type MySqlDateTimeStringBuilderInitial<TName extends string> = MySqlDateT
columnType: 'MySqlDateTimeString';
data: string;
driverParam: string | number;

enumValues: undefined;
generated: undefined;
}>;

export class MySqlDateTimeStringBuilder<T extends ColumnBuilderBaseConfig<'string', 'MySqlDateTimeString'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/decimal.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlDecimalBuilderInitial<TName extends string> = MySqlDecimalBuild
data: string;
driverParam: string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlDecimalBuilder<
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/double.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlDoubleBuilderInitial<TName extends string> = MySqlDoubleBuilder
data: number;
driverParam: number | string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlDoubleBuilder<T extends ColumnBuilderBaseConfig<'number', 'MySqlDouble'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/enum.ts
Original file line number Diff line number Diff line change
@@ -13,6 +13,7 @@ export type MySqlEnumColumnBuilderInitial<TName extends string, TEnum extends [s
data: TEnum[number];
driverParam: string;
enumValues: TEnum;
generated: undefined;
}>;

export class MySqlEnumColumnBuilder<T extends ColumnBuilderBaseConfig<'string', 'MySqlEnumColumn'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/float.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlFloatBuilderInitial<TName extends string> = MySqlFloatBuilder<{
data: number;
driverParam: number | string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlFloatBuilder<T extends ColumnBuilderBaseConfig<'number', 'MySqlFloat'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/int.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlIntBuilderInitial<TName extends string> = MySqlIntBuilder<{
data: number;
driverParam: number | string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlIntBuilder<T extends ColumnBuilderBaseConfig<'number', 'MySqlInt'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/json.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlJsonBuilderInitial<TName extends string> = MySqlJsonBuilder<{
data: unknown;
driverParam: string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlJsonBuilder<T extends ColumnBuilderBaseConfig<'json', 'MySqlJson'>> extends MySqlColumnBuilder<T> {
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/mediumint.ts
Original file line number Diff line number Diff line change
@@ -12,6 +12,7 @@ export type MySqlMediumIntBuilderInitial<TName extends string> = MySqlMediumIntB
data: number;
driverParam: number | string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlMediumIntBuilder<T extends ColumnBuilderBaseConfig<'number', 'MySqlMediumInt'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/real.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlRealBuilderInitial<TName extends string> = MySqlRealBuilder<{
data: number;
driverParam: number | string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlRealBuilder<T extends ColumnBuilderBaseConfig<'number', 'MySqlReal'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/serial.ts
Original file line number Diff line number Diff line change
@@ -19,6 +19,7 @@ export type MySqlSerialBuilderInitial<TName extends string> = NotNull<
data: number;
driverParam: number;
enumValues: undefined;
generated: undefined;
}>
>
>;
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/smallint.ts
Original file line number Diff line number Diff line change
@@ -12,6 +12,7 @@ export type MySqlSmallIntBuilderInitial<TName extends string> = MySqlSmallIntBui
data: number;
driverParam: number | string;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlSmallIntBuilder<T extends ColumnBuilderBaseConfig<'number', 'MySqlSmallInt'>>
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/text.ts
Original file line number Diff line number Diff line change
@@ -14,6 +14,7 @@ export type MySqlTextBuilderInitial<TName extends string, TEnum extends [string,
data: TEnum[number];
driverParam: string;
enumValues: TEnum;
generated: undefined;
}>;

export class MySqlTextBuilder<T extends ColumnBuilderBaseConfig<'string', 'MySqlText'>> extends MySqlColumnBuilder<
1 change: 1 addition & 0 deletions drizzle-orm/src/mysql-core/columns/time.ts
Original file line number Diff line number Diff line change
@@ -11,6 +11,7 @@ export type MySqlTimeBuilderInitial<TName extends string> = MySqlTimeBuilder<{
data: string;
driverParam: string | number;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlTimeBuilder<T extends ColumnBuilderBaseConfig<'string', 'MySqlTime'>> extends MySqlColumnBuilder<
2 changes: 2 additions & 0 deletions drizzle-orm/src/mysql-core/columns/timestamp.ts
Original file line number Diff line number Diff line change
@@ -12,6 +12,7 @@ export type MySqlTimestampBuilderInitial<TName extends string> = MySqlTimestampB
data: Date;
driverParam: string | number;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlTimestampBuilder<T extends ColumnBuilderBaseConfig<'date', 'MySqlTimestamp'>>
@@ -63,6 +64,7 @@ export type MySqlTimestampStringBuilderInitial<TName extends string> = MySqlTime
data: string;
driverParam: string | number;
enumValues: undefined;
generated: undefined;
}>;

export class MySqlTimestampStringBuilder<T extends ColumnBuilderBaseConfig<'string', 'MySqlTimestampString'>>
Loading