Add ds.write_dataset kwarg overrides to write_deltalake function

[someaveragepunter]

Description

allow passing ds.write_dataset kwarg overrides into write_deltalake function

delta-rs/python/deltalake/writer.py

Lines 327 to 344 in fcfd1bf

	ds.write_dataset(
	data,
	base_dir="/",
	basename_template=f"{current_version + 1}-{uuid.uuid4()}-{{i}}.parquet",
	format="parquet",
	partitioning=partitioning,
	# It will not accept a schema if using a RBR
	schema=schema if not isinstance(data, RecordBatchReader) else None,
	file_visitor=visitor,
	existing_data_behavior="overwrite_or_ignore",
	file_options=file_options,
	max_open_files=max_open_files,
	max_rows_per_file=max_rows_per_file,
	min_rows_per_group=min_rows_per_group,
	max_rows_per_group=max_rows_per_group,
	filesystem=filesystem,
	max_partitions=max_partitions,
	)

Use Case
my specific use case is to override the basename_template param because at times when I'm bombarding S3 with thousands of concurrent tasks, hitting the parquet file directly without using the txn log to find the files yields performance benefits. hence, explicitly naming the parquet file allows me to statically deterministically specify the filename (as opposed to querying for it at runtime)

Furthermore, this would future proof and expose any additional kwargs / enhancements to the pyarrow datasets api

I'm happy to propose the change and submit PR if this is an acceptable enhancement.

[ion-elgreco]

@someaveragepunter can you elaborate a bit more on the use case? We use UUIDs so that there aren't any file collisions