[FSTORE-1439] Merge hopsworks-api, feature-store-api and machine-learning-api#230

Merged

aversey merged 929 commits intomainfrom dev-merge

Jul 17, 2024

+127,572-578

This pull request is big! We're only showing the most recent 250 commits

Commits on May 5, 2023

Fix multi-part insert docstring (#1003)
moritzmeister
authored

Commits on May 9, 2023

[FSTORE-846] Feature Group commit_details fails in certain cases (#1002)
moritzmeister
authored

Commits on May 10, 2023

[FSTORE-851] Increase Kafka List Topics Timeout in HSFS (#1009)
moritzmeister
authored

Commits on May 12, 2023

[FSTORE-854] Accept datetime object in filter and support unbinded features (#1011)

tdoehmen
and
bubriks
authored

Commits on May 17, 2023

[FSTORE-690] Setup Online Feature Store Benchmark with Locust (#948)
moritzmeister
authored

Commits on May 23, 2023

[FSTORE-647][FSTORE-646][FSTORE-644] Bigquery and GCS python validation and path fix (#992)

dhananjay-mk
and
bubriks
authored

Commits on May 26, 2023

[FSTORE-849] Support Spine Dataframes for batch data and training datasets (#1021)
moritzmeister
authored

Commits on May 27, 2023

[FSTORE-838] asynchronous fg.insert/save (#995)

tdoehmen
and
moritzmeister
authored

Commits on May 29, 2023

Commits on Jun 5, 2023

Commits on Jun 6, 2023

[FSTORE-870] Issues including None/Nan/Null values in queries on feature views (#1029)
moritzmeister
authored

Commits on Jun 8, 2023

[FSTORE-855] Query object refactoring and docs (#1015)
tdoehmen
authored

Commits on Jun 9, 2023

Commits on Jun 11, 2023

[FSTORE-894] Add missing mkdocs-minify-plugin for building docs (#1042)
jimdowling
authored

Commits on Jun 12, 2023

[HWORKS-586] Upgrade great expectations to 0.14.13 (#1041)
robzor92
authored

Commits on Jun 14, 2023

added pd.NA support (#1046)
tdoehmen
authored

Commits on Jun 15, 2023

stop loading animation on error (#1049)
tdoehmen
authored

Commits on Jun 19, 2023

Commits on Jun 21, 2023

[FSTORE-912] Fixed arrow schema for complex features (#1047)
vatj
authored

Commits on Jun 22, 2023

Commits on Jun 30, 2023

[FSTORE-931] Add support for creating feature group metadata through save method (#1060)
SirOibaf
authored

Commits on Jul 2, 2023

[FSTORE-935] add return type to get_feature_vector(s) (#1065)
davitbzh
authored

Commits on Jul 3, 2023

Bump development version to 3.4.0-SNAPSHOT/3.4.0.dev1 (#1067)
kouzant
authored

Commits on Jul 11, 2023

[FSTORE-939] Change name of Stream Feature Group's DeltaStreamer Job (#1068)
davitbzh
authored

Commits on Jul 12, 2023

[FSTORE-928] Hitting limit of number of projects that one user can create (#1071)
bubriks
authored

Commits on Jul 14, 2023

Commits on Jul 18, 2023

Commits on Jul 19, 2023

[FSTORE-888] Upgrade to flink 1.17 (#1036)

davitbzh
and
SirOibaf
authored

Commits on Jul 20, 2023

[FSTORE-963] feature group expectation_suite setter doesn't handle pr… (#1080)
SirOibaf
authored

Commits on Jul 23, 2023

[FSTORE-965] fastavro fails to build when installing HSFS (#1082)
SirOibaf
authored

Commits on Jul 24, 2023

[FSTORE-955] Fix bug init batch scoring (#1074)
kennethmhc
authored

Commits on Jul 25, 2023

[FSTORE-942][FSTORE-647] adls path validation and default path fixes for path connectors (#1070)
dhananjay-mk
authored

Commits on Jul 26, 2023

Commits on Jul 28, 2023

[FSTORE-906] Fix compute_stats job for TDs (#1089)
javierdlrm
authored

Commits on Aug 2, 2023

[FSTORE-803] Beam support for HSFS java client (#982)
davitbzh
authored

Commits on Aug 4, 2023

[FSTORE-654] Should throw proper error if data format is not provided. (#1093)
bubriks
authored

Commits on Aug 7, 2023

[FSTORE-842] Setting fg.insert(storage="online") adds data to offline as well (#1092)
bubriks
authored

Commits on Aug 10, 2023

[FSTORE-984] Added bigquery arrow flight storage connector (#1095)
tdoehmen
authored

Commits on Aug 16, 2023

[FSTORE-948] Added ASOF point-in-time join variant (#1090)
tdoehmen
authored

Commits on Aug 26, 2023

[FSTORE-866] Add option to deprecate a feature group (#1094)
bubriks
authored

Commits on Aug 28, 2023

[FSTORE-840] Use existing Kafka cluster (#1028)
bubriks
authored

Commits on Aug 29, 2023

[HWORKS-589] Separate hive metastore from hopsworks (#1097)
SirOibaf
authored

Commits on Aug 30, 2023

Commits on Sep 1, 2023

Commits on Sep 7, 2023

[FSTORE-862] Allow naming of Kafka topics for data ingestion (#1101)
bubriks
authored

Commits on Sep 9, 2023

[APPEND][FSTORE-921] Handle label only fg (#1106)
kennethmhc
authored

Commits on Sep 10, 2023

Commits on Sep 11, 2023

[FSTORE-840][APPEND] Use existing Kafka cluster (#1113)
bubriks
authored

Commits on Sep 12, 2023

[FSTORE-840][APPEND] set "enable.idempotence" to false in flink engine (#1114)
bubriks
authored

Commits on Sep 18, 2023

Prepare for 3.5.0 development (#1117)
SirOibaf
authored

Commits on Sep 19, 2023

Bump HSFS utils version (#1119)
SirOibaf
authored

Commits on Sep 25, 2023

Commits on Sep 28, 2023

[FSTORE-1036] Add usage logging (#1115)
kennethmhc
authored

Commits on Oct 4, 2023

Bump avro from 1.11.0 to 1.11.3 in /python (#1123)
dependabot[bot]
authored

Commits on Oct 10, 2023

[FSTORE-1048] HSFS spark doesn't configure correctly kafka reader/wri… (#1125)
SirOibaf
authored

Commits on Oct 13, 2023

[FSTORE-1051] Allow access to external feature views using DuckDB (#1127)
Steffen Grohsschmiedt
authored

Commits on Oct 17, 2023

Commits on Oct 20, 2023

[FSTORE-1050] Reset arrow_flight_client on close (#1135)
Steffen Grohsschmiedt
authored

Commits on Oct 25, 2023

[FSTORE-1061] Add documentation for get_feature_vector and fallback to use raw feature name (#1138)
kennethmhc
authored

Commits on Oct 27, 2023

[FSTORE-1062] Materialisation job does not work with new Hopsworks sc… (#1136)
SirOibaf
authored

Commits on Nov 2, 2023

[FSTORE-916] FeatureGroup.insert does not retry in case of a failure (#1134)
bubriks
authored
Replace all feature store names for ArrowFlight (#1142)
Steffen Grohsschmiedt
authored

Commits on Nov 3, 2023

[FSTORE-1072] Configure timeout for arrow flight (#1143)
Steffen Grohsschmiedt
authored

Commits on Nov 10, 2023

[FSTORE-1075] Cannot get schema from shared project (#1144)
bubriks
authored

Commits on Nov 18, 2023

[FSTORE-1080] Don't write the operation type in the hoodie table conf… (#1146)
SirOibaf
authored

Commits on Nov 19, 2023

Commits on Nov 20, 2023

[FSTORE-1087] Add retries for FlightUnavailableError (#1151)
Steffen Grohsschmiedt
authored

Commits on Nov 21, 2023

[FSTORE-980] Helper, primary key and event time columns with feature view (#1111)
davitbzh
authored

Commits on Nov 22, 2023

Commits on Nov 23, 2023

Prepare for 3.7.0 development
SirOibaf
committed

Commits on Nov 26, 2023

[FSTORE-1089] Remove copying of application code from databricks integration (#1154)
robzor92
authored

Commits on Nov 30, 2023

Commits on Dec 1, 2023

[FSTORE-1102] Remove unnecessary @staticmethod (#1159)
Steffen Grohsschmiedt
authored

Commits on Dec 4, 2023

[FSTORE-1104] Pin numpy < 2 (#1161)
robzor92
authored

Commits on Dec 11, 2023

[FSTORE-1115] Introduce new spark-no-metastore engine (#1164)
SirOibaf
authored

Commits on Dec 14, 2023

Correcting default value for write_options in recreate_training_data (#1166)
manu-sj
authored

Commits on Dec 15, 2023

[FSTORE-1047] Support Similarity Search in the Feature Store (#1139)
kennethmhc
authored

Commits on Dec 18, 2023

Commits on Dec 20, 2023

[FSTORE-1128] Fallback to head node host in opensearch api (#1172)
kennethmhc
authored

Commits on Dec 22, 2023

[FSTORE-1131] DeltaStreamer job fails when feature group has complex feature (#1178)
bubriks
authored

Commits on Dec 24, 2023

[FSTORE-1116] support aiomysql for executing parallel online queries (#1168)
dhananjay-mk
authored

Commits on Jan 2, 2024

Commits on Jan 9, 2024

[FSTORE-1118][APPEND] Disable preserve_index for pyarrow from_pandas
bubriks
authored

Commits on Jan 11, 2024

Commits on Jan 12, 2024

[FSTORE-1156] Fix FeatureView.clean() code snippet to use the static method
SirOibaf
committed

Commits on Jan 15, 2024

[FSTORE-1047][APPEND] Add opensearch-py as a dependency (#1193)
robzor92
authored

Commits on Jan 17, 2024

[HWORKS-707] Migrate statistics to the DB (#1155)
javierdlrm
authored

Commits on Jan 18, 2024

[FSTORE-1155] Add support for Delta Lake time travel format (#1191)

authored

Commits on Jan 22, 2024

Commits on Jan 23, 2024

Commits on Jan 25, 2024

[FSTORE-1132] Enable filtering in find_neighbors (#1176)
kennethmhc
authored

Commits on Jan 31, 2024

[FSTORE-1164] Support composite primary key in similarity search (#1196)
kennethmhc
authored

Commits on Feb 2, 2024

[FSTORE-1203] 'FeatureGroup' object has no attribute 'time_travel_format' (#1209)
bubriks
authored

Commits on Feb 5, 2024

Commits on Feb 6, 2024

Commits on Feb 8, 2024

[FSTORE-1190] Attach model to embedding feature (#1207)
kennethmhc
authored

Commits on Feb 9, 2024

[FSTORE-1187] Execution failing with framework_failure causes insert to hang forever (#1218)
robzor92
authored

Commits on Feb 11, 2024

Added reminder for logical operands symbols in filter doc (#1219)
Marco Pellegrino
authored

Commits on Feb 12, 2024

[FSTORE-1234] deep copy feature object for updateFeatureDescription in Java client (#1220)

davitbzh
and
davitbzh
authored

Commits on Feb 13, 2024

[FSTORE-1222] Fix Feature Store API Contriburing.md instructions (#1217)

authored

Commits on Feb 15, 2024

[FSTORE-612] Improve API reference for feature monitoring (#1225)
javierdlrm
authored

Commits on Feb 16, 2024

[FSTORE-1181] Helper columns should return all columns if they have different names across feature groups (#1203)
davitbzh
authored

Commits on Feb 19, 2024

[FSTORE-1218] Fix as_of and read_changes doc (#1216)

authored
check helper columns if required (#1229)

davitbzh
and
davitbzh
authored

Commits on Feb 20, 2024

Commits on Feb 21, 2024

[FSTORE-1260] Hsfs should not use hsml client to get embedding model (#1233)
kennethmhc
authored

Commits on Feb 22, 2024

[FSTORE-1202] Support similarity search in external fg (#1210)
kennethmhc
authored

Commits on Feb 24, 2024

[FSTORE-1265] feature_group.materialization_job.run() fails with Spar… (#1234)
SirOibaf
authored

Commits on Feb 26, 2024

Commits on Feb 27, 2024

Commits on Feb 28, 2024

fix no label FG primary key supplied (#1237)
dhananjay-mk
authored

Commits on Mar 1, 2024

[FSTORE-1275][append] table.version can be missing
SirOibaf
committed

Commits on Mar 7, 2024

[FSTORE-1287] Use before_transformation statistics when appropriate (#1246)
javierdlrm
authored

Commits on Mar 8, 2024

[FSTORE-1278] Recreated FG could be blacklisted in onlinefs if schema ID matches (#1244)
bubriks
authored

Commits on Mar 14, 2024

[FSTORE-1186] Polars Integration into Hopsworks - Writing and Reading DataFrames (#1221)
manu-sj
authored

Commits on Mar 18, 2024

[FSTORE-1290] Add embedding classes to API reference (#1248)

kennethmhc
and
bubriks
authored

Commits on Mar 19, 2024

Commits on Mar 20, 2024

Commits on Mar 21, 2024

Catch early failure to read from online storage based on FG being offline only (#1257)
vatj
authored

Commits on Mar 27, 2024

[FSTORE-1237] implement commit_delete_records method for DELTA enabled feature groups (#1222)

authored

Commits on Apr 3, 2024

[FSTORE-1316][APPEND] Move check read supported and check earlier for as_of being used in python client (#1260)
vatj
authored

Commits on Apr 4, 2024

[FSTORE-1334] Pin Polars Version and supress polars CPU warning (#1265)
manu-sj
authored

Commits on Apr 5, 2024

Commits on Apr 10, 2024

Commits on Apr 11, 2024

Commits on Apr 12, 2024

[HWORKS-1115] Remove unused hiveserver2/mysql endpoints (#1272)

SirOibaf
and
vatj
authored

Commits on Apr 15, 2024

Commits on Apr 16, 2024

Commits on Apr 17, 2024

Commits on Apr 20, 2024

[FSTORE-1333][APPEND] Add fixes for missing properties and method on vector server, feature view, vectorDbClient and online store sql client (#1299)
vatj
authored

Commits on Apr 23, 2024

[FSTORE-1346][FSTORE-1212] Fix documentation dependency issues and add outdated banner (#1284)
vatj
authored

Commits on Apr 25, 2024

[FSTORE-1374] Python client can't read a Parquet training dataset created from a Databricks cluster (#1304)
SirOibaf
authored

Commits on Apr 26, 2024

[FSTORE-1360] Make the get_feature_group method smart (#1294)
vatj
authored

Commits on Apr 29, 2024

[FSTORE-1331] Do not disable Hopsworks Feature Query Service on retryable failure (#1303) (#1306)
vatj
authored

Commits on May 2, 2024

[HWORKS-1104] Explicit storage connector provenance (#1263)
bubriks
authored

Commits on May 3, 2024

Commits on May 6, 2024

Commits on May 7, 2024

Commits on May 8, 2024

[FSTORE-1261] Should be able to read vector store for embedding fg (#1316)
kennethmhc
authored

Commits on May 10, 2024

[FSTORE-1378] Refactor opensearch client error handling (#1312)
kennethmhc
authored

Commits on May 15, 2024

[FSTORE-1398] Repr for sql statements + fix get_feature_vectors for label FG (#1329)
vatj
authored

Commits on May 20, 2024

[FSTORE-1402] skip_offsets logic is inverted (#1331)
bubriks
authored

Commits on May 24, 2024

[FSTORE-1348] Online Store Rest Client Compatible with 22.10.3 (#1332)
vatj
authored

Commits on May 27, 2024

enable default to sql client for none value (#1334)
vatj
authored

Commits on May 28, 2024

[FSTORE-1415] Add helper column support for Online Store REST client (#1336)
vatj
authored

Commits on May 29, 2024

Commits on May 31, 2024

Commits on Jun 4, 2024

[FSTORE-1406][APPEND] add warning only if there are no features when getting FG (#1340)
bubriks
authored

Commits on Jun 5, 2024

[FSTORE-1421] Add return_type to fv.find_neighbors (#1342)
kennethmhc
authored

Commits on Jun 10, 2024

[FSTORE-1402-2][APPEND] Set FG id as kafka consumer group id for DeltaStreamer (#1345)
bubriks
authored

Commits on Jun 11, 2024

[FSTORE-1348] Key validation fixes (#1347)
vatj
authored

Commits on Jun 12, 2024

Commits on Jun 13, 2024

Commits on Jun 19, 2024

[FSTORE-1382] fix for async concurrency issues for sql client (#1343)

dhananjay-mk
and
vatj
authored

Commits on Jun 27, 2024

[FSTORE-1423] Refactor Great Expectations to make it an optional dependency (#1344)
vatj
authored

Commits on Jul 2, 2024

undo conflicted overwritten method (#1353)
dhananjay-mk
authored

Commits on Jul 3, 2024

Commits on Jul 8, 2024

Commits on Jul 9, 2024

Commits on Jul 10, 2024

[HWORKS-1416] Close sparks sessions (#1370)
gibchikafa
authored

Commits on Jul 11, 2024

[FSTORE-1285] Model Dependent Transformation Functions (#1308)
manu-sj
authored

Commits on Jul 13, 2024

Commits on Jul 16, 2024

[FSTORE-1439] Merge hopsworks-api, feature-store-api and machine-learning-api
aversey
committed