Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FSTORE-1439] Merge hopsworks-api, feature-store-api and machine-learning-api #230

Merged
merged 929 commits into from
Jul 17, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
929 commits
Select commit Hold shift + click to select a range
b2961e2
Fix multi-part insert docstring (#1003)
moritzmeister May 5, 2023
bb674e6
[FSTORE-846] Feature Group commit_details fails in certain cases (#1002)
moritzmeister May 9, 2023
63d5dc0
[FSTORE-851] Increase Kafka List Topics Timeout in HSFS (#1009)
moritzmeister May 10, 2023
b62ece0
[FSTORE-854] Accept datetime object in filter and support unbinded fe…
tdoehmen May 12, 2023
fcc5253
[FSTORE-836] Show "Reading data with..." message and remove Hive warn…
tdoehmen May 16, 2023
b15db64
[FSTORE-861] fetch external broker address for spark/pyspark (#1012)
davitbzh May 16, 2023
ce02454
[FSTORE-751][APPEND] add external kafka listeners for flink engine (#…
davitbzh May 16, 2023
607ed6f
[FSTORE-864] Downgrade avro version in hsfs to 1.8.2 (#1014)
SirOibaf May 16, 2023
89c5bcc
[FSTORE-690] Setup Online Feature Store Benchmark with Locust (#948)
moritzmeister May 17, 2023
dec8827
[FSTORE-647][FSTORE-646][FSTORE-644] Bigquery and GCS python validati…
dhananjay-mk May 23, 2023
de2b020
[FSTORE-849] Support Spine Dataframes for batch data and training dat…
moritzmeister May 26, 2023
3aa1102
[FSTORE-838] asynchronous fg.insert/save (#995)
tdoehmen May 27, 2023
b5f7d17
[FSTORE-737] Show archived commits in Feature Group activity page (#986)
SirOibaf May 29, 2023
ae9f459
[FSTORE-849][append] Add spine group api docs (#1027)
moritzmeister May 29, 2023
9539ff3
[FSTORE-737][append] Fix conversion for last_active_commit_time in py…
SirOibaf Jun 5, 2023
483b960
[FSTORE-883] Add Pandas StringDtype support (#1032)
tdoehmen Jun 5, 2023
3d90644
[FSTORE-870] Issues including None/Nan/Null values in queries on feat…
moritzmeister Jun 6, 2023
d376451
[FSTORE-855] Query object refactoring and docs (#1015)
tdoehmen Jun 8, 2023
534a052
[FSTORE-577] add spark options for s3 (#1035)
dhananjay-mk Jun 9, 2023
e6b5eec
[FSTORE-858] Pandas 2.0 support (#1020)
tdoehmen Jun 9, 2023
e968531
[FSTORE-894] Add missing mkdocs-minify-plugin for building docs (#1042)
jimdowling Jun 11, 2023
8355b97
[HWORKS-586] Upgrade great expectations to 0.14.13 (#1041)
robzor92 Jun 12, 2023
04931af
added pd.NA support (#1046)
tdoehmen Jun 14, 2023
fbc7e5f
stop loading animation on error (#1049)
tdoehmen Jun 15, 2023
dfce232
[FSTORE-922] Python join deserialization reads join_type instead of t…
SirOibaf Jun 19, 2023
cf4f3b9
[FSTORE-893] Get Hopsworks certificates for external Flink client (#…
davitbzh Jun 19, 2023
f0f7bbc
[FSTORE-912] Fixed arrow schema for complex features (#1047)
vatj Jun 21, 2023
3509c62
[FSTORE-917] Decamelize to update metadata + minor cleanup (#1056)
vatj Jun 22, 2023
c0d7272
[FSTORE-924] HSFS External client doens't handle HA services (#1057)
SirOibaf Jun 22, 2023
5e78563
[FSTORE-917][append] Add lower bound to pyarrow (#1058)
vatj Jun 22, 2023
d4ade38
[FSTORE-931] Add support for creating feature group metadata through …
SirOibaf Jun 30, 2023
2e289f4
[FSTORE-935] add return type to get_feature_vector(s) (#1065)
davitbzh Jul 2, 2023
3044349
Bump development version to 3.4.0-SNAPSHOT/3.4.0.dev1 (#1067)
kouzant Jul 3, 2023
1154e0d
[FSTORE-939] Change name of Stream Feature Group's DeltaStreamer Job …
davitbzh Jul 11, 2023
ec6bc40
[FSTORE-928] Hitting limit of number of projects that one user can cr…
bubriks Jul 12, 2023
a00634d
[FSTORE-844] Added arrow flight server read_options (#1075)
tdoehmen Jul 14, 2023
aa8ca0c
[FSTORE-921] Resolve serving key in feature view (#1059)
kennethmhc Jul 14, 2023
79831b7
renaming (#1079)
tdoehmen Jul 18, 2023
ce27edf
[FSTORE-903] Snowflake Storage Connector (#1069)
tdoehmen Jul 18, 2023
b7237ee
[FSTORE-888] Upgrade to flink 1.17 (#1036)
davitbzh Jul 19, 2023
46a3cff
[FSTORE-963] feature group expectation_suite setter doesn't handle pr…
SirOibaf Jul 20, 2023
2c0c33c
[FSTORE-965] fastavro fails to build when installing HSFS (#1082)
SirOibaf Jul 23, 2023
808b79e
[FSTORE-955] Fix bug init batch scoring (#1074)
kennethmhc Jul 24, 2023
2ed1d06
[FSTORE-942][FSTORE-647] adls path validation and default path fixes …
dhananjay-mk Jul 25, 2023
72bc303
[FSTORE-877] Materializing Training Dataset with Arrow Flight (light)…
tdoehmen Jul 26, 2023
235d00d
[APPEND][FSTORE-955] Fix get batch data (#1087)
kennethmhc Jul 26, 2023
5a6dc4b
[FSTORE-906] Fix compute_stats job for TDs (#1089)
javierdlrm Jul 28, 2023
3b4cae9
[FSTORE-803] Beam support for HSFS java client (#982)
davitbzh Aug 2, 2023
79e5a6f
[FSTORE-654] Should throw proper error if data format is not provided…
bubriks Aug 4, 2023
dcfc826
[FSTORE-842] Setting fg.insert(storage="online") adds data to offline…
bubriks Aug 7, 2023
230dccb
[FSTORE-984] Added bigquery arrow flight storage connector (#1095)
tdoehmen Aug 10, 2023
b3b8903
[FSTORE-948] Added ASOF point-in-time join variant (#1090)
tdoehmen Aug 16, 2023
78dbbf4
[FSTORE-866] Add option to deprecate a feature group (#1094)
bubriks Aug 26, 2023
5e61e86
[FSTORE-840] Use existing Kafka cluster (#1028)
bubriks Aug 28, 2023
c102e47
[HWORKS-589] Separate hive metastore from hopsworks (#1097)
SirOibaf Aug 29, 2023
b1edac2
[FSTORE-840][APPEND] Use existing Kafka cluster (#1098)
bubriks Aug 30, 2023
bb07747
[FSTORE-926] enable external client support for bigquery & GCS (#1096)
dhananjay-mk Aug 30, 2023
3e67b26
[FSTORE-993] HSFS Java should use UTF-8 when creating the StringEntit…
SirOibaf Aug 30, 2023
ec58c86
[FSTORE-997] Pin pandas<2.1.0 for hsfs (#1105)
robzor92 Sep 1, 2023
aa4edfe
[FSTORE-840][APPEND] Use existing Kafka cluster (#1104)
bubriks Sep 1, 2023
4cdf6e8
Add maven clean in java ut (#1107)
SirOibaf Sep 1, 2023
cf57117
[FSTORE-862] Allow naming of Kafka topics for data ingestion (#1101)
bubriks Sep 7, 2023
603aeba
[APPEND][FSTORE-921] Handle label only fg (#1106)
kennethmhc Sep 9, 2023
111dda8
[FSTORE-1006] Fix training dataset paths (#1109)
kennethmhc Sep 10, 2023
1f54980
[FSTORE-840][APPEND] Use existing Kafka cluster (#1112)
bubriks Sep 10, 2023
87e57f9
[FSTORE-840][APPEND] Use existing Kafka cluster (#1113)
bubriks Sep 11, 2023
a4999a8
[FSTORE-840][APPEND] set "enable.idempotence" to false in flink engin…
bubriks Sep 12, 2023
02ada1d
Prepare for 3.5.0 development (#1117)
SirOibaf Sep 18, 2023
8f34671
Bump HSFS utils version (#1119)
SirOibaf Sep 19, 2023
f8cd354
[FSTORE-1027] Join_type parameter fix in documentation (#1121)
Maxxx-zh Sep 25, 2023
329ef40
[HWORKS-745] Support python 3.11 for the client APIs (#1118)
robzor92 Sep 25, 2023
8d44921
[FSTORE-1036] Add usage logging (#1115)
kennethmhc Sep 28, 2023
0d08a51
Bump avro from 1.11.0 to 1.11.3 in /python (#1123)
dependabot[bot] Oct 4, 2023
e9407e3
[FSTORE-1048] HSFS spark doesn't configure correctly kafka reader/wri…
SirOibaf Oct 10, 2023
507d975
[FSTORE-1051] Allow access to external feature views using DuckDB (#1…
Oct 13, 2023
27d4746
[FSTORE-927] Upgrade great expectations to 0.15.12 (#1128)
robzor92 Oct 17, 2023
d3255ea
[HWORKS-798] Add **kwargs to python client libraries (#1129)
robzor92 Oct 17, 2023
e15c2fa
[FSTORE-1050] Reset arrow_flight_client on close (#1135)
Oct 20, 2023
3d6237c
[FSTORE-1061] Add documentation for get_feature_vector and fallback t…
kennethmhc Oct 25, 2023
9686480
[FSTORE-1062] Materialisation job does not work with new Hopsworks sc…
SirOibaf Oct 27, 2023
756a867
[FSTORE-916] FeatureGroup.insert does not retry in case of a failure …
bubriks Nov 2, 2023
5c9be7a
Replace all feature store names for ArrowFlight (#1142)
Nov 2, 2023
26134b4
[FSTORE-1072] Configure timeout for arrow flight (#1143)
Nov 3, 2023
2664dc3
[FSTORE-1075] Cannot get schema from shared project (#1144)
bubriks Nov 10, 2023
48f19dd
[FSTORE-1080] Don't write the operation type in the hoodie table conf…
SirOibaf Nov 18, 2023
2057bd2
[FSTORE-1085] Add profiles to HSFS to support multiple Spark version …
SirOibaf Nov 19, 2023
66ac4c1
[FSTORE-1080][append] Update java utils to use correct version of hsf…
SirOibaf Nov 19, 2023
1685adf
[FSTORE-1087] Add retries for FlightUnavailableError (#1151)
Nov 20, 2023
6a6ab76
[FSTORE-980] Helper, primary key and event time columns with feature …
davitbzh Nov 21, 2023
5a22c50
added strip to authentication headers (#1152)
MKLepium Nov 22, 2023
ad9c85f
[FSTORE-1084] Change spark query name (#1149)
kennethmhc Nov 22, 2023
26492b6
Bump org.json:json from 20230227 to 20231013 in /java (#1133)
dependabot[bot] Nov 22, 2023
d0d0fde
Prepare for 3.7.0 development
SirOibaf Nov 23, 2023
a0c4a5d
[FSTORE-1089] Remove copying of application code from databricks inte…
robzor92 Nov 26, 2023
cac9a09
[FSTORE-1097] Disable usage for unit test (#1158)
kennethmhc Nov 30, 2023
1c46ef7
[HWORKS-802] Python 3.12 support for clients (#1157)
robzor92 Nov 30, 2023
aaf27d9
[FSTORE-1102] Remove unnecessary @staticmethod (#1159)
Dec 1, 2023
2c56672
[FSTORE-1104] Pin numpy < 2 (#1161)
robzor92 Dec 4, 2023
6ed179a
[FSTORE-1115] Introduce new spark-no-metastore engine (#1164)
SirOibaf Dec 11, 2023
60bfb1a
Correcting default value for write_options in recreate_training_data …
manu-sj Dec 14, 2023
fbfc07a
[FSTORE-1047] Support Similarity Search in the Feature Store (#1139)
kennethmhc Dec 15, 2023
7e5b257
[FSTORE-1021] Add a warning when using externally managed Kafka
bubriks Dec 18, 2023
825d867
[FSTORE-1052] Update the docs to include Kafka config variables for t…
bubriks Dec 18, 2023
c2dfca3
[FSTORE-1128] Fallback to head node host in opensearch api (#1172)
kennethmhc Dec 20, 2023
cfb6598
[FSTORE-1131] DeltaStreamer job fails when feature group has complex …
bubriks Dec 22, 2023
ff1355a
[FSTORE-1116] support aiomysql for executing parallel online queries …
dhananjay-mk Dec 24, 2023
40cf8f4
[FSTORE-1138] Java client is not designed to work with shared feature…
bubriks Jan 2, 2024
1f01fac
[FSTORE-1130] Get schema from shared project (#1174)
bubriks Jan 2, 2024
8458c36
[FSTORE-1055] Support pandas 2.1.* (#1169)
robzor92 Jan 2, 2024
c7a035d
[FSTORE-1118] Pandas arrow type dataframes cannot be inserted into fe…
manu-sj Jan 5, 2024
3630a87
[FSTORE-1143] Bump fastavro to 1.8.4 to install using provided wheel …
robzor92 Jan 5, 2024
b424247
[FSTORE-1142] Remove markupsafe<2.1.0 pinning (#1183)
robzor92 Jan 5, 2024
a9abc3e
[HWORKS-897] Upgrade pytest to match internal hopsworks version (#1186)
robzor92 Jan 5, 2024
010fd27
[FSTORE-1034] .select() method should not default to empty list (#1185)
bubriks Jan 5, 2024
05690b4
[FSTORE-1118][APPEND] Disable preserve_index for pyarrow from_pandas
bubriks Jan 9, 2024
e211f16
fix serving_keys for similarity search (#1188)
dhananjay-mk Jan 11, 2024
5ec8379
[FSTORE-1152] Get list of tds metadata from fv object (#1189)
javierdlrm Jan 11, 2024
a822237
[FSTORE-1156] Fix FeatureView.clean() code snippet to use the static …
SirOibaf Jan 12, 2024
025b0ec
[FSTORE-1047][APPEND] Add opensearch-py as a dependency (#1193)
robzor92 Jan 15, 2024
031f29e
[HWORKS-707] Migrate statistics to the DB (#1155)
javierdlrm Jan 17, 2024
ae100c5
[FSTORE-1155] Add support for Delta Lake time travel format (#1191)
davitbzh Jan 18, 2024
61e5ed3
[HWORKS-944] Pin upper pandas to 2.1.4 (#1195)
robzor92 Jan 22, 2024
b4c812f
[FSTORE-1182] Extend spark-no-metastore engine to compute statistics …
SirOibaf Jan 22, 2024
cd79ac6
[FSTORE-1184] Kafka storage connector confluent_options method uses w…
SirOibaf Jan 23, 2024
16a688a
[HWORKS-934] Use more precise statistics (#1198)
javierdlrm Jan 23, 2024
d6d4519
[FSTORE-1132] Enable filtering in find_neighbors (#1176)
kennethmhc Jan 25, 2024
cd78490
[FSTORE-1193] HSFS python tests fail after moto has been updated (#1206)
bubriks Jan 30, 2024
f3d812a
[FSTORE-1147] Online feature store notification system (#1202)
bubriks Jan 30, 2024
868d84e
[FSTORE-1136] Add doc for similarity search (#1179)
kennethmhc Jan 30, 2024
d7dc7d8
[FSTORE-1116][APPEND] Fix ordering of executed prepared statements an…
dhananjay-mk Jan 30, 2024
58d4e5e
[FSTORE-1164] Support composite primary key in similarity search (#1196)
kennethmhc Jan 31, 2024
4c2e5a1
[FSTORE-1203] 'FeatureGroup' object has no attribute 'time_travel_for…
bubriks Feb 2, 2024
3b8cc9d
[FSTORE-1213] Remove support for configuring databricks instances fro…
SirOibaf Feb 5, 2024
3755c8d
[FSTORE-1180] metastore confuses partitions when reading fg and retur…
bubriks Feb 5, 2024
cda955d
[FSTORE-612] Support for feature monitoring (#1205)
javierdlrm Feb 6, 2024
d9e8744
Prepare for 3.8.0-SNAPSHOT development
SirOibaf Feb 6, 2024
de66023
[FSTORE-1180][UNDO] metastore confuses partitions when reading fg and…
bubriks Feb 6, 2024
63508c2
[FSTORE-1190] Attach model to embedding feature (#1207)
kennethmhc Feb 8, 2024
70b0e5c
[FSTORE-1187] Execution failing with framework_failure causes insert …
robzor92 Feb 9, 2024
03e0788
Added reminder for logical operands symbols in filter doc (#1219)
Feb 11, 2024
93f76a4
[FSTORE-1234] deep copy feature object for updateFeatureDescription i…
davitbzh Feb 12, 2024
070389f
[FSTORE-1222] Fix Feature Store API Contriburing.md instructions (#1217)
Feb 13, 2024
53bdddd
[FSTORE-612] Improve API reference for feature monitoring (#1225)
javierdlrm Feb 15, 2024
3283198
[FSTORE-1181] Helper columns should return all columns if they have d…
davitbzh Feb 16, 2024
d43dedc
[FSTORE-1218] Fix as_of and read_changes doc (#1216)
Feb 19, 2024
5132d69
check helper columns if required (#1229)
davitbzh Feb 19, 2024
6907101
[FSTORE-1181][APPEND] for materialized training datasets check helper…
davitbzh Feb 20, 2024
725a21e
[FSTORE-1253] Adding support for all datatype during statistic comput…
javierdlrm Feb 20, 2024
cc0a31c
[FSTORE-1260] Hsfs should not use hsml client to get embedding model …
kennethmhc Feb 21, 2024
fc8b352
[FSTORE-1202] Support similarity search in external fg (#1210)
kennethmhc Feb 22, 2024
2cd5b2f
[FSTORE-1265] feature_group.materialization_job.run() fails with Spar…
SirOibaf Feb 24, 2024
48bb5e0
[FSTORE-1183] Error downloading credentials for Kafka storage connect…
bubriks Feb 26, 2024
8a54daa
[FSTORE-1268] fv.serving_keys raises 'FeatureGroup' object has no fea…
SirOibaf Feb 26, 2024
e456067
[FSTORE-1247] Raise DataValidationException on validation failure of …
vatj Feb 27, 2024
2e23263
[FSTORE-1275] HoodieDeltaStreamer fails if table was created with Hoo…
SirOibaf Feb 27, 2024
479d2fa
[FSTORE-1276] Use a larger value of k in find_neighbors when using pr…
kennethmhc Feb 27, 2024
c947c8a
fix no label FG primary key supplied (#1237)
dhananjay-mk Feb 28, 2024
ab7fc21
[FSTORE-1275][append] table.version can be missing
SirOibaf Mar 1, 2024
beb6822
[FSTORE-1287] Use before_transformation statistics when appropriate (…
javierdlrm Mar 7, 2024
30ca722
[FSTORE-1278] Recreated FG could be blacklisted in onlinefs if schema…
bubriks Mar 8, 2024
88e21d3
[FSTORE-1186] Polars Integration into Hopsworks - Writing and Reading…
manu-sj Mar 14, 2024
522490c
[FSTORE-1290] Add embedding classes to API reference (#1248)
kennethmhc Mar 18, 2024
579bd47
[FSTORE-1306] Use ruff as linter and formatter (#1250)
vatj Mar 19, 2024
2702633
[HWORKS-936] Explicit model provenance (#1254)
bubriks Mar 19, 2024
01c2d0e
[FSTORE-1305] Handle requested result is too large in vector database…
kennethmhc Mar 20, 2024
7aff80c
[FSTORE-1306][Append] Handle None in Training Dataset splits setter (…
vatj Mar 20, 2024
a240c32
[FSTORE-1186][APPEND] Polars Integration into Hopsworks - Writing and…
manu-sj Mar 20, 2024
1cee6be
Catch early failure to read from online storage based on FG being off…
vatj Mar 21, 2024
e32405e
[FSTORE-1237] implement commit_delete_records method for DELTA enable…
davitbzh Mar 27, 2024
b1e0744
[FSTORE-1316][APPEND] Move check read supported and check earlier for…
vatj Apr 3, 2024
02710db
[FSTORE-1334] Pin Polars Version and supress polars CPU warning (#1265)
manu-sj Apr 4, 2024
a020492
Infer reference branch for source link from env variables (#1268)
vatj Apr 5, 2024
e72735a
Fix for release not PR tests... (#1270)
vatj Apr 5, 2024
e4ec98b
[FSTORE-1284] install aiomysql from LC fork (#1274)
dhananjay-mk Apr 10, 2024
9727df2
[FSTORE-1349] Upgrade great expectations to 0.18.12 (#1278)
vatj Apr 10, 2024
69a8554
[FSTORE-1346] Update dependencies on the documentation generation (#1…
vatj Apr 10, 2024
c24395f
[FSTORE-1225] Validate the embedding feature in add_embedding (#1273)
kennethmhc Apr 11, 2024
032f31c
[FSTORE-1354] Fix spark engine udf time series split test on windows …
vatj Apr 11, 2024
2ef5ef6
[HWORKS-1115] Remove unused hiveserver2/mysql endpoints (#1272)
SirOibaf Apr 12, 2024
7622d57
[FSTORE-1350] Add method to configure Databricks certificates on the …
SirOibaf Apr 15, 2024
a8a007b
[FSTORE-1250] Add HTTP server to locust benchmarks (#1227)
SirOibaf Apr 15, 2024
d64f225
[FSTORE-1226] Make sure the index mapping limit does not exceed when …
kennethmhc Apr 15, 2024
a2fb5b8
[FSTORE-1324][Append] Add annotations to several api classes (#1264)
vatj Apr 16, 2024
038cc58
[FSTORE-1324] Increase type hinting coverage (#1262)
vatj Apr 16, 2024
198c9b7
[FSTORE-1342] Add base online store client (#1276)
vatj Apr 16, 2024
32ed536
[FSTORE-1324][APPEND] Add fail safe in case feature_store property no…
vatj Apr 17, 2024
c3d514c
[FSTORE-1333] Refactor SQL client out of vector server (#1261)
vatj Apr 17, 2024
b43136d
[FSTORE-1330] Autofix feature names which contains spaces (#1292)
vatj Apr 17, 2024
3862fad
[FSTORE-1317] Add retry and count to embedding index (#1277)
kennethmhc Apr 18, 2024
df35e98
[FSTORE-1359] Send datetime as utc in usage reports and add timezone …
vatj Apr 18, 2024
ee02e71
[FSTORE-1362] Fix profiling for null-only columns (#1297)
javierdlrm Apr 18, 2024
cc69b62
[FSTORE-1333][APPEND] Several fixes for missing attributes or methods…
vatj Apr 18, 2024
3146174
[FSTORE-1333][APPEND] Add fixes for missing properties and method on …
vatj Apr 20, 2024
4d24865
[FSTORE-1346][FSTORE-1212] Fix documentation dependency issues and ad…
vatj Apr 23, 2024
cbb1cb7
[FSTORE-1374] Python client can't read a Parquet training dataset cre…
SirOibaf Apr 25, 2024
a99d92d
[FSTORE-1360] Make the get_feature_group method smart (#1294)
vatj Apr 26, 2024
606d44e
[FSTORE-1331] Do not disable Hopsworks Feature Query Service on retry…
vatj Apr 29, 2024
bc01b89
[FSTORE-1331][APPEND] Fix timeout typo and cleanup static members (#1…
vatj Apr 30, 2024
939ea71
[FSTORE-1264] Test ingesting different data types to opensearch (#1302)
kennethmhc Apr 30, 2024
0d15262
[FSTORE-1360][APPEND] fix get for cached and ondemand fgs (#1313)
bubriks Apr 30, 2024
ab3be6f
[HWORKS-1161] explicit provenance - feature view - cache last trainin…
o-alex Apr 30, 2024
0f7c6ec
[HWORKS-1104] Explicit storage connector provenance (#1263)
bubriks May 2, 2024
7496e0a
[FSTORE-1377] Feature store API returns 401 error during jwt token ro…
SirOibaf May 3, 2024
d3ce7e2
[FSTORE-1360][append] Remove wild print (#1320)
SirOibaf May 3, 2024
845c90c
[APPEND][FSTORE-1226] Fix mapping in vector db client (#1318)
kennethmhc May 6, 2024
c874a7a
[FSTORE-1371] Move to pyproject, add badge for supported python versi…
vatj May 6, 2024
c7cf606
[FSTORE-1371] Add submodules and fix required python version (#1322)
vatj May 6, 2024
e15e920
[HWORKS-1104][APPEND] Explicit storage connector provenance documenta…
bubriks May 7, 2024
ea21150
[FSTORE-1317] Hanlde opensearch timeout parameter (#1323)
kennethmhc May 7, 2024
25c8a22
[FSTORE-1333][APPEND] fg_label and helper fix (#1326)
vatj May 7, 2024
9de81f4
[FSTORE-1261] Should be able to read vector store for embedding fg (#…
kennethmhc May 8, 2024
b9fad9a
[FSTORE-1378] Refactor opensearch client error handling (#1312)
kennethmhc May 10, 2024
523ccfb
[FSTORE-1398] Repr for sql statements + fix get_feature_vectors for l…
vatj May 15, 2024
fbeb684
[FSTORE-1402] skip_offsets logic is inverted (#1331)
bubriks May 20, 2024
6d3353c
[FSTORE-1348] Online Store Rest Client Compatible with 22.10.3 (#1332)
vatj May 24, 2024
2f1b4c6
enable default to sql client for none value (#1334)
vatj May 27, 2024
5a59264
[FSTORE-1415] Add helper column support for Online Store REST client …
vatj May 28, 2024
af2e77b
[FSTORE-1414] Create a method for collecting client info (#1335)
kennethmhc May 29, 2024
d2d8f88
[FSTORE-1406] add warning if there are no features (#1333)
bubriks May 29, 2024
356813b
[FSTORE-1348][APPEND] If a feature is a label, then no need to fail i…
vatj May 31, 2024
be0356d
[FSTORE-1402][APPEND] Always provide offsets for the first execution …
bubriks May 31, 2024
a0b1467
[FSTORE-1417] Remove not implemented similarity search functionality …
kennethmhc May 31, 2024
64056de
[FSTORE-1406][APPEND] add warning only if there are no features when…
bubriks Jun 4, 2024
2b9eb8a
[FSTORE-1421] Add return_type to fv.find_neighbors (#1342)
kennethmhc Jun 5, 2024
12a1740
[FSTORE-1402-2][APPEND] Set FG id as kafka consumer group id for Delt…
bubriks Jun 10, 2024
5558f1c
[FSTORE-1348] Key validation fixes (#1347)
vatj Jun 11, 2024
737a967
[HWORKS-1309] Switch to -m build to build the Python wheel (#1349)
SirOibaf Jun 12, 2024
d93a5c9
[FSTORE-1425] Publish hopsworks aiomysql fork on pypi (#1350)
SirOibaf Jun 12, 2024
2a8e0c2
[FSTORE-1426] add requirements.txt for documentation instead of using…
SirOibaf Jun 13, 2024
0b73101
Prepare for 4.0.0-SNAPSHOT development
SirOibaf Jun 13, 2024
02291fb
[FSTORE-1382] fix for async concurrency issues for sql client (#1343)
dhananjay-mk Jun 19, 2024
19a45c4
[FSTORE-1423] Refactor Great Expectations to make it an optional depe…
vatj Jun 27, 2024
676d135
undo conflicted overwritten method (#1353)
dhananjay-mk Jul 2, 2024
fec5fb4
[FSTORE-1459] Fix spark initialization in client/external.py (#1356)
aversey Jul 3, 2024
b939fff
[HWORKS-1373] Append MATERIAL_DIRECTORY env var value to certificates…
gibchikafa Jul 3, 2024
b208343
[FSTORE-1459] Fix test_base_client.py (#1355)
aversey Jul 5, 2024
a9ba98a
[FSTORE-1463] Refactor SQL dependencies out of util (#1362)
vatj Jul 5, 2024
7c5bbb2
[FSTORE-1462] Remove hive connection from python client (#1361)
vatj Jul 5, 2024
4b79d34
[FSTORE-1435] In helper columns change argument "primary_keys" to "pr…
davitbzh Jul 5, 2024
65a05ca
[FSTORE-1424] Feature logging (#1354)
kennethmhc Jul 5, 2024
834d13f
[FSTORE-1461] Refactor Kafka out of python engine (#1359)
vatj Jul 8, 2024
cf4c3e0
Fix mistype of _project_id in engine/python (#1364)
aversey Jul 8, 2024
70dd435
[APPEND][FSTORE-1424] Feature logging fix fv logging_enabled (#1366)
kennethmhc Jul 8, 2024
7c5ae12
[APPEND][FSTORE-1424] Feature logging fix _apply_transformation_funct…
kennethmhc Jul 9, 2024
7210867
[FSTORE-1105] Query constructor for snowflake schema (#1346)
davitbzh Jul 9, 2024
8c0d994
[HWORKS-1416] Close sparks sessions (#1370)
gibchikafa Jul 10, 2024
a4efba1
[FSTORE-1285] Model Dependent Transformation Functions (#1308)
manu-sj Jul 11, 2024
c599739
Merge machine-learning-api into hsml subdirectory
aversey Jul 13, 2024
d8f3979
Merge feature-store-api into hsfs subdirectory
aversey Jul 13, 2024
67484a9
[FSTORE-1439] Merge hopsworks-api, feature-store-api and machine-lear…
aversey Jul 13, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
32 changes: 32 additions & 0 deletions .github/pull_request_template.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
This PR adds/fixes/changes...
- please summarize your changes to the code
- and make sure to include all changes to user-facing APIs

JIRA Issue: -

Priority for Review: -

Related PRs: -

**How Has This Been Tested?**

- [ ] Unit Tests
- [ ] Integration Tests
- [ ] Manual Tests on VM


**Checklist For The Assigned Reviewer:**

```
- [ ] Checked if merge conflicts with master exist
- [ ] Checked if stylechecks for Java and Python pass
- [ ] Checked if all docstrings were added and/or updated appropriately
- [ ] Ran spellcheck on docstring
- [ ] Checked if guides & concepts need to be updated
- [ ] Checked if naming conventions for parameters and variables were followed
- [ ] Checked if private methods are properly declared and used
- [ ] Checked if hard-to-understand areas of code are commented
- [ ] Checked if tests are effective
- [ ] Built and deployed changes on dev VM and tested manually
- [x] (Checked if all type annotations were added and/or updated appropriately)
```
62 changes: 62 additions & 0 deletions .github/workflows/java.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,62 @@
name: java

on: pull_request

jobs:
unit_tests:
name: Unit Tests
runs-on: ubuntu-latest

steps:
- name: Set Timezone
run: sudo timedatectl set-timezone UTC

- name: Checkout
uses: actions/checkout@v3

- name: Set up JDK 8
uses: actions/setup-java@v3
with:
java-version: "8"
distribution: "adopt"

- name: Cache local Maven repository
uses: actions/cache@v2
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-${{ hashFiles('java/pom.xml') }}
restore-keys: |
${{ runner.os }}-maven-

- name: Test
working-directory: ./java
run: mvn clean test

unit_tests_local_tz:
name: Unit Tests (Local TZ)
runs-on: ubuntu-latest

steps:
- name: Set Timezone
run: sudo timedatectl set-timezone Europe/Amsterdam

- name: Checkout
uses: actions/checkout@v3

- name: Set up JDK 8
uses: actions/setup-java@v3
with:
java-version: "8"
distribution: "adopt"

- name: Cache local Maven repository
uses: actions/cache@v2
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-${{ hashFiles('java/pom.xml') }}
restore-keys: |
${{ runner.os }}-maven-

- name: Test
working-directory: ./java
run: mvn clean test
19 changes: 18 additions & 1 deletion .github/workflows/mkdocs-main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,24 @@ jobs:
run: cp ../README.md . && pip3 install -r ../requirements-docs.txt && pip3 install -e .[dev]

- name: generate autodoc
run: python3 auto_doc.py
run: python3 ./python/auto_doc.py

- name: Cache local Maven repository
uses: actions/cache@v2
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-${{ hashFiles('java/pom.xml') }}
restore-keys: |
${{ runner.os }}-maven-
- name: Set up JDK 8
uses: actions/setup-java@v3
with:
java-version: "8"
distribution: "adopt"

- name: Build java doc documentation
working-directory: ./java
run: mvn clean install javadoc:javadoc javadoc:aggregate -DskipTests && cp -r target/site/apidocs ../docs/javadoc

- name: setup git
run: |
Expand Down
22 changes: 20 additions & 2 deletions .github/workflows/mkdocs-release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ name: mkdocs-release

on:
push:
branches: [branch-*\.*]
branches: [branch-*]

jobs:
publish-release:
Expand All @@ -29,7 +29,25 @@ jobs:
run: cp ../README.md . && pip3 install -r ../requirements-docs.txt && pip3 install -e .[dev]

- name: generate autodoc
run: python3 auto_doc.py
run: python3 ./python/auto_doc.py

- name: Cache local Maven repository
uses: actions/cache@v2
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-${{ hashFiles('java/pom.xml') }}
restore-keys: |
${{ runner.os }}-maven-
- name: Set up JDK 8
uses: actions/setup-java@v3
with:
java-version: "8"
distribution: "adopt"

- name: Build java doc documentation
working-directory: ./java
run:
mvn clean install javadoc:javadoc javadoc:aggregate -DskipTests && cp -r target/site/apidocs ../docs/javadoc

- name: setup git
run: |
Expand Down
49 changes: 0 additions & 49 deletions .github/workflows/python-lint.yml

This file was deleted.

Loading
Loading