From 1c0afb1146faffaf7fcc24ded1b96426c4c0cd92 Mon Sep 17 00:00:00 2001 From: Xiaoying Wang Date: Tue, 8 Oct 2024 13:16:13 -0700 Subject: [PATCH] Update Federation.md --- Federation.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/Federation.md b/Federation.md index 27c1039a8..d80824079 100644 --- a/Federation.md +++ b/Federation.md @@ -1,2 +1,10 @@ # Enabling Query Federation +We use [accio](https://github.com/sfu-db/accio) to rewrite a federated query into multiple single-source ones, and combine the result locally with [datafusion](https://github.com/apache/datafusion). + +To enable query federation for connectorx: +1. Clone accio: `git@github.com:sfu-db/accio.git`. +2. Build accio: `cd accio/rewriter && mvn package -Dmaven.test.skip=true`. +3. Move the jar file to location `${YOUR_LOCAL_PYTHON_PATH}/site-packages/connectorx/dependencies/federated-rewriter.jar` +4. Configure accio and set the configuration path as `FED_CONFIG_PATH`. Example configurations can be found [here](https://github.com/sfu-db/accio/tree/main/benchmark/config/tpch10_datafusion/10gbit). +5. Run federated query using connectorx!