Skip to content

Commit

Permalink
Setup AggregationFuzzer against Presto in experimental jobs.
Browse files Browse the repository at this point in the history
  • Loading branch information
kgpai committed Jan 9, 2024
1 parent fd920aa commit 4caaa24
Show file tree
Hide file tree
Showing 5 changed files with 14 additions and 4 deletions.
5 changes: 5 additions & 0 deletions .github/workflows/experimental.yml
Original file line number Diff line number Diff line change
Expand Up @@ -115,6 +115,10 @@ jobs:
with:
name: aggregation

- name: "Start Presto Java"
- run: |
- /opt/start-prestojava.sh
- name: "Run Aggregate Fuzzer"
run: |
mkdir -p /tmp/aggregate_fuzzer_repro/
Expand All @@ -128,6 +132,7 @@ jobs:
--minloglevel=0 \
--repro_persist_path=/tmp/aggregate_fuzzer_repro \
--enable_sorted_aggregations=true \
----presto_url=http://127.0.0.1:8080 \
&& echo -e "\n\nAggregation fuzzer run finished successfully."
- name: Archive aggregate production artifacts
if: always()
Expand Down
4 changes: 4 additions & 0 deletions scripts/etc/hive.properties
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
connector.name=hive-hadoop2
hive.metastore=file
hive.metastore.catalog.dir=file:/opt/presto-server/etc/data
hive.allow-drop-table=true
5 changes: 3 additions & 2 deletions scripts/etc/node.properties
Original file line number Diff line number Diff line change
@@ -1,2 +1,3 @@
node.environment=test
node.data-dir=/var/lib/presto/data
node.environment=production
node.id=ffffffff-ffff-ffff-ffff-ffffffffffff
node.data-dir=/tmp/presto/data
3 changes: 2 additions & 1 deletion scripts/prestojava-container.dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -36,12 +36,13 @@ RUN dnf install -y java-11-openjdk less procps python3 \
&& ln -s /opt/presto-cli /usr/local/bin/ \
&& mkdir -p $PRESTO_HOME/etc \
&& mkdir -p $PRESTO_HOME/etc/catalog \
&& mkdir -p /var/lib/presto/data \
&& mkdir -p $PRESTO_HOME/etc/data \
&& mkdir -p /usr/lib/presto/utils

COPY scripts/etc/config.properties.example $PRESTO_HOME/etc/config.properties
COPY scripts/etc/jvm.config.example $PRESTO_HOME/etc/jvm.config
COPY scripts/etc/node.properties $PRESTO_HOME/etc/node.properties
COPY scripts/etc/hive.properties $PRESTO_HOME/etc/catalog
COPY scripts/start-prestojava.sh /opt

WORKDIR /velox
1 change: 0 additions & 1 deletion scripts/start-prestojava.sh
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,5 @@
# limitations under the License.

set -e
echo "node.id=$HOSTNAME" >> $PRESTO_HOME/etc/node.properties

$PRESTO_HOME/bin/launcher run

0 comments on commit 4caaa24

Please sign in to comment.