Skip to content

Commit

Permalink
Refactor setup scripts
Browse files Browse the repository at this point in the history
  • Loading branch information
czentgr committed Aug 5, 2024
1 parent 84428f9 commit 764aae4
Show file tree
Hide file tree
Showing 11 changed files with 454 additions and 475 deletions.
8 changes: 7 additions & 1 deletion .github/workflows/linux-build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,9 @@ on:
- "CMake/**"
- "third_party/**"
- "scripts/setup-ubuntu.sh"
- "scripts/setup-common.sh"
- "scripts/setup-linux.sh"
- "scripts/setup-versions.sh"
- "scripts/setup-helper-functions.sh"
- ".github/workflows/linux-build.yml"

Expand All @@ -36,6 +39,9 @@ on:
- "CMake/**"
- "third_party/**"
- "scripts/setup-ubuntu.sh"
- "scripts/setup-common.sh"
- "scripts/setup-linux.sh"
- "scripts/setup-versions.sh"
- "scripts/setup-helper-functions.sh"
- ".github/workflows/linux-build.yml"

Expand Down Expand Up @@ -171,7 +177,7 @@ jobs:
MAKEFLAGS: "NUM_THREADS=8 MAX_HIGH_MEM_JOBS=4 MAX_LINK_JOBS=4"
EXTRA_CMAKE_FLAGS: "-DVELOX_ENABLE_ARROW=ON"
run: |
make debug
make debug
- name: CCache after
run: |
Expand Down
6 changes: 6 additions & 0 deletions .github/workflows/scheduled.yml
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,9 @@ on:
- "CMake/**"
- "third_party/**"
- "scripts/setup-ubuntu.sh"
- "scripts/setup-common.sh"
- "scripts/setup-linux.sh"
- "scripts/setup-versions.sh"
- "scripts/setup-helper-functions.sh"
- ".github/workflows/scheduled.yml"

Expand All @@ -36,6 +39,9 @@ on:
- "CMake/**"
- "third_party/**"
- "scripts/setup-ubuntu.sh"
- "scripts/setup-common.sh"
- "scripts/setup-linux.sh"
- "scripts/setup-versions.sh"
- "scripts/setup-helper-functions.sh"
- ".github/workflows/scheduled.yml"

Expand Down
5 changes: 3 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -132,11 +132,12 @@ libraries. Once you have checked out Velox, you can setup and build like so:

```shell
$ ./scripts/setup-centos9.sh
$ ./scripts/setup-adapters.sh
$ ./scripts/setup-centos9.sh install_adapters
$ make
```

Note that `setup-adapters.sh` supports MacOS and Ubuntu 20.04 or later.
Note that the `install_adapters` command is available for the supports MacOS and
Ubuntu (20.04 or later) scripts.

### Building Velox

Expand Down
10 changes: 7 additions & 3 deletions scripts/adapters.dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -15,15 +15,19 @@
ARG image=ghcr.io/facebookincubator/velox-dev:centos9
FROM $image

COPY scripts/setup-adapters.sh /
COPY scripts/setup-centos9.sh /
COPY scripts/setup-linux.sh /
COPY scripts/setup-common.sh /
COPY scripts/setup-versions.sh /
COPY scripts/setup-helper-functions.sh /
RUN mkdir build && ( cd build && source /opt/rh/gcc-toolset-12/enable && \
bash /setup-adapters.sh ) && rm -rf build && dnf remove -y conda && dnf clean all
bash /setup-centos9.sh install_adapters ) && rm -rf build && dnf remove -y conda && dnf clean all

# install miniforge
RUN curl -L -o /tmp/miniforge.sh https://github.com/conda-forge/miniforge/releases/download/23.11.0-0/Mambaforge-23.11.0-0-Linux-x86_64.sh && \
bash /tmp/miniforge.sh -b -p /opt/miniforge && \
rm /tmp/miniforge.sh
ENV PATH=/opt/miniforge/condabin:${PATH}
ENV PATH=/opt/miniforge/condabin:${PATH}

# install test dependencies
RUN mamba create -y --name adapters python=3.8
Expand Down
231 changes: 0 additions & 231 deletions scripts/setup-adapters.sh

This file was deleted.

Loading

0 comments on commit 764aae4

Please sign in to comment.