Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bump to 24.1 - Single-container setup #607

Merged
merged 24 commits into from
Nov 12, 2024
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
24 commits
Select commit Hold shift + click to select a range
4902410
bump to 24.1
jyotipm29 Oct 30, 2024
c664506
small fixes
jyotipm29 Oct 31, 2024
26d0cca
added tusd role
jyotipm29 Nov 1, 2024
5dae32d
added flower role
jyotipm29 Nov 1, 2024
40e479e
added redis role
jyotipm29 Nov 2, 2024
bf03c59
remove default channel from conda
bgruening Nov 2, 2024
a2784aa
added slurm role and some refactorings
jyotipm29 Nov 2, 2024
86375d4
added condor role
jyotipm29 Nov 3, 2024
6305e34
added proftpd role
jyotipm29 Nov 3, 2024
cb21b29
install conda from conda-forge (miniforge)
jyotipm29 Nov 3, 2024
b5a00cc
added cvmfs provision playbook and removed g++
jyotipm29 Nov 4, 2024
b8bc58c
added rabbitmq role
jyotipm29 Nov 4, 2024
298ee36
moved all tasks (except nginx) from galaxyextras repo
jyotipm29 Nov 5, 2024
afeaf9b
add docker role and enabled role installation via ansible-galaxy
jyotipm29 Nov 5, 2024
62e0b76
added nginx, certbot, self_signed_certs role and removed galaxyextras…
jyotipm29 Nov 7, 2024
83c8499
fix some strange errors only happening for me
bgruening Nov 7, 2024
7ef12e0
added multi-stage build in Dockerfile
jyotipm29 Nov 9, 2024
11dc49f
update dockerfile
jyotipm29 Nov 9, 2024
3b9f9a0
migrate from galaxy-central to "galaxy"
bgruening Nov 9, 2024
d2dc319
Merge pull request #1 from bgruening/change_root_dir
jyotipm29 Nov 9, 2024
4739bb8
migrate remaining galaxy-central, added dive tests, some fixes and op…
jyotipm29 Nov 11, 2024
97c3de6
changed execution order in startup and added test for data persistence
jyotipm29 Nov 11, 2024
a2c7267
fix startup issues
bgruening Nov 12, 2024
93d57b3
update DinD
bgruening Nov 12, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions .github/workflows/lint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,18 +5,18 @@ jobs:
runs-on: ubuntu-latest
steps:
- name: Checkout
uses: actions/checkout@v2
- name: Cleanup to only use compose
run: rm -R docs galaxy test
uses: actions/checkout@v4
# - name: Cleanup to only use compose
# run: rm -R docs galaxy test
- name: Run shellcheck with reviewdog
uses: reviewdog/action-shellcheck@v1.1.3
uses: reviewdog/action-shellcheck@v1.27.0
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
reporter: github-check
level: warning
pattern: "*.sh"
- name: Run hadolint with reviewdog
uses: reviewdog/action-hadolint@v1.16.0
uses: reviewdog/action-hadolint@v1.46.0
with:
github_token: ${{ secrets.GITHUB_TOKEN }}
reporter: github-check
9 changes: 5 additions & 4 deletions .github/workflows/single.sh
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ docker info

# start building this repo
git submodule update --init --recursive
git submodule update --remote --rebase
jyotipm29 marked this conversation as resolved.
Show resolved Hide resolved
sudo chown 1450 /tmp && sudo chmod a=rwx /tmp

## define a container size check function, first parameter is the container name, second the max allowed size in MB
Expand Down Expand Up @@ -50,8 +51,8 @@ docker run -d -p 8080:80 -p 8021:21 -p 8022:22 \
--privileged=true \
-v "$(pwd)/local_folder:/export/" \
-e GALAXY_CONFIG_ALLOW_USER_DATASET_PURGE=True \
-e GALAXY_CONFIG_ALLOW_LIBRARY_PATH_PASTE=True \
-e GALAXY_CONFIG_ENABLE_USER_DELETION=True \
-e GALAXY_CONFIG_ALLOW_PATH_PASTE=True \
-e GALAXY_CONFIG_ALLOW_USER_DELETION=True \
-e GALAXY_CONFIG_ENABLE_BETA_WORKFLOW_MODULES=True \
-v /tmp/:/tmp/ \
quay.io/bgruening/galaxy
Expand Down Expand Up @@ -82,7 +83,7 @@ cd "${WORKING_DIR}/test/slurm/" && bash test.sh && cd "$WORKING_DIR"
# - cd $WORKING_DIR/test/gridengine/ && bash test.sh && cd $WORKING_DIR

echo 'Waiting for Galaxy to come up.'
galaxy-wait -g $BIOBLEND_GALAXY_URL --timeout 300
galaxy-wait -g $BIOBLEND_GALAXY_URL --timeout 600

curl -v --fail $BIOBLEND_GALAXY_URL/api/version

Expand Down Expand Up @@ -124,7 +125,7 @@ cd "$WORKING_DIR/test/bioblend/" && . ./test.sh && cd "$WORKING_DIR/"
# then
# # Test without install-repository wrapper
# sleep 10
# docker_exec_run bash -c 'cd $GALAXY_ROOT && python ./scripts/api/install_tool_shed_repositories.py --api admin -l http://localhost:80 --url https://toolshed.g2.bx.psu.edu -o devteam --name cut_columns --panel-section-name BEDTools'
# docker_exec_run bash -c 'cd $GALAXY_ROOT_DIR && python ./scripts/api/install_tool_shed_repositories.py --api admin -l http://localhost:80 --url https://toolshed.g2.bx.psu.edu -o devteam --name cut_columns --panel-section-name BEDTools'
# fi


Expand Down
8 changes: 4 additions & 4 deletions .github/workflows/single_container.yml
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
name: Single Container Test
on: [push]
on: [push, pull_request]
jobs:
build_and_test:
runs-on: ubuntu-latest
strategy:
matrix:
python-version: [3.7]
python-version: ['3.10']
steps:
- name: Checkout
uses: actions/checkout@v2
- uses: actions/setup-python@v1
uses: actions/checkout@v4
- uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
- name: Build and Test
Expand Down
5 changes: 3 additions & 2 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@
[submodule "galaxy/roles/galaxyproject.galaxyextras"]
path = galaxy/roles/galaxyprojectdotorg.galaxyextras
url = https://github.com/galaxyproject/ansible-galaxy-extras
branch = 20.05
jyotipm29 marked this conversation as resolved.
Show resolved Hide resolved
url = https://github.com/jyotipm29/ansible-galaxy-extras
branch = 24.1

[submodule "galaxy/roles/galaxy-postgresql"]
path = galaxy/roles/galaxy-postgresql
url = https://github.com/galaxyproject/ansible-postgresql
13 changes: 7 additions & 6 deletions .travis.yml
Copy link
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Travis is not used anymore as it seems, at least it is not triggered. Do you have time to move the tests over to github actions?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can do that

Original file line number Diff line number Diff line change
@@ -1,14 +1,14 @@
sudo: required

language: python
python: 3.6
python: 3.10

services:
- docker

env:
matrix:
- TOX_ENV=py36
- TOX_ENV=py310
global:
- secure: "SEjcKJQ0NGXdpFxFhLVlyJmiBvgiLtR5Uufg90Vm3owKlMy0NSfIrOR+2dwNniqOp7QI3eVepnqjid/Ka0QStzVqMCe55OLkJ/TbTHnMLpbtY63mpGfogVRvxMMAVpzLpcQqtJFORZmO/MIWSLlBiXMMzOg3+tbXvQXmL17Rbmw="

Expand Down Expand Up @@ -39,6 +39,7 @@ before_install:

# start building this repo
- git submodule update --init --recursive
- git submodule update --remote --rebase
jyotipm29 marked this conversation as resolved.
Show resolved Hide resolved
- sudo chown 1450 /tmp && sudo chmod a=rwx /tmp
- export WORKING_DIR="$TRAVIS_BUILD_DIR"
- export DOCKER_RUN_CONTAINER="quay.io/bgruening/galaxy"
Expand Down Expand Up @@ -68,8 +69,8 @@ before_install:
--privileged=true \
-v `pwd`/local_folder:/export/ \
-e GALAXY_CONFIG_ALLOW_USER_DATASET_PURGE=True \
-e GALAXY_CONFIG_ALLOW_LIBRARY_PATH_PASTE=True \
-e GALAXY_CONFIG_ENABLE_USER_DELETION=True \
-e GALAXY_CONFIG_ALLOW_PATH_PASTE=True \
-e GALAXY_CONFIG_ALLOW_USER_DELETION=True \
-e GALAXY_CONFIG_ENABLE_BETA_WORKFLOW_MODULES=True \
-v /tmp/:/tmp/ \
quay.io/bgruening/galaxy
Expand Down Expand Up @@ -101,7 +102,7 @@ script:
# - cd $TRAVIS_BUILD_DIR/test/gridengine/ && bash test.sh && cd $WORKING_DIR

- echo 'Waiting for Galaxy to come up.'
- galaxy-wait -g $BIOBLEND_GALAXY_URL --timeout 300
- galaxy-wait -g $BIOBLEND_GALAXY_URL --timeout 600

- curl -v --fail $BIOBLEND_GALAXY_URL/api/version

Expand Down Expand Up @@ -140,7 +141,7 @@ script:
# then
# # Test without install-repository wrapper
# sleep 10
# docker_exec_run bash -c 'cd $GALAXY_ROOT && python ./scripts/api/install_tool_shed_repositories.py --api admin -l http://localhost:80 --url https://toolshed.g2.bx.psu.edu -o devteam --name cut_columns --panel-section-name BEDTools'
# docker_exec_run bash -c 'cd $GALAXY_ROOT_DIR && python ./scripts/api/install_tool_shed_repositories.py --api admin -l http://localhost:80 --url https://toolshed.g2.bx.psu.edu -o devteam --name cut_columns --panel-section-name BEDTools'
# fi


Expand Down
Loading
Loading