Skip to content

IVS-556 Task pasta refactoring #204

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 20 commits into
base: development
Choose a base branch
from
+989 −1,223
Open

IVS-556 Task pasta refactoring #204

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
e761515
refactor
Ghesselink Jul 21, 2025
1c1b14c
add task configuration
Ghesselink Jul 21, 2025
aa33ef0
tasks configuration
Ghesselink Jul 23, 2025
5e28a51
small DRY improvements
Ghesselink Jul 23, 2025
e5d1ec9
set model status to django model descriptors
Ghesselink Jul 26, 2025
2716657
simplify error handling
Ghesselink Jul 27, 2025
e83cbad
Add documentation for prev_result parallel tasks
Ghesselink Jul 27, 2025
dac01c1
update configs
Ghesselink Jul 27, 2025
e478119
update_progress inside single decorator
Ghesselink Jul 27, 2025
3a8eebe
Move all tasks to separate folder
Ghesselink Jul 27, 2025
7f6f993
use db status rather than prev_result of for blocking tasks
Ghesselink Jul 28, 2025
f46c779
rm internal results, rely on db
Ghesselink Jul 28, 2025
3861e60
configuration improvements
Ghesselink Jul 29, 2025
fa85b85
update ifcopenshell, align tests
Ghesselink Jul 29, 2025
54499a7
trigger tests, rm pdb
Ghesselink Jul 29, 2025
49573db
Merge branch 'development' into IVS-556-task-pasta-refactoring
Ghesselink Jul 29, 2025
645868d
remove lines of code
Ghesselink Jul 29, 2025
4f2c1c0
add separate execution layer
Ghesselink Aug 2, 2025
25489bb
check_program bugfix
Ghesselink Aug 3, 2025
1fa7c38
refactor processing layer, create task context
Ghesselink Aug 4, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/ci_cd.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ jobs:
source venv/bin/activate
# use version of ifcopenshell with desired schema parsing
# TODO: revert to pyPI when schema parsing is published in the future
wget -O /tmp/ifcopenshell_python.zip "https://s3.amazonaws.com/ifcopenshell-builds/ifcopenshell-python-311-v0.8.3-260bc80-linux64.zip"
wget -O /tmp/ifcopenshell_python.zip "https://s3.amazonaws.com/ifcopenshell-builds/ifcopenshell-python-311-v0.8.4-e13ba76-linux64.zip"
mkdir -p venv/lib/python3.11/site-packages
unzip -d venv/lib/python3.11/site-packages /tmp/ifcopenshell_python.zip

Expand Down
8 changes: 4 additions & 4 deletions backend/Makefile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -14,23 +14,23 @@ venv:
install: venv
$(PIP) install --upgrade pip
find . -name 'requirements.txt' -exec $(PIP) install -r {} \;
wget -O /tmp/ifcopenshell_python.zip "https://s3.amazonaws.com/ifcopenshell-builds/ifcopenshell-python-311-v0.8.3-260bc80-linux64.zip"
wget -O /tmp/ifcopenshell_python.zip "https://s3.amazonaws.com/ifcopenshell-builds/ifcopenshell-python-311-v0.8.4-e13ba76-linux64.zip"
mkdir -p $(VIRTUAL_ENV)/lib/python3.11/site-packages
unzip -f -d $(VIRTUAL_ENV)/lib/python3.11/site-packages /tmp/ifcopenshell_python.zip
rm /tmp/ifcopenshell_python.zip

install-macos: venv
find . -name 'requirements.txt' -exec $(PIP) install -r {} \;
$(PIP) install -r requirements.txt
wget -O /tmp/ifcopenshell_python.zip "https://s3.amazonaws.com/ifcopenshell-builds/ifcopenshell-python-311-v0.8.3-260bc80-macos64.zip"
wget -O /tmp/ifcopenshell_python.zip "https://s3.amazonaws.com/ifcopenshell-builds/ifcopenshell-python-311-v0.8.4-e13ba76-macos64.zip"
mkdir -p $(VIRTUAL_ENV)/lib/python3.11/site-packages
unzip /tmp/ifcopenshell_python.zip -d $(VIRTUAL_ENV)/lib/python3.11/site-packages
rm /tmp/ifcopenshell_python.zip

install-macos-m1: venv
find . -name 'requirements.txt' -exec $(PIP) install -r {} \;
$(PIP) install -r requirements.txt
wget -O /tmp/ifcopenshell_python.zip "https://s3.amazonaws.com/ifcopenshell-builds/ifcopenshell-python-311-v0.8.3-260bc80-macosm164.zip"
wget -O /tmp/ifcopenshell_python.zip "https://s3.amazonaws.com/ifcopenshell-builds/ifcopenshell-python-311-v0.8.4-e13ba76-macosm164.zip"
mkdir -p $(VIRTUAL_ENV)/lib/python3.11/site-packages
unzip /tmp/ifcopenshell_python.zip -d $(VIRTUAL_ENV)/lib/python3.11/site-packages
rm /tmp/ifcopenshell_python.zip
Expand Down Expand Up @@ -66,7 +66,7 @@ stop-worker:
-$(PYTHON) -m celery -A core control shutdown \
--destination=worker@$(shell hostname) || true

test: test-models test-bsdd-task test-header-validation-task test-syntax-task test-syntax-header-validation-task test-schema-task
test: test-models test-header-validation-task test-syntax-task test-syntax-header-validation-task test-schema-task

test-models:
MEDIA_ROOT=./apps/ifc_validation/fixtures $(PYTHON) manage.py test apps/ifc_validation_models --settings apps.ifc_validation_models.test_settings --debug-mode --verbosity 3
Expand Down
Loading