Skip to content
This repository has been archived by the owner on Dec 4, 2024. It is now read-only.

[DCOS-58437] Deploy workloads under role-enforced group. #550

Open
wants to merge 37 commits into
base: master
Choose a base branch
from

Conversation

mpereira
Copy link
Contributor

@mpereira mpereira commented Oct 7, 2019

What changes were proposed in this pull request?

Resolves DCOS-58437

How were these changes tested?

They will be tested in this week's Dry-Run MWT #21.

@mpereira mpereira changed the title [DCOS-58437] Add required roles and permissions required for group role enforcement. [DCOS-58437] Deploy workloads under role-enforced group. Oct 7, 2019
@mpereira mpereira force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 1d8575d to 510676e Compare October 7, 2019 18:59
Copy link
Contributor

@samvantran samvantran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for taking care of this @mpereira!

scale-tests/batch_test.py Outdated Show resolved Hide resolved
scale-tests/deploy-dispatchers.py Show resolved Hide resolved
scale-tests/kafka_cassandra_streaming_test.py Show resolved Hide resolved
scale-tests/run.sh Show resolved Hide resolved
scale-tests/scale_tests_utils.py Show resolved Hide resolved
spark-testing/spark_utils.py Outdated Show resolved Hide resolved
@mpereira mpereira force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 955ff8d to f4a0d7d Compare October 10, 2019 13:11
@mpereira mpereira force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 33907e2 to d7235ac Compare October 10, 2019 17:36
@mpereira
Copy link
Contributor Author

@samvantran there were a bunch of additional changes/improvements required for a smooth test today, please take a look at commits after your last review if you get a chance.

Copy link
Contributor

@samvantran samvantran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @mpereira - new changes look good.

scale-tests/deploy_dsengine.sh Outdated Show resolved Hide resolved
scale-tests/deploy_dsengine.sh Show resolved Hide resolved
@alexeygorobets alexeygorobets force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 440cd25 to 9f4b3cb Compare October 11, 2019 10:42
@mpereira
Copy link
Contributor Author

This PR changed sdk_security.py in a way that might be causing some tests to fail: TC builds

Need to take a look into that...

@samvantran
Copy link
Contributor

Looking at the 6 tests that fail towards the end of the CI run, it appears that hdfs does not deploy successfully (or at all: 10 expected tasks and not even 1 task up). Like you said, could be related to security/service-account changes.

@@ -31,6 +31,7 @@
--quota-executors-gpus <n> number of GPUs to use for executors quota [default: 0]
--quota-executors-mem <n> amount of memory (mb) to use per executors quota [default: 1524.0]
--role <role> Mesos role registered by dispatcher [default: *]
--group-role <group-role> TODO: description [default: None]
Copy link
Contributor

@alexeygorobets alexeygorobets Dec 3, 2019

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe we should provide a description here
root-level group to apply quotas against (e.g. '/dev') [default: None] ?

@rishabh96b rishabh96b force-pushed the dcos-58437-deploy-workloads-under-role-enforced-group branch from 38bbbd2 to 275da0f Compare April 15, 2020 11:21
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants