Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shared tc dir #5

Merged
merged 31 commits into from
Apr 30, 2020
Merged

Shared tc dir #5

merged 31 commits into from
Apr 30, 2020

Conversation

escapewindow
Copy link
Contributor

@escapewindow escapewindow commented Apr 15, 2020

This is an attempt to share taskcluster/ for all xpi source repos. We do need to copy in .taskcluster.yml into the source repo for things to work.

@tomprince how does this look? mozilla-releng/staging-xpi-public#6 is an example of a project using this.

@firefoxci-taskcluster
Copy link

Uh oh! Looks like an error! Details

InterpreterError at template.tasks[0].payload.env[0]["GITHUB_CLONE_SECRET"]: unknown context value githubCloneSecret

2 similar comments
@firefoxci-taskcluster
Copy link

Uh oh! Looks like an error! Details

InterpreterError at template.tasks[0].payload.env[0]["GITHUB_CLONE_SECRET"]: unknown context value githubCloneSecret

@firefoxci-taskcluster
Copy link

Uh oh! Looks like an error! Details

InterpreterError at template.tasks[0].payload.env[0]["GITHUB_CLONE_SECRET"]: unknown context value githubCloneSecret

taskcluster/xpi_taskgraph/parameters.py Outdated Show resolved Hide resolved
taskcluster/ci/config.yml Show resolved Hide resolved
@@ -213,10 +229,14 @@ tasks:
then: >
PIP_IGNORE_INSTALLED=0 pip install --user /builds/worker/checkouts/taskgraph &&
cd /builds/worker/checkouts/src &&
rm -rf taskcluster &&
ln -s /builds/worker/checkouts/template/taskcluster taskcluster &&

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You should not need to do this dance moving around the taskcluster directory. You can pass --root path/to/taskcluster/ci to taskgraph decision to read from a different location (this is how comm-central handles things).

Alternatively, you could run taskgraph from the template repository, with the xpi repository in a known place. (This is closer to what ci-admin/ci-config does, but ci-config isn't even checked out).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like this breaks any automation on xpi-template itself, but perhaps we want to turn that off anyway?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like it breaks for test-xpi-public as well. I'm guessing --root also keeps us from looking in test-xpi-public for the xpi source, and instead looks in xpi-template ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Alternatively, you could run taskgraph from the template repository, with the xpi repository in a known place. (This is closer to what ci-admin/ci-config does, but ci-config isn't even checked out).

I think I was avoiding this, because a) we need to translate paths, and b) xpi-template is level 3; the xpi source repo will be level 1. We could make xpi-template level 1. Is going back to the taskcluster/ dance a blocker?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

busted test-xpi-public: mozilla-releng/staging-xpi-public#6

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#7

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

--root seems to break everything. I'm going to punt on that.

@escapewindow
Copy link
Contributor Author

@tomprince better? I'm punting on --root because that seems to lose the docker-image image_builder stuff from taskgraph, and otherwise breaks this multi-repo setup. Tracked in #7.

@rail I can merge as admin, but we may want a real approving review.

Copy link

@tomprince tomprince left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

(reminder of the bits that need to change on landing)

@@ -0,0 +1 @@
mozilla-mobile

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
mozilla-mobile
mozilla-extensions

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like these two comments are regarding the xpi-manifest repository. I'll open a PR there to address these.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.


FROM ubuntu:18.04

MAINTAINER Tom Prince "[email protected]"

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should probably be updated (or removed, I'm not sure how much value it is providing).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mozilla-extensions/xpi-manifest#32 . (The tip of this PR doesn't have any taskcluster/docker; we use the docker image indexes from xpi-manifest. I tried copying the docker directory as part of trying to resolve the --root bustage.)

@escapewindow
Copy link
Contributor Author

Thanks! I'll merge this and update docs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants