Skip to content
This repository has been archived by the owner on May 26, 2023. It is now read-only.

transport cmd foundation #43

Merged
merged 24 commits into from
Dec 1, 2021
Merged

transport cmd foundation #43

merged 24 commits into from
Dec 1, 2021

Conversation

jschicktanz
Copy link
Contributor

What this PR does / why we need it:
first PR in a series of PRs for the implementation of the CTT functionality.

Contains:

  • interfaces for resource processors and processing pipelines (multiple chained processors)
  • implementation of a processing pipeline
  • classes for communicating with extension executables via stdin/stdout and unix domain sockets

Which issue(s) this PR fixes:
Fixes #

Special notes for your reviewer:

Release note:

@jschicktanz jschicktanz requested a review from a team as a code owner September 14, 2021 15:12
@gardener-robot gardener-robot added needs/review Needs review size/l Size of pull request is large (see gardener-robot robot/bots/size.py) needs/second-opinion Needs second review by someone else labels Sep 14, 2021
@gardener-robot-ci-3 gardener-robot-ci-3 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) needs/ok-to-test Needs approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Sep 14, 2021
pkg/transport/process/extension/stdio_executable.go Outdated Show resolved Hide resolved
pkg/transport/process/extension/stdio_executable.go Outdated Show resolved Hide resolved
pkg/transport/process/extension/stdio_executable.go Outdated Show resolved Hide resolved
pkg/transport/process/extension/stdio_executable.go Outdated Show resolved Hide resolved
pkg/transport/process/extension/uds_executable.go Outdated Show resolved Hide resolved
pkg/transport/process/util.go Outdated Show resolved Hide resolved
pkg/transport/process/util.go Outdated Show resolved Hide resolved
pkg/transport/process/util.go Outdated Show resolved Hide resolved
pkg/transport/process/pipeline.go Outdated Show resolved Hide resolved
pkg/transport/process/pipeline.go Show resolved Hide resolved
@gardener-robot gardener-robot added the needs/changes Needs (more) changes label Sep 15, 2021
@gardener-robot-ci-3 gardener-robot-ci-3 added the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Sep 16, 2021
@gardener-robot-ci-2 gardener-robot-ci-2 removed the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Sep 16, 2021
@gardener-robot-ci-2 gardener-robot-ci-2 added the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Sep 16, 2021
@gardener-robot-ci-1 gardener-robot-ci-1 removed the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Sep 16, 2021
@gardener-robot
Copy link
Contributor

@enrico-kaack-comp You have pull request review open invite, please check

@gardener-robot gardener-robot added size/xl Size of pull request is huge (see gardener-robot robot/bots/size.py) and removed size/l Size of pull request is large (see gardener-robot robot/bots/size.py) labels Sep 20, 2021
@gardener-robot-ci-1 gardener-robot-ci-1 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Sep 20, 2021
@gardener-robot-ci-1 gardener-robot-ci-1 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Sep 20, 2021
@gardener-robot-ci-1 gardener-robot-ci-1 added the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Nov 3, 2021
@gardener-robot-ci-3 gardener-robot-ci-3 removed the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Nov 3, 2021
@gardener-robot-ci-2 gardener-robot-ci-2 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Nov 3, 2021
@gardener-robot-ci-2 gardener-robot-ci-2 added the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Nov 3, 2021
@gardener-robot-ci-3 gardener-robot-ci-3 removed the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Nov 3, 2021
@gardener-robot-ci-3 gardener-robot-ci-3 added the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Nov 3, 2021
@gardener-robot-ci-2 gardener-robot-ci-2 removed the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Nov 3, 2021
@jschicktanz jschicktanz changed the title transport cmd 0 transport cmd foundation Nov 3, 2021
pkg/transport/process/extensions/extensions_suite_test.go Outdated Show resolved Hide resolved
pkg/transport/process/extensions/uds_executable.go Outdated Show resolved Hide resolved
pkg/transport/process/extensions/uds_executable.go Outdated Show resolved Hide resolved
pkg/transport/process/pipeline.go Outdated Show resolved Hide resolved
func processorRoutine(inputStream io.Reader, outputStream io.WriteCloser) error {
defer outputStream.Close()

tmpfile, err := ioutil.TempFile("", "")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would interest me too

pkg/transport/process/processors/example/main.go Outdated Show resolved Hide resolved
pkg/transport/process/utils/processor_message.go Outdated Show resolved Hide resolved
pkg/transport/process/utils/processor_message.go Outdated Show resolved Hide resolved
pkg/transport/process/utils/uds_server.go Outdated Show resolved Hide resolved
return errors.New("archiveWriter must not be nil")
}

tempfile, err := ioutil.TempFile("", "")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

explain that you use the tempFile for size calculation

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if you write a file to a tar archive, you must know the size upfront (gets written into the preceding file header)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i mean a comment that the tempfile only exists for that reason

@gardener-robot-ci-1 gardener-robot-ci-1 added the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Nov 29, 2021
@gardener-robot-ci-3 gardener-robot-ci-3 removed the reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) label Nov 29, 2021
@gardener-robot-ci-3 gardener-robot-ci-3 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Nov 29, 2021
@gardener-robot-ci-2 gardener-robot-ci-2 added reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) and removed reviewed/ok-to-test Has approval for testing (check PR in detail before setting this label because PR is run on CI/CD) labels Nov 30, 2021
Copy link
Contributor

@enrico-kaack-comp enrico-kaack-comp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jschicktanz jschicktanz dismissed schrodit’s stale review December 1, 2021 14:48

tim's no longer active in the project

@jschicktanz jschicktanz merged commit bae35c6 into main Dec 1, 2021
@jschicktanz jschicktanz deleted the transport-cmd-0 branch December 1, 2021 14:51
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
needs/changes Needs (more) changes needs/ok-to-test Needs approval for testing (check PR in detail before setting this label because PR is run on CI/CD) needs/review Needs review needs/second-opinion Needs second review by someone else size/xl Size of pull request is huge (see gardener-robot robot/bots/size.py)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants