Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AUT-563: Chaos spark Integration. #52

Draft
wants to merge 40 commits into
base: master
Choose a base branch
from
Draft

AUT-563: Chaos spark Integration. #52

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
40 commits
Select commit Hold shift + click to select a range
4778693
AUT-544-new: Jio like deployement flow.
kritika-saxena-guavus Jul 18, 2019
0a85951
AUT-544-new: temporary changes
kritika-saxena-guavus Jul 24, 2019
4e2cf7d
AUT-544-new: Adding chaostoolkit-reporting package in requirements.txt
kritika-saxena-guavus Jul 26, 2019
00f001b
AUT-544-new: Adding chaos validation code w.r.t jio
kritika-saxena-guavus Aug 1, 2019
5de8c1c
AUT-544-new: Adding chaos validation code w.r.t jio
kritika-saxena-guavus Aug 1, 2019
dcaeacc
AUT-544-new: Adding chaos validation code w.r.t jio
kritika-saxena-guavus Aug 1, 2019
efc4627
AUT-544-new: Jinja templating + modularizing jio job schedule actions…
kritika-saxena-guavus Aug 5, 2019
340486e
AUT-544-new: Working code + incremental tests . Exception handling fo…
kritika-saxena-guavus Aug 7, 2019
6c1b735
AUT-544-new: Added assert on job schedule action.
kritika-saxena-guavus Aug 7, 2019
5989e99
AUT-544-new: assert on chaos experiment.
kritika-saxena-guavus Aug 7, 2019
f3da0a0
Spark-executor kill use case for jio job. (Chaos run breaks at valida…
kritika-saxena-guavus Aug 13, 2019
a0a3477
Added retries and exception handlings in yarn and spark apis being us…
kritika-saxena-guavus Aug 16, 2019
46c929a
Working code.
kritika-saxena-guavus Aug 16, 2019
e1e8ca2
Driver kill code + Logging updation in exec kill action + ms to minu…
kritika-saxena-guavus Aug 19, 2019
a7d3ed0
Grep on app id for driver kill + journal custom path
kritika-saxena-guavus Aug 19, 2019
913017c
handled retryerror on after experiment control + inserted rollbacks e…
kritika-saxena-guavus Aug 19, 2019
4232c5c
Increased spark query timeout to from 90s to 180s and added spark dri…
kritika-saxena-guavus Aug 20, 2019
b840b21
Test functions naming change + made schedule_job a fixture now
kritika-saxena-guavus Aug 21, 2019
8be8438
Update Readme
kritika-saxena-guavus Aug 21, 2019
8581803
Update Readme
kritika-saxena-guavus Aug 21, 2019
1d9f4c0
Readme formatting fixes.
kritika-saxena-guavus Aug 21, 2019
cff9bdb
Readme formatting fixes.
kritika-saxena-guavus Aug 21, 2019
654c090
kubernetes documentation order changed
kritika-saxena-guavus Aug 21, 2019
5fc118c
Spellings corrected.
kritika-saxena-guavus Aug 21, 2019
aee6f0b
test_validation func name changed
kritika-saxena-guavus Aug 21, 2019
e7a5452
Templating with default value + fetching templates from fileserver + …
kritika-saxena-guavus Aug 23, 2019
1890426
Removing space from requirements.txt
kritika-saxena-guavus Aug 23, 2019
6e4a386
adding nimble in requirements.txt
kritika-saxena-guavus Aug 23, 2019
6f2baf1
Restricted nimble version
kritika-saxena-guavus Aug 23, 2019
960cc8f
Restricted nimble version
kritika-saxena-guavus Aug 23, 2019
a302a84
Added exception handling on testbed and component attributes yaml fou…
kritika-saxena-guavus Aug 28, 2019
32bdd0c
Logging correction spark_apps_ha_utils
kritika-saxena-guavus Aug 28, 2019
d29f94b
Updated Readme.md
kritika-saxena-guavus Aug 30, 2019
2d338a0
Updated Readme.md
kritika-saxena-guavus Aug 30, 2019
b1fb302
Updated Readme.md
kritika-saxena-guavus Aug 30, 2019
61c376e
Updated Readme.md
kritika-saxena-guavus Aug 30, 2019
aa2f03d
Updated Readme.md
kritika-saxena-guavus Sep 2, 2019
0effd09
Updated probes and actions in Readme.md
kritika-saxena-guavus Sep 2, 2019
c0ac670
Readme.md
kritika-saxena-guavus Sep 2, 2019
a3a7111
Changes done corresponding to nimble changes. Also release changes in…
kritika-saxena-guavus Oct 17, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
308 changes: 8 additions & 300 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,302 +1,10 @@
# Changelog

## [Unreleased][]

[Unreleased]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.20.0...HEAD

- Try to read proxy from environment variable "HTTP_PROXY" and set it
appropriately if it exists
- Add the `deployment_is_fully_available` probe to wait for a deployment to be fully available [#38][38]
- Fix calls to `delete_namespaced_*` so that the `body` argument is passed
a named argument [#42][42]. A follow up to [#34][34]
- Fix calls to `delete_nodes` so that the `body` argument is passed
a named argument [#44][44].

[38]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/pull/38
[42]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/issues/42
[44]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/pull/44

## [0.20.0][] - 2018-03-25

[0.20.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.19.1...0.20.0

### Added

- Add a probe to check pods conditions [PR#31][31]

[31]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/pull/31

### Changed

- Fix call to `delete_namespaced_pod` so that the `body` argument is passed
a named argument [#34][34]

[34]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/issues/34


## [0.19.1][] - 2018-10-08

[0.19.1]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.18.1...0.19.1

### Changed

- As part of [#21][21], we realized that passing `None` to some parameters of the
Kubernetes client API was not the right move because, in that case, the client
turns that into a `"None"` string which is not what we want. So I had to
resort to many conditionals that make the code not as clean I'd want. Sigh!

[21]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/issues/21

## [0.18.1][] - 2018-10-08

[0.18.1]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.18.0...0.18.1

### Changed

- Fix: use `Succeeded` instead of `Completed` to filter successful pods created by a cronjob in the `all_microservices_healthy` probe.

## [0.18.0][] - 2018-10-08

[0.18.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.17.0...0.18.0

### Added

- [Codecov][codecov] integration
- Renamed `FailedActivity` to `ActivityFailed` as per [chaostoolkit 0.20.0][0.20.0]. See [PR#20][20]
- Add Ability to specify a maximum percentage of pods to be killed [PR#19][19]
- Consider `Completed` pods as healthy in the `all_microservices_healthy` probe. See [PR#23][23]
- Support a new `grace_period_seconds` parameter in the `terminate_pods` action. See [PR#24][24]

[codecov]: https://codecov.io/gh/chaostoolkit/chaostoolkit-kubernetes
[0.20.0]: https://github.com/chaostoolkit/chaostoolkit-lib/blob/master/CHANGELOG.md#0200---2018-08-09
[20]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/pull/20
[19]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/pull/19

## [0.17.0][] - 2018-09-07

[0.17.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.16.2...0.17.0

### Added

- List work nodes

## [0.16.2][] - 2018-05-14

[0.16.2]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.16.1...0.16.2

### Added

- Read version from source file without importing

## [0.16.1][] - 2018-05-14

[0.16.1]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.16.0...0.16.1

### Added

- Added requirements-dev.txt to MANIFEST.in so it gets packaged and distributed

## [0.16.0][] - 2018-04-24

[0.16.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.15.0...0.16.0

### Added

- Allow to pass the Kubernetes context to authenticate from by setting
the `"KUBERNETES_CONTEXT"` key in the environment or the secrets object
[#15][15]

[15]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/issues/15

## [0.15.0][] - 2018-04-13

[0.15.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.14.0...0.15.0

### Added

- a probe to count the number of pods
- actions to delete and create nodes
- actions to cordon, uncordon and drain nodes
- canot locate credentials automatically when ran from within a Pod if
you set the `CHAOSTOOLKIT_IN_POD: "true"` environment variable in the Pod
spec

## [0.14.0][] - 2018-04-05

[0.14.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.13.0...0.14.0

### Added

- allow to create a Kubernetes client from a Kubernetes cluster pod

## [0.13.0][] - 2018-03-09

[0.13.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.12.0...0.13.0

### Added

- `chaosk8s.pod.probes.pods_in_phase` to probe that all pods matching a label
are in a given pod Phase
- `chaosk8s.pod.probes.pods_not_in_phase` to probe that all pods matching a
label are not in a given pod Phase

## [0.12.0][] - 2018-02-12

[0.12.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.11.0...0.12.0

### Changed

- Moved the `chaosk8s.probes.read_microservice_logs` to
`chaosk8s.pod.probes.read_pod_logs` for clarity
- Make name optional for `chaosk8s.pod.probes.read_pod_logs` as it usually
more preferred to use a label for that probe
- Removed the system discovery as it wasn't used by chaostoolkit anyway

## [0.11.0][] - 2018-01-28

[0.11.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.10.0...0.11.0

### Added

- Added a pod specific set of actions

### Changed

- Refactor dev/test dependencies so they are not deployed on install

## [0.10.0][] - 2018-01-22

[0.10.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.9.0...0.10.0

### Changed

- activities now take a `label_selector` argument to let you adjust to your
conventions when selecting resources [#7][7]

[7]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/issues/7

## [0.9.0][] - 2018-01-16

[0.9.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.8.0...0.9.0

### Added

- discovery mechanism

## [0.8.0][] - 2017-12-29

[0.8.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.7.0...0.8.0

### Added

- `read_microservices_logs` probe to fetch pod's logs

## [0.7.0][] - 2017-12-17

[0.7.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.6.0...0.7.0

### Added

- Deployment scaler action

### Changed

- Updated to chaostoolkit-lib 0.8.0

## [0.6.0][] - 2017-12-12

[0.6.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.5.0...0.6.0

### Added

- Logging at DEBUG level for investigation
- Probe `deployment_is_not_fully_available` to wait until a deployment is not
fully available (its desired state is different from its current state)

### Changed

- Selecting on the name Label rather than Service as it's more commonly used
- Updated chaostoolkit-lib to 0.7.0 for configuration support

## [0.5.0][] - 2017-12-06

[0.5.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.4.3...0.5.0

### Changed

- Updated to match chaostoolkit-lib 0.6.0 API changes
- Probes now return `True` on success so they can be nicely used from the
steady state hypothesis checks

## [0.4.3][] - 2017-11-23

[0.4.3]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.4.2...0.4.3

### Changed

- Removing unwanted parameter

## [0.4.2][] - 2017-11-20

[0.4.2]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.4.1...0.4.2

### Changed

- Proper verify SSL reading of the environment key

## [0.4.1][] - 2017-11-20

[0.4.1]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.4.0...0.4.1

### Added

- Passing secrets down to client function


## [0.4.0][] - 2017-11-20

[0.4.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.3.0...0.4.0

### Added

- Can create a client from secrets


## [0.3.0][] - 2017-11-20

[0.3.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.2.0...0.3.0

### Added

- Can now authenticate to the Kubernetes API endpoint either via a token,
username/password or certificate/pkey. All of this via environment variable.
By default, still looks up for ~/kube/config if it exists


## [0.2.0][] - 2017-10-23

[0.2.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.1.1...0.2.0

### Added

- Remove check Kubernetes service by name

### Changed

- Do not build a universal wheel package (no Python 2 support in chaostoolkit)

## [0.1.1][] - 2017-10-06

[0.1.1]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/compare/0.1.0...0.1.1

### Changed

- Package up extra files when installed from source

## [0.1.0][] - 2017-10-06

[0.1.0]: https://github.com/chaostoolkit/chaostoolkit-kubernetes/tree/0.1.0

### Added

- Initial release
## [Unreleased]

## [0.0.1]: 2019-08-23
#### Added
- Support for checking
- Support to killing spark executor for a spark application.
- Support for killing spark driver for a spark application.
- Support for killing spark driver and exectutor for a spark application.
Loading