0.6.0

GrimoireLab 0.6.0

The following list describes the changes by component:

graal 0.4.0 - (2022-09-27)

Others:

• Update flake8 dependencies
  Update flake8 dependency to ^4.0.1 to be similar to other Grimoirelab
  repositories.

0.5.0-rc.1

GrimoireLab 0.5.0-rc.1

The following list describes the changes by component:

kidash 0.5.1-rc.7 - (2022-09-26)

Others:

• Update Poetry dependencies
  Update package dependencies for the new release.

sortinghat 0.7.21-rc.6 - (2022-09-26)

Others:

• Update package dependencies
  Update jinja2 package and dev-dependencies.

cereslib 0.3.2-rc.4 - (2022-09-26)

Others:

• Update package dependencies
  Update numpy version to be the same as in sortinghat

perceval 0.20.0-rc.15 - (2022-09-26)

New features:

• [phabricator] Skip a list of items by id
  Perceval will not fetch the items set with the --blacklist-ids
  argument. In the following example, perceval will skip the items
  with ids 123 and 456: perceval phabricator <PHAB_URL> -t <API_TOKEN> --blacklist-ids 123 456

grimoire-elk 0.103.0-rc.10 - (2022-09-26)

New features:

• git-branches study skip uncloned repo
  The git-branches study skips the repository when it is not cloned and
  continues with the next one.
• Configurable study aliases
  Before this fix, the name of the study aliases was hard coded. From
  now on, these values can be configured by passing them as parameters.
• Entry points to support enriching plugin mechanism
  This plugin mechanism allows ELK to use third-party enriching
  backends. Developers only need to include the next snippet in their
  package configuration and ELK will import them as any other core
  backend. entry_points={"grimoire_elk": "mybackend = package.subpackage:get_connectors"}, NOTE: In the previous
  example, get_connectors is a function that returns the backend
  classes needed to enrich a datasource. Take the next snipped as an
  example: def get_connectors(): return {"backend": [MyBackend, MyBackendOcean, MyBackendEnrich, MyBackendCommand]}

Bug fixes:

• [raw/slack] Handle fields in "data.file"
  Avoid the 'Failed to insert data to ES' error when a document contains
  at least one immense term in 'data.file' (whose UTF8 encoding is
  longer than the max length 32766).

sirmordred 0.4.0-rc.1 - (2022-09-26)

New features:

• Configurable study names and aliases
  Study aliases and names can be set in the configuration file using the
  keyword studies_aliases. The following snippet shows an example of
  configuration. i.e. In this aliases.json file the name of the study
  is enrich_onion and the name of the alias is all_onion ```
  "studies_aliases": { "enrich": [ { "alias":
  "all_onion", "name": "enrich_onion" }, ... ] }

Bug fixes:

• [git] pair-programming activation fixed
  Git pair-programming can be activated if the data source contains a
  tag like [git:pair]
• Study selection fixed
  This fix solves the problem of executing the studies with no
  associated aliases.

0.5.0

GrimoireLab 0.5.0

The following list describes the changes by component:

kidash 0.5.1 - (2022-09-26)

Others:

• Update Poetry dependencies
  Update package dependencies for the new release.

sortinghat 0.7.21 - (2022-09-26)

Others:

• Update package dependencies
  Update jinja2 package and dev-dependencies.

cereslib 0.3.2 - (2022-09-26)

Others:

• Update package dependencies
  Update numpy version to be the same as in sortinghat

perceval 0.20.0 - (2022-09-26)

New features:

• [phabricator] Skip a list of items by id
  Perceval will not fetch the items set with the --blacklist-ids
  argument. In the following example, perceval will skip the items
  with ids 123 and 456: perceval phabricator <PHAB_URL> -t <API_TOKEN> --blacklist-ids 123 456

grimoire-elk 0.103.0 - (2022-09-26)

New features:

• git-branches study skip uncloned repo
  The git-branches study skips the repository when it is not cloned and
  continues with the next one.
• Configurable study aliases
  Before this fix, the name of the study aliases was hard coded. From
  now on, these values can be configured by passing them as parameters.
• Entry points to support enriching plugin mechanism
  This plugin mechanism allows ELK to use third-party enriching
  backends. Developers only need to include the next snippet in their
  package configuration and ELK will import them as any other core
  backend. entry_points={"grimoire_elk": "mybackend = package.subpackage:get_connectors"}, NOTE: In the previous
  example, get_connectors is a function that returns the backend
  classes needed to enrich a datasource. Take the next snipped as an
  example: def get_connectors(): return {"backend": [MyBackend, MyBackendOcean, MyBackendEnrich, MyBackendCommand]}

Bug fixes:

• [raw/slack] Handle fields in "data.file"
  Avoid the 'Failed to insert data to ES' error when a document contains
  at least one immense term in 'data.file' (whose UTF8 encoding is
  longer than the max length 32766).

sirmordred 0.4.0 - (2022-09-26)

New features:

• Configurable study names and aliases
  Study aliases and names can be set in the configuration file using the
  keyword studies_aliases. The following snippet shows an example of
  configuration. i.e. In this aliases.json file the name of the study
  is enrich_onion and the name of the alias is all_onion ```
  "studies_aliases": { "enrich": [ { "alias":
  "all_onion", "name": "enrich_onion" }, ... ] }

Bug fixes:

• [git] pair-programming activation fixed
  Git pair-programming can be activated if the data source contains a
  tag like [git:pair]
• Study selection fixed
  This fix solves the problem of executing the studies with no
  associated aliases.

0.4.0

GrimoireLab 0.4.0 - (2022-06-29)

New components:

• grimoirelab-toolkit 0.3.1
• perceval 0.19.1
• perceval-mozilla 0.3.1
• perceval-puppet 0.2.1
• perceval-opnfv 0.2.1
• perceval-weblate 0.2.1
• kingarthur 0.3.1
• graal 0.3.1
• elk 0.102.0
• sirmordred 0.3.1

Perceval

New features:

• [confluence] Option max_contents to limit the number of requested contents
  This parameter sets the maximum number of contents requested per
  query. By default, this number is 200, but this can be changed by
  adding the --max-contents argument. This will help to bypass those
  instances where the maximum limit is lower than Perceval's default
  value.

Bug fixes:

• [confluence] KeyError exception when arguments not passed to 'fetch_items'
  Required arguments that weren't passed to 'fetch_items' made the code
  fail with a KeyError exception.
• [bugzillarest] Failback when checking custom instances
  Some Bugzilla instances return a HTTP 400 error when checking if their
  are custom instances or not. On those cases, the backend will capture
  the error and consider the version of that Bugzilla instance as
  custom.
• [slack] Slack identifier extraction fixed
  Extract the identifier without user information when the user was
  deleted.

GrimoireELK

Bug fixes:

• Poetry build version updated
  The current version of the poetry builder was old and caused some
  problems when installing packages in developer mode. With this new
  version, it's possible to install ELK in developer or editable mode
  without using setuptools files (i.e. setup.cfg and setup.py).

0.3.0

GrimoireLab 0.3.0 - (2022-06-07)

Feature removals:

• Drop Python 3.6 support
  Python 3.6 has reached the end of life in Dec 2021. This means it
  won't receive any further patches to fix the secutiry issues. So,
  dropping the support of 3.6 and it now supports Python>=3.7 version
  only.

New components:

• grimoirelab-toolkit 0.3.0
• perceval 0.18.0
• perceval-mozilla 0.3.0
• perceval-opnfv 0.2.0
• perceval-puppet 0.2.0
• perceval-weblate 0.2.0
• graal 0.3.0
• kingarthur 0.2.0
• sortinghat 0.7.20
• cereslib 0.3.0
• grimoire-elk 0.101.1
• sigils 0.1.0
• sirmordred 0.3.0
• kidash 0.5.0

The following list describes the changes by component:

Perceval

New features:

• [bugzillarest] API Key authentication
  A new authentication is available in the bugzillarest backend using
  an API Key. This can be provided using the parameter --api-key on
  the command line. Note that this parameter will invalidate --backend- user --backend-password, and --api-token parameters. For
  developers, this parameter is also available during the initialization
  of the class BugzillaRESTClient under the name api_key.
• Confluence supports fetch by spaces
  This allows fetching confluence by specific spaces. By default it will
  fetch the entire instance, but adding the --spaces argument will
  fetch only these spaces.

Graal

Bug fixes:

• Fix error in update worktree
  Graal wasn't working with the latest version of Git 2.35.1 because it
  protects braches checked out in all worktrees. This change renames the
  branch created when creating a worktree to fix the issue.

Sorting Hat

Bug fixes:

• [gitdm] Skip invalid format lines
  Gitdm parser won't fail reading files with an invalid format. Instead,
  it will ignore invalid content.

GrimoireELK

New features:

• Anonymize parameters
  A new API function anonymize_params(params) allows to anonymize a
  list of parameters that developers might consider secrets. It will
  only take effect for those parameters which their names are defined on
  SECRET_PARAMETERS constant.
• Dependencies file for development
  Include a new requirements.txt file to install the development version
  from the repositories.
• Support to add identities to SortingHat from Enrich class
  New methods add_identities and add_identity are available on
  Enrich class to add new identities to a SortingHat database.
  Libraries using elk won't need to use sortinghat library to store
  new identities while enriching items.
• Collect and enrich confluence by spaces
  Users can collect and enrich Confluence data from specific spaces
  only, adding the option --spaces=[SPACE1, SPACE2, ...] to their
  projects.json. The following example shows how to collect and to
  enrich data from only the DEV and SUPP spaces only. { "project": { "confluence": [ "http://example.com --spaces=[DEV, SUPP]" ] } }
• Add demographic study to mattermost
  Add the demographic study to the mattermost data source.

Bug fixes:

• Skip sources with wrong arguments
  Sources won't interrupt collection or enrichment processes when any of
  their arguments are invalid. Instead, they will be skipped.
• Git fix 'is_git_commit_multi_author'
  This fixes the is_git_commit_multi_author field when the commit has
  more than one author and pair-programming is enabled. This is
  important for calculating pair_programming_* values.
• SortingHat as a required package
  SortingHat is required for running grimoireelk but it was set as an
  extra dependency. From now on sortinghat is always installed with
  grimoireelk.
• Confluence credentials not stored in raw indexes
  Credentials for Confluence datasource were stored in raw indices as
  part of the URL. For now on, credentials that are part of URLs are
  removed before any data is stored.
• Pair programming regular expression improvement
  The regular expression to detect pair programming authors in git
  datasource has been improved adding more connectors. The following
  list shows the current connectors: - [aA][nN][dD] - & - +
• Fix fetching authors with min and max dates
  The old query only returns 10000 items due to ElasticSearch and
  OpenSearch now use composite aggregation to paginate all buckets.

Sir Mordred

New features:

• Add extract spaces
  Extract spaces from the URL. By default it will extract labels but
  adding tag_type="spaces" it will extract spaces.

Bug fixes:

• Studies aliases relocated
  Relocate studies aliases so they are not created automatically by
  Mordred.
• Add pair-programming in '_get_enrich_backend' method
  Add the pair-programming to the _get_enrich_backend method if it
  exists in the setup.cfg file.

Feature removals:

• FINOS Meeting backend removed
  FINOS Meeting backend is not supported anymore. The Perceval backend
  was archived in Bitergia repository so it shouldn't be part of the
  core anymore because it's software not maintained.

Others:

• Add studies to the alias file
  Add onion, areas of code, and demographics studies to the file
  aliases.json. This is needed to keep this file updated with the
  aliases we use in the dashboards by adding them to the appropiate data
  sources. The included aliases: - all_onion - git_areas_of_code -
  demographics