RFC: override the indices entrypoint

[nharraud]

Problem:
As soon as one uses Invenio-search all indices registered in the entrypoint will be added to elasticsearch. The problem is that some services don't want the ones provided by default. The only way to override the entrypoint name is by not using invenio-base as it is given directly to the extension.

Who has this problem:

• Zenodo (@lnielsen)
• B2Share

Suggested solution:
Move the entrypoint name to the configuration.

Timeline:
This is not urgent but might be problematic if two mappings conflict (one from invenio and another from the overlay) after an upgrade.

[jirikuncar]

@nharraud which default mappings would you like to remove?

[nharraud]

@jirikuncar In B2Share case, all of them. We only use marc21 for exports, not internally. Especially the "deposits" mapping which prevent us from using the same name.

[nharraud]

Or at least we don't use marc21 internally for now. If we use the authority module later it will make sense to use it then. For other records we will keep our own format.

[jirikuncar]

Can you remove them manually from mappings and aliases (

invenio-search/invenio_search/ext.py

Lines 50 to 51 in e9a23e9

	self.mappings = {}
	self.aliases = {}

) until we find some good solution.

Posible solutions for discussion:

1. Move the entrypoint name to the configuration. (by @nharraud)
2. Don't install package entrypoints but let overlays to add them to their setup.py.
3. Add configurable blacklist.
4. TBD

[nharraud]

Another solution I am using in the mean time is to index directly in the index and not the alias. Then I avoid the elasticsearch error complaining about multiple indices per alias. The search will still work the same way.
This doesn't remove the unused indices and aliases but it makes it a minor issue.

The blacklist issue is that new indices might still pop up when a module is updated.

[jirikuncar]

The blacklist issue is that new indices might still pop up when a module is updated.

--dry-run could help ... (probably not implemented yet)