Ontology processing enhancement proposals

[syphax-bouazzouni]

Issue

Our main problems currently are the following:

• We don't have any UI visual feedback, telling us the processing state of an ontology (email notifications are the only actual way that has the users to tell if their resource had parsed well or not)
• We can't monitor the ontologies processing issues (the only way that we have currently is to go to see the logs)
• Don't work (or hardly) for large files
• The process steps can be more isolated into small steps (e.g process_rdf=generate_rdf + append_to_triple_store + extract metadata + labels + mappings + ...)
• Our queue system is too simple (a Redis first in the first out queue), and can be (maybe) enhanced by using background processing tools like Sideqik or multithreading

The Goal

Having to process any type of file, and having a visual follow-up on the state evolution

Changes todo

to specify later

[syphax-bouazzouni]

Replace by #641