Sprint review 28 July

[matentzn]

• Feature 1: New dump pipeline
  • New opportunity for preprocessing!
  • As now there is a new step, it would be good to do some count queries in between pdb1 and pdb2, at least for some essential things like neuron count. @dosumis
• Feature 2: VFB SOLR loader
  • Review prefix code of the SOLR JSON creator (@matentzn search for #discuss in Python code)
  • Go through prefix ticket here
  • I would like individual tickets for any additional features such as xrefs etc
• Feature 3: OWLERY should load just logic
  • The dumps pipeline now drops a barebones owl version of the entire triplestore with only logical axioms (ROBOT filter).
  • http://owl.p2.virtualflybrain.org/kbs/vfb (its about 1 third larger than the current version (1.1M axioms, rather than 780K), which is probably due to external ontologies. I also have not run reduce yet - this is the vanilla set of all logical axioms.
• Other:
  • All docker images now migrated from matentzn to VFB organisation on dockerhub.
  • The neo4jconfig now has a purl (http://virtualflybrain.org/config/neo4j2owl-config.yaml), which redirects to some github location (configured here, so that moving it around is easier (issue). (@Robbie1977 you may want to change IMPORT_CONFIG to that purl in case you have set it in Rancher (vfb-pipeline-update-prod))
  • Current hours: 80, so 70 left. I suggest to leave at least 30 hours for bug fixing later this year, so this means we have, on the current contract, 40 hours left - not a lot. We should consider:
    1. Documentation needs, if any?
    2. At least half of these hours should be spent after a full deployment of the entire stack happened - this will reveal missing features (not bugs, which is covered by the 30).

[matentzn]

• reverse value order on map (issue)
• owlery reduce (issue)
• Materialise the OWL types also for SOLR -> factes_annotation (added to the KB ones)
• Add ENV for skipping output filter (issue)
• SOLR doc bug (too few entries)
• Post reasoning - entity types and classification (issue)
• owlery OWL should be reasoner-checked as well (OWLERY: Load barebones logic owlery-vfb#8)
• 5 hours documentation - overview document in markdown with links to the components

[matentzn]

Board updated.