Extracting decimal sections

[petermr]

Goal

To extract explicit number sections (1.2, 1.3.4, etc)

tests

## styles

first must still extract styles

test_extract_normalize_styles_old_chapter_example

## test.test_decimal_chapters_production

code

        TEST_IPCC_WG3 = Path(Resources.HOME, "projects", "semanticClimate", "ipcc", "ar6", "wg3")
        if not TEST_IPCC_WG3.exists():
            print(f"semanticClimate files not available locally")
            return
        html_elem = lxml.etree.parse(str(Path(TEST_IPCC_WG3, "Chapter03", "fulltext.html")))
        xpath = (".//div/span["
                 "contains(@class, 'dec1') "
            "or contains(@class, 'dec2') "
            "or contains(@class, 'dec3') "
            "or contains(@class, 'dec4')]")
        decimal_sections = HtmlTree.get_decimal_sections(html_elem, xpath=xpath)

        hierarchy = Hierachy()
        hierarchy.add_sections(decimal_sections, poplist=["Chapter 3:"])
        hierarchy.sort_sections()

output

root b'<sect id="4"/>\n'
 missing parent section 4.2.5
tree:
 <sect id="4">
  <sect id="4.1"/>
  <sect id="4.2">
    <sect id="4.2.1"/>
    <sect id="4.2.2">
      <sect id="4.2.2.1"/>
      <sect id="4.2.2.2"/>
      <sect id="4.2.2.4"/>
      <sect id="4.2.2.5"/>
      <sect id="4.2.2.6"/>
      <sect id="4.2.2.7"/>
      <sect id="4.2.2.8"/>
    </sect>
    <sect id="4.2.3"/>
    <sect id="4.2.4">
      <sect id="4.2.4.1"/>
      <sect id="4.2.4.2"/>
      <sect id="4.2.4.3"/>
    </sect>
...
  <sect id="4.5"/>
</sect>

sort sections NYI

## test.test_html.TestHtmlTree.test_nest_decimal_sections

** relies on marked up HTML **

    html_elem = lxml.etree.parse(str(Path(Resources.TEST_IPCC_CHAP04, "ipcc_fulltext_styles.html")))
    #  "<span id="id1521" class="s0 dec2">4.1</span>")
    xpath = (".//div/span["
             "contains(@class, 'dec1') "
        "or contains(@class, 'dec2') "
        "or contains(@class, 'dec3') "
        "or contains(@class, 'dec4')]")
    decimal_sections = HtmlTree.get_decimal_sections(html_elem, xpath=xpath)

    hierarchy = Hierachy()
    hierarchy.add_sections(decimal_sections, poplist=["Chapter 4:"])
    hierarchy.sort_sections()

### output