Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Parts are getting missed out after using extract funtion #430

Open
alroythalus opened this issue Oct 12, 2023 · 1 comment
Open

Parts are getting missed out after using extract funtion #430

alroythalus opened this issue Oct 12, 2023 · 1 comment
Labels
enhancement New feature or request

Comments

@alroythalus
Copy link

alroythalus commented Oct 12, 2023

This is how i am using trafilatura (1.6.2)

    web_content = "".join(
            extract(
                original_html,
                include_formatting=True,
                include_tables=True,
                include_comments=False,
                include_links=False,
                output_format="xml",
                favor_recall=True,
            )
        )  # type: ignore

It is skipping the entire section marked in red and few others from this URL https://www.privo.com/privacy-information-for-kids

https://www.privo.com/privacy-information-for-kids#hs_cos_wrapper_module_1616710927811207
Screenshot (725)

@adbar adbar added the enhancement New feature or request label Oct 12, 2023
@adbar
Copy link
Owner

adbar commented Oct 12, 2023

This is not only about the section you mention, there are a number a problems with deeply nested tags on this page.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants