Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Isue with archive for Github web page #444

Closed
juev opened this issue Jun 28, 2022 · 3 comments
Closed

Isue with archive for Github web page #444

juev opened this issue Jun 28, 2022 · 3 comments

Comments

@juev
Copy link

juev commented Jun 28, 2022

Hello,

When I saves Github page to shiori I got unreadable result.

I saved html page for original and archive. Whats wrong?

archive.zip

As I can see, we have duplicate meta character, wrong meta name="optimizely-datafile", many js files was merged to one file.

Why you changed canonical url?

<link rel="canonical" href="https-github.com-milgradesec-ddns" data-pjax-transient=""/>

As I can see this pages have many difference on body. Whats wrong?

@stale
Copy link

stale bot commented Jul 28, 2022

This issue has been automatically marked as stale because it has not had any activity for quite some time.
It will be closed if no further activity occurs.
Thank you for your contributions.

@fmartingr
Copy link
Member

Hey @juev, we currently use warc to archive websites, but there's plans to move to obelisk (#353) which would hopefully fix some archiving issues, I can't say for sure why it's doing what you mention right now (until I hop on that task) but since we're archiving sites some procesing needs to be done and maybe some data treatment breaks some headers.

This is a low priority at the moment until we finish up with #353. And if we don't end up migrating to that we could take a look at that in WARC.

@stale
Copy link

stale bot commented Sep 4, 2022

This issue has been automatically marked as stale because it has not had any activity for quite some time.
It will be closed if no further activity occurs.
Thank you for your contributions.

@stale stale bot added the tag:stale label Sep 4, 2022
@stale stale bot closed this as completed Sep 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants