Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Local Webpage Upload Functionality for Authenticated and Restricted Content #785

Open
1 task done
longzanxi opened this issue Dec 29, 2024 · 1 comment
Open
1 task done

Comments

@longzanxi
Copy link

Describe the feature you'd like

I would like to request the addition of a feature that allows users to upload locally saved webpages to Hoarder, including content that is not publicly accessible on the internet. This functionality would enable users to archive webpages that require authentication (e.g., Twitter, Rabbit, or forums) or have restricted access, ensuring that the saved content is an exact replica of what the user sees in their browser. This feature would be particularly useful for archiving posts, threads, or pages that are only visible after logging in or have specific permissions.

Describe the benefits this would bring to existing Hoarder users

  1. Access to Restricted Content: Users can archive content that is not publicly accessible, such as private tweets, forum posts, or subscription-based articles.
  2. Bypass Authentication Barriers: By saving webpages locally after logging in, users can avoid the need to configure tokens or cookies for server-side scraping.
  3. Preserve User-Specific Views: The saved webpages will reflect the exact content visible to the user, including personalized or dynamically loaded elements.
  4. Enhanced Archiving Capabilities: This feature expands Hoarder's utility for archiving content from platforms like Twitter, Rabbit, and other forums where authentication is required.
  5. Improved Compatibility with Browser Tools: Users can leverage browser-based tools (e.g., AI translators, ad blockers) during the archiving process, ensuring a seamless experience.

Can the goal of this request already be achieved via other means?

No. While users can manually save webpages and upload them to a server, this process is not integrated into Hoarder's workflow and lacks the convenience and automation that this feature would provide.

Have you searched for an existing open/closed issue?

  • I have searched for existing issues and none cover my fundamental request

Additional context

This feature would complement Hoarder's existing capabilities, making it a more versatile and user-friendly archiving tool. It aligns with the project's goal of simplifying web archiving while leveraging modern browser technologies. For inspiration, you can refer to the functionality provided by Ray-D-Song/web-archive, which allows users to save and upload webpages directly from their browsers. This feature would be particularly beneficial for archiving content from platforms like Twitter, Rabbit, and forums, where authentication or permissions are required to access specific content.

@MohamedBassem
Copy link
Collaborator

Thanks for the detailed feature request. We're planning to support this natively in the extension itself in (#172). If it's implemented in the extension, would you still want to manually upload archives?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants