docs: Update http crawler docs

[belloibrahv]

Description

This PR refactors the HttpCrawler class to ensure conformity with Google's style docstring guidelines. The updates are focused on improving documentation clarity and structure, without altering the functionality of the code.

Key changes include:

• Enhanced the class-level docstring for HttpCrawler to provide a clear overview of its purpose and functionality.
• Added usage examples with correct code snippets to demonstrate how to instantiate and run the HttpCrawler.
• Standardized method docstrings to include detailed descriptions of parameters, return values, and behavior, following Google's style guideline.

Issues

• Closes: Improve API docs of public components #304

Testing

The changes were tested to ensure:

• The revised docstrings are accurate and reflect the current functionality.
• No unintended changes were introduced that would affect the behavior of the HttpCrawler.
• Code examples provided in the docstrings execute correctly and align with the intended usage.

Checklist

• CI passed