Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Remove explicit bot/crawler "index" or "follow" via meta tags #21

Open
psolbach opened this issue Jun 14, 2022 · 1 comment
Open

Remove explicit bot/crawler "index" or "follow" via meta tags #21

psolbach opened this issue Jun 14, 2022 · 1 comment
Labels
enhancement New feature or request

Comments

@psolbach
Copy link
Member

psolbach commented Jun 14, 2022 •
edited
Loading

We might discard the explicit "index" or "follow" allow meta tags entirely, as crawlers index without these explicitly set anways and the granular rules contained here might lead to issues. The meta tags in questions are set in a template in hugo-modules, but it makes sense to discuss it here.

<meta content="index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1" name="googlebot">
@psolbach psolbach added the enhancement New feature or request label Jun 14, 2022
@tfeldhaus
Copy link

The bots and search engines have a default behavior that is usually very good for the site (search experience) - so I'm for taking out.

For image heavy pages or SEO special requirements I would adjust the tag.

@psolbach psolbach changed the title Remove explicit allowing of "index" or "follow" via meta tags Remove explicit bot/crawler "index" or "follow" via meta tags Jun 14, 2022
@peterschewe peterschewe mentioned this issue Jul 14, 2022
Merged
18 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tfeldhaus @psolbach