Skip to content

Redirect seventeen guessed Learn URLs that crawlers keep requesting #3175

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ktsaou merged 2 commits into from
Nov 3, 2026
Merged

Redirect seventeen guessed Learn URLs that crawlers keep requesting #3175

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
dc3c884
Redirect seventeen guessed Learn URLs that crawlers keep requesting
ktsaou Nov 1, 2026
62951f5
Send the collectors guesses to the collector catalog
ktsaou Nov 1, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
72 changes: 72 additions & 0 deletions netlify.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1346,6 +1346,78 @@
from="/docs/netdata-cloud/netdata-plans-&-billing"
to="/docs/netdata-cloud/netdata-plans-&-billing"

# Guessed addresses (2026-11-01): AI assistants and their crawlers keep requesting these paths,
# which never existed or no longer do, hundreds of times a month. Each goes to the page that
# covers the subject; guesses without one clear subject are left to the 404 page.

[[redirects]]
from="/docs/netdata-ai/machine-learning-and-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-ai/machine-learning-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-agent/machine-learning-and-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-agent/machine-learning-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-agent/ml-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-agent/ml"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-ai/anomaly-advisor"
to="/docs/netdata-ai/troubleshooting/anomaly-advisor"

[[redirects]]
from="/docs/netdata-agent/configuration/optimize-the-netdata-agents-performance"
to="/docs/netdata-agent/configuration/performance-optimization"

[[redirects]]
from="/docs/netdata-agent/configuration/running-the-agent-behind-a-reverse-proxy"
to="/docs/netdata-agent/configuration/securing-agents/running-the-agent-behind-a-reverse-proxy"

[[redirects]]
from="/docs/netdata-agent/observability-centralization-points"
to="/docs/netdata-parents"

[[redirects]]
from="/docs/netdata-agent/streaming"
to="/docs/netdata-parents"

[[redirects]]
from="/docs/netdata-agent/daemons"
to="/docs/netdata-agent/daemon"

[[redirects]]
from="/docs/collectors"
to="/docs/collecting-metrics/collectors"

[[redirects]]
from="/docs/netdata-agent/collectors"
to="/docs/collecting-metrics/collectors"

[[redirects]]
from="/docs/collecting-metrics/system-metrics/system-statistics"
to="/docs/collecting-metrics/collectors/operating-systems/system-statistics"

[[redirects]]
from="/docs/alerts-&-notifications/configure-health-alerts"
to="/docs/alerts-&-notifications/alert-configuration-reference"

# Corrected generated redirects (2026-10-07): these dead pages went to an unrelated or generic page
# although a page with their content, a native page for the same product, or the page that now
# covers their subject exists. Each rule overrides the generated rule with the same source; a few
Expand Down
72 changes: 72 additions & 0 deletions static.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1345,6 +1345,78 @@
from="/docs/netdata-cloud/netdata-plans-&-billing"
to="/docs/netdata-cloud/netdata-plans-&-billing"

# Guessed addresses (2026-11-01): AI assistants and their crawlers keep requesting these paths,
# which never existed or no longer do, hundreds of times a month. Each goes to the page that
# covers the subject; guesses without one clear subject are left to the 404 page.

[[redirects]]
from="/docs/netdata-ai/machine-learning-and-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-ai/machine-learning-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-agent/machine-learning-and-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-agent/machine-learning-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-agent/ml-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-agent/ml"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-anomaly-detection"
to="/docs/netdata-ai/anomaly-detection"

[[redirects]]
from="/docs/netdata-ai/anomaly-advisor"
to="/docs/netdata-ai/troubleshooting/anomaly-advisor"

[[redirects]]
from="/docs/netdata-agent/configuration/optimize-the-netdata-agents-performance"
to="/docs/netdata-agent/configuration/performance-optimization"

[[redirects]]
from="/docs/netdata-agent/configuration/running-the-agent-behind-a-reverse-proxy"
to="/docs/netdata-agent/configuration/securing-agents/running-the-agent-behind-a-reverse-proxy"

[[redirects]]
from="/docs/netdata-agent/observability-centralization-points"
to="/docs/netdata-parents"

[[redirects]]
from="/docs/netdata-agent/streaming"
to="/docs/netdata-parents"

[[redirects]]
from="/docs/netdata-agent/daemons"
to="/docs/netdata-agent/daemon"

[[redirects]]
from="/docs/collectors"
to="/docs/collecting-metrics/collectors"

[[redirects]]
from="/docs/netdata-agent/collectors"
to="/docs/collecting-metrics/collectors"

[[redirects]]
from="/docs/collecting-metrics/system-metrics/system-statistics"
to="/docs/collecting-metrics/collectors/operating-systems/system-statistics"

[[redirects]]
from="/docs/alerts-&-notifications/configure-health-alerts"
to="/docs/alerts-&-notifications/alert-configuration-reference"

# Corrected generated redirects (2026-10-07): these dead pages went to an unrelated or generic page
# although a page with their content, a native page for the same product, or the page that now
# covers their subject exists. Each rule overrides the generated rule with the same source; a few
Expand Down
Loading