Project

General

Profile

Actions
Copy link

Feature #27876

closed

Add project id to robots.txt

Added by Grischa Zengel about 8 years ago. Updated about 7 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Category:
SEO
Target version:
4.0.0
Resolution:
Fixed

Description

Bots found activities by project number and traverse to the whole history:

redmine:443 66.249.76.119 - - [02/Jan/2018:05:42:49 +0000] "GET /redmine/projects/3/activity?from=1979-03-13&show_files=1&user_id=3 HTTP/1.1" 200 8090 "-" "Mozilla/5.0 (compatible; Googlebot/2.1;)"

robots.txt looks like:

User-agent: *
Disallow: /redmine/projects/support/repository
Disallow: /redmine/projects/support/issues
Disallow: /redmine/projects/support/activity
Disallow: /redmine/issues/gantt
Disallow: /redmine/issues/calendar
Disallow: /redmine/activity
Disallow: /redmine/search

Expected:

User-agent: *
Disallow: /redmine/projects/support/repository
Disallow: /redmine/projects/support/issues
Disallow: /redmine/projects/support/activity
Disallow: /redmine/projects/3/repository
Disallow: /redmine/projects/3/issues
Disallow: /redmine/projects/3/activity
Disallow: /redmine/issues/gantt
Disallow: /redmine/issues/calendar
Disallow: /redmine/activity
Disallow: /redmine/search

Files

robot.diff (633 Bytes) robot.diff Toshi MARUYAMA, 2018-01-02 11:02
Actions
Copy link

Also available in: Atom PDF