Ada kalanya Anda perlu menghapus URL dari Google index – konten sensitif, halaman duplikat, atau konten yang tidak ingin diindeks. Berikut cara melakukannya.
Kapan Perlu Remove URL
Alasan Valid
1. Konten sensitif/pribadi
2. Halaman tidak lagi relevan
3. Duplicate content
4. Test/staging pages
5. Outdated information
6. Legal/compliance issues
7. Thin content pages
8. Old URLs after migration
Kapan TIDAK Remove
Jangan remove jika:
- Halaman masih valuable
- Redirecting (301 cukup)
- Temporary removal
- Want to "reset" rankings
Removal = permanent dari index.
Metode Removal
Method 1: Google Search Console
Fastest method (temporary):
- Login GSC
- Removals → New Request
- Enter URL
- Choose "Remove this URL only"
atau "Remove all URLs with prefix"
- Submit
Duration: ~6 bulan temporary.
GSC Removal Types
Options:
1. Remove URL temporarily
- 6 bulan dari index
- Must take permanent action
- Clear cached copy
- Removes cached version
- Fresh crawl next time
- Remove outdated content
- For content already gone
- Via removals.google.com
Method 2: Noindex Meta Tag
<meta name="robots" content="noindex" />
Or specific:
<meta name="googlebot" content="noindex" />
Permanent solution. Google will de-index over time.
Method 3: X-Robots-Tag Header
Server header:
X-Robots-Tag: noindex
For non-HTML files:
- PDFs
- Images
- Videos
Apache .htaccess
<Files "file.pdf">
Header set X-Robots-Tag "noindex"
</Files>
Nginx
location /file.pdf {
add_header X-Robots-Tag "noindex";
}
Method 4: Delete Page + 404/410
Delete page:
- Returns 404 Not Found
- Or 410 Gone (faster)
Google eventually removes.
404 = might return
410 = definitely gone
Method 5: Password Protection
Require login:
- Google can't access
- Returns 401/403
- De-indexed over time
Method 6: Robots.txt Disallow
robots.txt:
Disallow: /private-page/
WARNING:
- Prevents crawling
- NOT immediate removal
- URL can still be indexed
- Use noindex instead
Step-by-Step Removal
Permanent Removal Process
Step 1: Add noindex to page
<meta name="robots" content="noindex">
Step 2: Submit temporary removal in GSC
(For immediate effect)
Step 3: Wait for Google to crawl
Check GSC Coverage
Step 4: Verify removal
site:yoursite.com/page
Done when page not found.
For Deleted Content
If page already deleted:
- Go to:
https://search.google.com/search-console/removals
- Or:
https://www.google.com/webmasters/tools/removals
- Enter outdated URL
- Submit
For pages you don't own:
https://support.google.com/websearch/troubleshooter/3111061
Bulk Removal
Multiple URLs
GSC method:
- Use "Remove all URLs with this prefix"
- Example: /old-section/ removes all under it
Or submit multiple single requests.
Pattern Removal
For pattern matching:
1. Add noindex to all pages via code
2. Submit directory prefix in GSC
3. Wait for de-indexing
Checking Removal Status
Verify in GSC
GSC → Removals:
- Request history
- Status (processing/approved/denied)
- Expiration date
Search Check
In Google:
site:example.com/page-url
If not found = removed.
If found = still indexed.
URL Inspection Tool
GSC → URL Inspection:
- Enter URL
- Check "On Google?" status
- See crawl details
Robots.txt Misunderstanding
Common Mistake
Disallow ≠ Removal
Disallow: /page/
This:
- Blocks crawling
- Does NOT remove from index
- URL can still appear in SERP
(just with less info)
Correct Approach
For removal:
1. Allow crawling
2. Add noindex
3. Let Google see noindex
4. Then optionally disallow
Disallow + noindex together
= Google might not see noindex.
Specific Scenarios
Removing Duplicate Content
Options:
1. 301 redirect to canonical
2. Add rel="canonical"
3. Noindex duplicate
Best: 301 redirect if possible.
Removing Old URLs After Migration
After site migration:
1. 301 redirects in place
2. Submit removal if needed
3. Old URLs will naturally drop
Redirects usually sufficient.
Removing Sensitive Information
Urgent removal:
1. Delete content immediately
2. Submit GSC removal request
3. Submit outdated content removal
4. Monitor search results
For legal issues:
https://support.google.com/legal
Removing Images
For images:
1. Delete image file
2. Return 404/410
3. Remove from sitemap
4. Submit removal if urgent
Or: X-Robots-Tag: noindex
Timeline Expectations
How Long?
GSC temporary removal:
- Usually hours to days
- Maximum 1-2 weeks
Noindex method:
- Depends on crawl frequency
- Days to weeks
404/410:
- Can take weeks to months
- Depends on crawl rate
Speeding Up Process
To expedite:
1. Submit temporary removal (GSC)
2. Implement noindex
3. Request indexing of page (shows noindex)
4. Update sitemap
5. Build links to other pages (redirect crawl budget)
URL Removal Checklist
Preparation:
☐ Confirm URL should be removed
☐ Backup content if needed
☐ Choose removal method
Implementation:
☐ Add noindex (or delete)
☐ Submit GSC removal request
☐ Update internal links
☐ Remove from sitemap
Verification:
☐ Check GSC removal status
☐ Verify with site: search
☐ Monitor for re-indexing
☐ Set calendar reminder
Kesimpulan
Removal URL dari Google index memerlukan kombinasi temporary removal (GSC) dan permanent action (noindex atau delete). Pastikan benar-benar ingin remove sebelum melakukan, karena re-indexing memerlukan waktu.
Ditulis oleh
Hendra Wijaya