Robots.txt buat wordpress

litllemonster · Jun 1, 2011

fungsinya robot.txt ini kyk gmana yah?

ewwink · Jun 1, 2011

litllemonster said: ↑

fungsinya robot.txt ini kyk gmana yah?
Click to expand...

fungsinya lihat lagi post pertama

ivink3aray · Jun 1, 2011

nice info..........

jawanane · Jun 1, 2011

punya ane simple aja kek gini

User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /feed
Disallow: /comments
Disallow: /wp-login.php
Click to expand...

rizkyrezza · Jun 2, 2011

taruh mana robot.txt nya masbero?

aflyingdreamer · Jun 6, 2011

rizkyrezza said: ↑

taruh mana robot.txt nya masbero?
Click to expand...

Pake plugin juga bisa masbrow, biar pragmatis

ryandipranata · Oct 24, 2013

Thanks mod

Al theradz · Oct 27, 2013

Mantap gan sharingya

firdaushuda · Feb 27, 2014

scarface said: ↑

nih versi saya..

HTML:

# This rule means it applies to all user-agents
User-agent:  *
 
# Disallow all directories and files within
Disallow: /cgi-bin/
Disallow: /stats/
#Disallow: /tag/
Disallow: /wp-admin/
Disallow: /wp-includes/
  
# The Googlebot is the main search bot for google
User-agent: Googlebot
 
# Disallow all files ending with these extensions
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /*.gz$
Disallow: /*.wmv$
Disallow: /*.tar$
Disallow: /*.tgz$
Disallow: /*.cgi$
Disallow: /*.xhtml$
 
# Disallow Google from parsing indididual post feeds and trackbacks..
Disallow: */feed/
Disallow: */trackback/
Allow: /feed/
 
# Disallow all files with ? in url
Disallow: /*?*
Disallow: /*?
 
# The Googlebot-Image is the image bot for google
User-agent: Googlebot-Image
 
# Allow Everything
Allow: /*
 
# This is the ad bot for google
User-agent: Mediapartners-Google*
 
# Allow Everything
Allow: /*

# This is the ad bot for google
User-agent: Mediapartners-Google*
 
# Allow Everything
Allow: /*# BEGIN XML-SITEMAP-PLUGIN
Sitemap: http://www.domainmu.com/sitemap.xml.gz
# END XML-SITEMAP-PLUGIN

Click to expand...

makasih mastah. langsung pasang di web dah.