1. Halo Guest, pastikan Anda selalu menaati peraturan forum sebelum mengirimkan post atau thread baru.

Robots.txt buat wordpress

Discussion in 'Wordpress' started by ewwink, Nov 21, 2008.

Page 1 of 4
  1. ewwink

    ewwink Super Hero

    Joined:
    Apr 27, 2006
    Messages:
    2,836
    Likes Received:
    1,100
    Location:
    Tasikmalaya, Sunda, Indonesia
    Robots.txt adalah sebuah file text yang berisi perintah2 yg menginstruksikan robot-robot search engine apakah suatu URL sebuah domain bisa dijelajahi dan di index atau tidak kedalam servernya dan ini Robots.txt versi ane....
    Code:
    # this is the robots.txt for domainku.com
# sitemaps domain kamu:
Sitemap: http://domainku.com/sitemap.xml.gz

User-agent: *
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-content/
Disallow: /wp-includes/
Disallow: /wp-login.php
    Disallow diatas artinya URL/Directory pada domain tsb tidak boleh dijelajahi atau di index oleh search engine.
     
    Last edited: Jun 1, 2011
    ewwink, Nov 21, 2008
    #1
    nono1, arvinrakha, DollarsHunter$$$ and 4 others like this.
  2. scarface

    scarface Super Hero

    Joined:
    Nov 13, 2007
    Messages:
    6,274
    Likes Received:
    3,008
    Location:
    garut gito loh
    nih versi saya..

    HTML:
    # This rule means it applies to all user-agents
User-agent:  *
 
# Disallow all directories and files within
Disallow: /cgi-bin/
Disallow: /stats/
#Disallow: /tag/
Disallow: /wp-admin/
Disallow: /wp-includes/
  
# The Googlebot is the main search bot for google
User-agent: Googlebot
 
# Disallow all files ending with these extensions
Disallow: /*.php$
Disallow: /*.js$
Disallow: /*.inc$
Disallow: /*.css$
Disallow: /*.gz$
Disallow: /*.wmv$
Disallow: /*.tar$
Disallow: /*.tgz$
Disallow: /*.cgi$
Disallow: /*.xhtml$
 
# Disallow Google from parsing indididual post feeds and trackbacks..
Disallow: */feed/
Disallow: */trackback/
Allow: /feed/
 
# Disallow all files with ? in url
Disallow: /*?*
Disallow: /*?
 
# The Googlebot-Image is the image bot for google
User-agent: Googlebot-Image
 
# Allow Everything
Allow: /*
 
# This is the ad bot for google
User-agent: Mediapartners-Google*
 
# Allow Everything
Allow: /*

# This is the ad bot for google
User-agent: Mediapartners-Google*
 
# Allow Everything
Allow: /*# BEGIN XML-SITEMAP-PLUGIN
Sitemap: http://www.domainmu.com/sitemap.xml.gz
# END XML-SITEMAP-PLUGIN
     
    scarface, Nov 21, 2008
    #2
    lulus_sd, arvinrakha, hernawanjr and 8 others like this.
  3. jangkrikjr

    jangkrikjr Super Hero

    Joined:
    Oct 11, 2008
    Messages:
    1,411
    Likes Received:
    147
    Location:
    Kalteng
    trus cara make nya gimana bang ?
     
    jangkrikjr, Nov 22, 2008
    #3
  4. scarface

    scarface Super Hero

    Joined:
    Nov 13, 2007
    Messages:
    6,274
    Likes Received:
    3,008
    Location:
    garut gito loh
    bisa dibaca Disini bro cara kerjanya
     
    scarface, Nov 22, 2008
    #4
  5. ewwink

    ewwink Super Hero

    Joined:
    Apr 27, 2006
    Messages:
    2,836
    Likes Received:
    1,100
    Location:
    Tasikmalaya, Sunda, Indonesia
    bikin file baru namanya robots.txt lalu isi dengan kata2 di atas terus apload dech di root direktory atau supaya bisa diakses di http://domainku/robots.txt
     
    ewwink, Nov 22, 2008
    #5
    $ixpenc3 likes this.
  6. hioFatoni

    hioFatoni Ads.id Fan

    Joined:
    Sep 11, 2008
    Messages:
    115
    Likes Received:
    0
    naahh..ini dya nih yg dicari2..
    thanks para master :tepuktangan:
     
    hioFatoni, Nov 23, 2008
    #6
  7. sibejo

    sibejo Newbie

    Joined:
    Aug 21, 2009
    Messages:
    17
    Likes Received:
    0
    Tengkew .. Tengkew ...:gembira: :gembira:
     
    sibejo, Aug 28, 2009
    #7
  8. gandensang

    gandensang Super Hero

    Joined:
    Aug 4, 2009
    Messages:
    3,680
    Likes Received:
    899
    Location:
    Tulungagung, Indonesia
    Walau belum ngerti,kayaknya nanti puenting banget ni tread
     
    gandensang, Aug 28, 2009
    #8
  9. iman patrick

    iman patrick Super Hero

    Joined:
    May 19, 2009
    Messages:
    1,469
    Likes Received:
    141
    Location:
    jakarta
    maksudanya apa sih:swt:

    saya ga ngerty:nangis:
     
    iman patrick, Aug 28, 2009
    #9
  10. mawarkuning

    mawarkuning Super Hero

    Joined:
    Aug 29, 2007
    Messages:
    1,503
    Likes Received:
    110
    kebanyakan disallow malah muncul Restricted by robots.txt di webmaster banyak apalagi tag nya
     
    mawarkuning, Aug 28, 2009
    #10
    deanvaldis likes this.
  11. umama

    umama Newbie

    Joined:
    Aug 23, 2009
    Messages:
    12
    Likes Received:
    0
    ini fungsinya untuk apa yach..:senyum:
     
    umama, Aug 29, 2009
    #11
  12. frontman82

    frontman82 Hero

    Joined:
    Jul 23, 2009
    Messages:
    515
    Likes Received:
    18
    Location:
    Jogja
    nanya ni boss...
    misalnya kita mau plugin kita, misal plugin autoblog, ga di-crawl sama bot gimana robots.txt-nya...
    apakah
    Disallow:/wp-content/plugin/plugin-yang-dimaksud
    atau gimana nih...
    mohon pencerahan....
     
    frontman82, Sep 11, 2009
    #12
  13. rayray

    rayray Newbie

    Joined:
    Sep 12, 2009
    Messages:
    18
    Likes Received:
    2
    kereeeen
     
    rayray, Sep 12, 2009
    #13
  14. blackshinobi

    blackshinobi Newbie

    Joined:
    Nov 20, 2009
    Messages:
    39
    Likes Received:
    0
    sumpah demi allaoh teu ngarti, leneng
     
    blackshinobi, Dec 25, 2009
    #14
  15. rivanx

    rivanx Super Hero

    Joined:
    Nov 5, 2009
    Messages:
    858
    Likes Received:
    40
    Location:
    di jogjakarta
    iya setuju ko disallow tuh malah entr ga muncul gmna???:lol:
     
    rivanx, Dec 25, 2009
    #15
  16. scarface

    scarface Super Hero

    Joined:
    Nov 13, 2007
    Messages:
    6,274
    Likes Received:
    3,008
    Location:
    garut gito loh
    Makanya ane disallow yang ga perlu aja :senyum::senyum:
     
    scarface, Dec 25, 2009
    #16
  17. yopimilano

    yopimilano Hero

    Joined:
    Jun 30, 2008
    Messages:
    743
    Likes Received:
    10
    Location:
    Bandung
    cik atuh jelaskeun para master... newbie yeuh..:nangis:
     
    yopimilano, Dec 25, 2009
    #17
  18. scarface

    scarface Super Hero

    Joined:
    Nov 13, 2007
    Messages:
    6,274
    Likes Received:
    3,008
    Location:
    garut gito loh
    nu pasti namah kitu weh pi
     
    scarface, Dec 25, 2009
    #18
  19. ewwink

    ewwink Super Hero

    Joined:
    Apr 27, 2006
    Messages:
    2,836
    Likes Received:
    1,100
    Location:
    Tasikmalaya, Sunda, Indonesia
    ya tah pokonamah baruled mun teu pasagi :D:swt:
     
    ewwink, Dec 26, 2009
    #19
  20. $ixpenc3

    $ixpenc3 Super Hero

    Joined:
    Oct 6, 2009
    Messages:
    2,019
    Likes Received:
    185
    Location:
    Sukabumi
    wah emang begini harusnya..
    para master bagi ilmu..

    lanjutkan !!
     
    $ixpenc3, Dec 26, 2009
    #20
Page 1 of 4

Share This Page