1. Halo Guest, pastikan Anda selalu menaati peraturan forum sebelum mengirimkan post atau thread baru.

web crawl error

Discussion in 'SEO' started by arif_cr7, Nov 24, 2008.

  1. arif_cr7

    arif_cr7 Newbie

    Joined:
    Oct 24, 2008
    Messages:
    12
    Likes Received:
    0
    Location:
    banjarmasin
    gimana ya ngebetulin web crawl yang error pada google webmaster
    punya saya yang error URLs restricted by robot.txt dan url not found apakah berpengaruh pada google dan blog saya
    please:nangis:
     
  2. kangkenyot

    kangkenyot Super Hero

    Joined:
    Nov 2, 2006
    Messages:
    1,925
    Likes Received:
    132
    Location:
    gak jau dari puser wanita cantik
    ya dibikin gak restricted di robot.txt (kalo mau)

    ya pengaruh dong.. jadi spamming google dengan url sampah.
    pake fasilitas remove url lagh di webmaster tool
     
  3. arif_cr7

    arif_cr7 Newbie

    Joined:
    Oct 24, 2008
    Messages:
    12
    Likes Received:
    0
    Location:
    banjarmasin
    iya saya mau :gembira: tapi gimana caranya please :nangis:
    udah cari dimana2 ga' ketemu cara ngebetulinnya
     
  4. kangkenyot

    kangkenyot Super Hero

    Joined:
    Nov 2, 2006
    Messages:
    1,925
    Likes Received:
    132
    Location:
    gak jau dari puser wanita cantik
    lagh nyarinya kok kemana2...
    ya tinggal buka n edit aja itu file robot.txt di root directory..
     
  5. arif_cr7

    arif_cr7 Newbie

    Joined:
    Oct 24, 2008
    Messages:
    12
    Likes Received:
    0
    Location:
    banjarmasin
  6. arif_cr7

    arif_cr7 Newbie

    Joined:
    Oct 24, 2008
    Messages:
    12
    Likes Received:
    0
    Location:
    banjarmasin
    apa itu root directory dan
    saya memakai blogspot
     
  7. scarface

    scarface Super Hero

    Joined:
    Nov 13, 2007
    Messages:
    6,274
    Likes Received:
    3,008
    Location:
    garut gito loh
    blogspot ga usah diedit robots.txtnya biarin aja..jangan terpaku ke webmaster tool.cari aja traffic yang tinggi
     
  8. arif_cr7

    arif_cr7 Newbie

    Joined:
    Oct 24, 2008
    Messages:
    12
    Likes Received:
    0
    Location:
    banjarmasin
    :swt: pantesan, eh tapi klo web crawl error restricted by robot.txt gimana cara ngebetulinnya di blogspot :hmm:
     
  9. scarface

    scarface Super Hero

    Joined:
    Nov 13, 2007
    Messages:
    6,274
    Likes Received:
    3,008
    Location:
    garut gito loh
    jangan utak-atik robots.txt nya kalo ga tahu..webmaster tool doing the best for blogspot..update aja link building dll
     
  10. kangkenyot

    kangkenyot Super Hero

    Joined:
    Nov 2, 2006
    Messages:
    1,925
    Likes Received:
    132
    Location:
    gak jau dari puser wanita cantik

    iya bener.. ini paling aman sambil dirimu belajar2 lagih.... :lol:

    soale kalo jelasin step by step ya panjang juga ceritanya... :silau:
     
  11. arif_cr7

    arif_cr7 Newbie

    Joined:
    Oct 24, 2008
    Messages:
    12
    Likes Received:
    0
    Location:
    banjarmasin
    makasih ya atas semuanya, :silau:
     
  12. budianta

    budianta Ads.id Fan

    Joined:
    Nov 3, 2008
    Messages:
    114
    Likes Received:
    2
    Location:
    jakarta
    pada ngomongin apa sih???:pusing::pusing::pusing:

    ga ngerti gw:pusing::pusing::pusing:

    gw msh pemula nih:hmm::hmm::hmm:

    bwt gw yg penting konten n trafik, yg laen bodo amat.hehehe:swt::swt:
     
  13. ANGGI

    ANGGI Newbie

    Joined:
    Jan 23, 2011
    Messages:
    17
    Likes Received:
    0
    oh, JD Gtu yah. ku jg pernah ngaLAMIN robot.txt sm url not foun. trus d remove beres dah
     
  14. bayyanmc

    bayyanmc Newbie

    Joined:
    May 13, 2011
    Messages:
    15
    Likes Received:
    0
    Kalo 404 not found jawaban dari google nggak usah di hapus nanti akan hilang sendiri, berikut saduran dari Google.com saya copas bahasa inggrisnya karena kemarin copas bahasa indonesianya di salahin he he

    When NOT to use the URL removal tool

    The URL removal tool is intended for pages that urgently need to be removed—for example, if they contain confidential data that was accidentally exposed. Using the tool for other purposes may cause problems for your site.

    Don’t use the URL tool to get rid of pages in these circumstances:

    To clean up cruft, like old pages that 404. The tool is intended for URLs that urgently need to be removed, such as confidential data that was accidentally exposed. If you recently made changes to your site and now have some outdated URLs in the index, Google's crawlers will see this as we recrawl your URLs, and those pages will naturally drop out of our search results over time. There's no need to request an urgent removal through this tool.

    To remove crawl errors from your Webmaster Tools account. The removal tool removes URLs from Google's search results, not from your Webmaster Tools account. There's currently no way for you to manually remove URLs from this report; they will drop out naturally over time as we stop crawling URLs that repeatedly 404.

    To "start from scratch" with your site. If you're worried that your site may have a penalty, or you want to start with a clean slate after purchasing a domain from someone else, we don't recommend trying to use the URL removal tool to remove your entire site and then start afresh. Search engines gather a lot of information from other sites (such as who links to you, or what words they use to describe your site) and use this to help understand your site. Even if we could remove everything we currently know about your site, a lot of it would come back exactly the same once we'd recrawled all the other sites that help us understand your site and put it in context. If you're worried that your domain has some bad history, we recommend filing a reconsideration request letting us know what you're worried about and what has changed (such as that you've acquired the domain from someone else, or that you've changed certain aspects of your site).

    To take your site "offline" after being hacked. If your site was hacked and you want to get rid of bad URLs that got indexed, you can use the URL removal tool to remove any new URLs that the hacker created—for example, http://www.example.com/buy-cheap-cialis-skq3w598.html. But we don't recommend removing your entire site, or removing URLs that you'll eventually want indexed. Instead, clean up the hacking and let us recrawl your site so that we can reindex the new, cleaned-up content as soon as possible. More information about dealing with a hacked site.

    To get the right "version" of your site indexed. When a request to remove https://www.example.com/tattoo.html is accepted, http://www.example.com/tattoo.html is also removed. The same is true of the www and non-www versions of your URL or site. This is because the same content is often available at each of these URLs and we realize that most webmasters and searchers don't want these duplicates appearing in search results. In short, don’t use the URL removal tool as a canonicalization tool. It won't keep your favorite version of a page, it'll remove all versions (http/https and www/non-www) of a URL. Learn about our recommended methods of canonicalization. www.home-dezign.com
     

Share This Page