1. Halo Guest, pastikan Anda selalu menaati peraturan forum sebelum mengirimkan post atau thread baru.

Untuk bikin AGC atau grabing cara manakah yg jadi favoritmu?

Discussion in 'Pemrograman Web' started by mp3online, Dec 7, 2012.

  1. mp3online

    mp3online Super Hero

    Joined:
    Jul 19, 2011
    Messages:
    2,228
    Likes Received:
    294
    Location:
    jakarta
    pokoknya diobok2 cari yg paling gampang n ringan ya boss hehe
     
  2. pujileksono

    pujileksono Ads.id Fan

    Joined:
    May 10, 2011
    Messages:
    186
    Likes Received:
    54
    Location:
    Rembang
    baru tau kalo ada fungsi snoopy , selama ini biasa pakai curl dan simple-html-dom...
     
  3. mp3online

    mp3online Super Hero

    Joined:
    Jul 19, 2011
    Messages:
    2,228
    Likes Received:
    294
    Location:
    jakarta
    snoopy udah lama ada boss, udah bertahun2 :)
    kalau cuma mau ambil linknya doang paling gampang pake snoopy, pake fungsi snoopy fetchlink otomatis yg ditangkap cuma link2nya.
    kalau cuma ambil textnya doang pake fungsi snoopy fetchtext
     
  4. go.dre.am

    go.dre.am Ads.id Pro

    Joined:
    Jun 4, 2011
    Messages:
    376
    Likes Received:
    61
    Location:
    www.tetuku.com
    sayangnya snoopy gak bs dipake login ke forum ya gan?
     
  5. nekaters

    nekaters Hero

    Joined:
    Aug 12, 2012
    Messages:
    673
    Likes Received:
    31
    Location:
    Yogyakarta
    idem sama mastah ini.
    pertama cari developer resminya dulu kalo ada, kalo ga ada baru pikirin ambil paksa kontennya kalo dirasa emang perlu.
    kalo gak perlu2 amat ya gak usah diambil, kasian yg punya konten :lol:
     
  6. zalorot

    zalorot Super Hero

    Joined:
    Aug 6, 2009
    Messages:
    826
    Likes Received:
    11
    memento .... sering coba nya curl ...... ......... :D
     
  7. mp3online

    mp3online Super Hero

    Joined:
    Jul 19, 2011
    Messages:
    2,228
    Likes Received:
    294
    Location:
    jakarta
    kata siapa boss? kan bisa pake yg fungsi snoopy submit kalau login methodnya post.
    cuma snoopy gak nyimpen cookies ke file kayak curl yg disimpen ke cookiejar.
    snoopy kl mau nyimpen cookies ke file hrs kita bikinin fungsi fwrite dan fgetnya.
    tp kalau tau cookie login forumnya, bisa dipasang langsung ke skrip grabbernya seperti cara set user agen :)
     
  8. mrlemonade

    mrlemonade Hero

    Joined:
    Sep 20, 2007
    Messages:
    548
    Likes Received:
    55
    gue mau share class scraping (php) yg rule based. mungkin kali aja berguna.

    bisa parsing by regex atau DOMpath by rules yg kita bikin sendiri.
    contohnya cara makenya ada di github :)

    Code:
    https://github.com/sphinxid/lemonScrap
    
     
    idiotcode and zalorot like this.
  9. gudel

    gudel Ads.id Pro

    Joined:
    Dec 13, 2012
    Messages:
    269
    Likes Received:
    24
    Aku test pake WAMP sample (ls-kompas.com.php) nya kok blank ya? :)
     
  10. mrlemonade

    mrlemonade Hero

    Joined:
    Sep 20, 2007
    Messages:
    548
    Likes Received:
    55
    coba di update file nya tadi ada sedikti bugfix di class utama nya.
    udah gue test sendiri ngga blank datanya (mungkin kalau nanti ada yg blank kemungkinan ada perubahan pada html tag di kompas atau php plugin punya lo ga lengkap)

    [​IMG]
     
  11. gudel

    gudel Ads.id Pro

    Joined:
    Dec 13, 2012
    Messages:
    269
    Likes Received:
    24
    Mgk jg krn WAMP q msh standar. Ntar aku cek lg
     
  12. gudel

    gudel Ads.id Pro

    Joined:
    Dec 13, 2012
    Messages:
    269
    Likes Received:
    24
    @mrlemonade
    Dah aku test bisa. Scriptnya ini apa bs d pake ngegrab situs file sharing ya??
    Klo buat rss feed aq biasa pake magpie rss yg base nya pke snoopy. :D
     
  13. missyswan

    missyswan Super Hero

    Joined:
    Jun 3, 2010
    Messages:
    1,211
    Likes Received:
    100
    gan ane make file_get_content kok error terus ya buat ambil bing.. padahal di coba localhost sukses mulus
     
  14. nekaters

    nekaters Hero

    Joined:
    Aug 12, 2012
    Messages:
    673
    Likes Received:
    31
    Location:
    Yogyakarta
    mungkin di disable kali gan ama penyedia hostingnya. trs penulisannya file_get_contents pake S, kalo report errornya aktif kan ada keterangan errornya kek gmn kan? :senyum:
     
  15. gold1994

    gold1994 Newbie

    Joined:
    Jan 21, 2013
    Messages:
    27
    Likes Received:
    1
    g ngerti nihhhh
     
  16. mp3online

    mp3online Super Hero

    Joined:
    Jul 19, 2011
    Messages:
    2,228
    Likes Received:
    294
    Location:
    jakarta
    @khayerz livelinknya matiin boss.
    member lama masa gak tau peraturan forum sih
     
  17. masyayan

    masyayan Ads.id Fan

    Joined:
    Jan 25, 2012
    Messages:
    125
    Likes Received:
    1
    Location:
    jakarta
    ane pake curl.,yang lain kagak tau soalnya,.,
     

Share This Page