[Langsung ke konten utama](https://developers.google.com/search/docs/crawling-indexing/robots/intro?hl=id#main-content)

[![Google Search Central](https://developers.google.com/static/search/images/google-search-central-logo.svg)](https://developers.google.com/search?hl=id)

*   [Google Search Central](https://developers.google.com/search?hl=id)
    

[Dokumentasi](https://developers.google.com/search/docs?hl=id)

*   Dasar-dasar SEO
*   [Pengantar](https://developers.google.com/search/docs?hl=id)
    
*   [Dasar-Dasar Penelusuran](https://developers.google.com/search/docs/essentials?hl=id)
    
*   [Panduan Memulai SEO](https://developers.google.com/search/docs/fundamentals/seo-starter-guide?hl=id)
    
*   [Cara Kerja Google Penelusuran](https://developers.google.com/search/docs/fundamentals/how-search-works?hl=id)
    
*   [Apakah Anda membutuhkan SEO?](https://developers.google.com/search/docs/fundamentals/do-i-need-seo?hl=id)
    

*   Crawling dan pengindeksan
*   [Peta Situs](https://developers.google.com/search/docs/crawling-indexing/sitemaps/overview?hl=id)
    
*   [robots.txt](https://developers.google.com/search/docs/crawling-indexing/robots/intro?hl=id)
    
*   [Tag meta](https://developers.google.com/search/docs/crawling-indexing/special-tags?hl=id)
    
*   [Pengelolaan crawler](https://developers.google.com/search/docs/crawling-indexing/ask-google-to-recrawl?hl=id)
    
*   [Penghapusan](https://developers.google.com/search/docs/crawling-indexing/control-what-you-share?hl=id)
    
*   [Kanonikalisasi](https://developers.google.com/search/docs/crawling-indexing/consolidate-duplicate-urls?hl=id)
    
*   [Pengalihan](https://developers.google.com/search/docs/crawling-indexing/301-redirects?hl=id)
    
*   [SEO JavaScript](https://developers.google.com/search/docs/crawling-indexing/javascript/javascript-seo-basics?hl=id)
    

*   Peringkat dan tampilan penelusuran
*   [Galeri Elemen Visual](https://developers.google.com/search/docs/appearance/visual-elements-gallery?hl=id)
    
*   [Link judul](https://developers.google.com/search/docs/appearance/title-link?hl=id)
    
*   [Cuplikan](https://developers.google.com/search/docs/appearance/snippet?hl=id)
    
*   [Gambar](https://developers.google.com/search/docs/appearance/google-images?hl=id)
    
*   [Video](https://developers.google.com/search/docs/appearance/video?hl=id)
    
*   [Data terstruktur](https://developers.google.com/search/docs/appearance/structured-data/search-gallery?hl=id)
    
*   [Favicon](https://developers.google.com/search/docs/appearance/favicon-in-search?hl=id)
    

*   Panduan khusus situs
*   [E-commerce](https://developers.google.com/search/docs/specialty/ecommerce?hl=id)
    
*   [Situs internasional dan multibahasa](https://developers.google.com/search/docs/specialty/international?hl=id)
    

*   Analisis data
*   [Mulai menggunakan Search Console](https://developers.google.com/search/docs/monitor-debug/search-console-start?hl=id)
    
*   [Men-debug penurunan traffic](https://developers.google.com/search/docs/monitor-debug/debugging-search-traffic-drops?hl=id)
    
*   [Menggunakan data Search Console dan Google Analytics untuk SEO](https://developers.google.com/search/docs/monitor-debug/google-analytics-search-console?hl=id)
    
*   [Mulai menggunakan Google Trends](https://developers.google.com/search/docs/monitor-debug/trends-start?hl=id)
    

[Dukungan](https://developers.google.com/search/help?hl=id) [Blog](https://developers.google.com/search/blog?hl=id) [Yang baru](https://developers.google.com/search/news?hl=id)

*   [Semua pembaruan](https://developers.google.com/search/news?hl=id)
    
*   [Pembaruan dokumentasi](https://developers.google.com/search/updates?hl=id)
    
*   [Pembaruan peringkat](https://status.search.google.com/products/rGHU1u87FJnkP6W2GwMi/history?hl=id)
    
*   [Video YouTube baru](https://www.youtube.com/channel/UCWf2ZlNsCGDS89VBF_awNvA?hl=id)
    
*   [Episode podcast terbaru](https://pod.link/1512522198)
    

[Acara](https://developers.google.com/search/events?hl=id) [Studi kasus](https://developers.google.com/search/case-studies?hl=id)

/

*   English
*   Deutsch
*   Español
*   Español – América Latina
*   Français
*   Indonesia
*   Italiano
*   Polski
*   Português – Brasil
*   Tiếng Việt
*   Türkçe
*   Русский
*   العربيّة
*   हिंदी
*   ภาษาไทย
*   中文 – 简体
*   中文 – 繁體
*   日本語
*   한국어

Masuk

*   [Documentation](https://developers.google.com/search/docs?hl=id)
    

[Search Console](https://goo.gle/searchconsole)

[![Google Search Central](https://developers.google.com/static/search/images/google-search-central-logo.svg)](https://developers.google.com/search?hl=id)

*   [Google Search Central](https://developers.google.com/search?hl=id)
    

*   [Dokumentasi](https://developers.google.com/search/docs)
    *   Lainnya
*   [Dukungan](https://developers.google.com/search/help)
    
*   [Blog](https://developers.google.com/search/blog)
    
*   [Yang baru](https://developers.google.com/search/news)
    *   Lainnya
*   [Acara](https://developers.google.com/search/events)
    
*   [Studi kasus](https://developers.google.com/search/case-studies)
    

*   [Pengantar](https://developers.google.com/search/docs)
    
*   Dasar-Dasar Penelusuran
    
    *   [Ringkasan](https://developers.google.com/search/docs/essentials)
        
    *   [Persyaratan teknis](https://developers.google.com/search/docs/essentials/technical)
        
    *   [Kebijakan spam](https://developers.google.com/search/docs/essentials/spam-policies)
        
    
*   Dasar-dasar SEO
    
    *   [Panduan Memulai SEO](https://developers.google.com/search/docs/fundamentals/seo-starter-guide)
        
    *   [Cara kerja Google Penelusuran](https://developers.google.com/search/docs/fundamentals/how-search-works)
        
    *   [Membuat konten yang bermanfaat, tepercaya, dan mengutamakan pengguna](https://developers.google.com/search/docs/fundamentals/creating-helpful-content)
        
    *   [Apakah Anda membutuhkan SEO?](https://developers.google.com/search/docs/fundamentals/do-i-need-seo)
        
    *   [Mempertahankan SEO situs Anda](https://developers.google.com/search/docs/fundamentals/get-started)
        
    *   [Panduan developer untuk Penelusuran](https://developers.google.com/search/docs/fundamentals/get-started-developers)
        
    *   [Menghadirkan situs Anda di Google](https://developers.google.com/search/docs/fundamentals/get-on-google)
        
    *   [Panduan menggunakan AI generatif](https://developers.google.com/search/docs/fundamentals/using-gen-ai-content)
        
    
*   Crawling dan pengindeksan
    
    *   [Ringkasan](https://developers.google.com/search/docs/crawling-indexing)
        
    *   [Jenis file yang dapat diindeks oleh Google](https://developers.google.com/search/docs/crawling-indexing/indexable-file-types)
        
    *   [Struktur URL](https://developers.google.com/search/docs/crawling-indexing/url-structure)
        
    *   [Tautan](https://developers.google.com/search/docs/crawling-indexing/links-crawlable)
        
    *   Peta Situs
        
        *   [Mempelajari peta situs](https://developers.google.com/search/docs/crawling-indexing/sitemaps/overview)
            
        *   [Membuat dan mengirimkan peta situs](https://developers.google.com/search/docs/crawling-indexing/sitemaps/build-sitemap)
            
        *   [Mengelola peta situs dengan file indeks peta situs](https://developers.google.com/search/docs/crawling-indexing/sitemaps/large-sitemaps)
            
        *   Ekstensi peta situs
            
            *   [Peta situs gambar](https://developers.google.com/search/docs/crawling-indexing/sitemaps/image-sitemaps)
                
            *   [Peta situs berita](https://developers.google.com/search/docs/crawling-indexing/sitemaps/news-sitemap)
                
            *   [Peta situs video dan alternatifnya](https://developers.google.com/search/docs/crawling-indexing/sitemaps/video-sitemaps)
                
            *   [Menggabungkan ekstensi peta situs](https://developers.google.com/search/docs/crawling-indexing/sitemaps/combine-sitemap-extensions)
                
            
        
    *   Pengelolaan crawler
        
        *   [Meminta Google untuk meng-crawl ulang URL](https://developers.google.com/search/docs/crawling-indexing/ask-google-to-recrawl)
            
        *   [Memecahkan masalah error crawl](https://developers.google.com/search/docs/crawling-indexing/troubleshoot-crawling-errors)
            
        *   Crawler Google
            
            *   [Daftar crawler Google](https://developers.google.com/crawling/docs/crawlers-fetchers/overview-google-crawlers)
                
            *   [Googlebot](https://developers.google.com/search/docs/crawling-indexing/googlebot)
                
            *   [Mengurangi frekuensi crawling Google](https://developers.google.com/crawling/docs/crawlers-fetchers/reduce-crawl-rate)
                
            *   [Memverifikasi Googlebot dan crawler Google lainnya](https://developers.google.com/crawling/docs/crawlers-fetchers/verifying-googlebot)
                
            
        
    *   robots.txt
        
        *   [Pengantar robots.txt](https://developers.google.com/search/docs/crawling-indexing/robots/intro)
            
        *   [Cara Google menafsirkan spesifikasi robots.txt](https://developers.google.com/crawling/docs/robots-txt/robots-txt-spec)
            
        
    *   Kanonikalisasi
        
        *   [Apa itu kanonikalisasi URL](https://developers.google.com/search/docs/crawling-indexing/canonicalization)
            
        *   [Cara menentukan URL kanonis dengan rel="canonical" dan metode lainnya](https://developers.google.com/search/docs/crawling-indexing/consolidate-duplicate-urls)
            
        *   [Memperbaiki masalah kanonikalisasi](https://developers.google.com/search/docs/crawling-indexing/canonicalization-troubleshooting)
            
        
    *   [Pengindeksan yang memprioritaskan situs seluler](https://developers.google.com/search/docs/crawling-indexing/mobile/mobile-sites-mobile-first-indexing)
        
    *   AMP
        
        *   [Pedoman AMP di Google Penelusuran](https://developers.google.com/search/docs/crawling-indexing/amp)
            
        *   [Memahami cara kerja AMP di hasil penelusuran](https://developers.google.com/search/docs/crawling-indexing/amp/about-amp)
            
        *   [Memperbaiki konten AMP](https://developers.google.com/search/docs/crawling-indexing/amp/enhance-amp)
            
        *   [Memvalidasi konten AMP](https://developers.google.com/search/docs/crawling-indexing/amp/validate-amp)
            
        *   [Menghapus konten AMP](https://developers.google.com/search/docs/crawling-indexing/amp/remove-amp)
            
        
    *   JavaScript
        
        *   [Memahami dasar-dasar SEO JavaScript](https://developers.google.com/search/docs/crawling-indexing/javascript/javascript-seo-basics)
            
        *   [Memperbaiki masalah JavaScript terkait penelusuran](https://developers.google.com/search/docs/crawling-indexing/javascript/fix-search-javascript)
            
        *   [Memperbaiki konten yang lambat dimuat](https://developers.google.com/search/docs/crawling-indexing/javascript/lazy-loading)
            
        *   [Rendering dinamis sebagai solusi](https://developers.google.com/search/docs/crawling-indexing/javascript/dynamic-rendering)
            
        
    *   Metadata halaman dan konten
        
        *   [Metadata halaman](https://developers.google.com/search/docs/crawling-indexing/valid-page-metadata)
            
        *   Tag meta
            
            *   [Atribut HTML dan tag meta yang didukung Google](https://developers.google.com/search/docs/crawling-indexing/special-tags)
                
            *   [Tag meta robot, data-nosnippet, dan X-Robots-Tag](https://developers.google.com/search/docs/crawling-indexing/robots-meta-tag)
                
            *   [noindex](https://developers.google.com/search/docs/crawling-indexing/block-indexing)
                
            
        *   [atribut rel](https://developers.google.com/search/docs/crawling-indexing/qualify-outbound-links)
            
        
    *   Penghapusan
        
        *   [Mengontrol informasi yang dibagikan ke Google](https://developers.google.com/search/docs/crawling-indexing/control-what-you-share)
            
        *   [Penghapusan halaman](https://developers.google.com/search/docs/crawling-indexing/remove-information)
            
        *   [Penghapusan gambar](https://developers.google.com/search/docs/crawling-indexing/prevent-images-on-your-page)
            
        *   [Informasi yang disamarkan](https://developers.google.com/search/docs/crawling-indexing/keep-redacted-information-out)
            
        
    *   Pemindahan dan perubahan situs
        
        *   [Pengalihan dan Google Penelusuran](https://developers.google.com/search/docs/crawling-indexing/301-redirects)
            
        *   Pemindahan situs
            
            *   [Mengubah hosting Anda](https://developers.google.com/search/docs/crawling-indexing/site-move-no-url-changes)
                
            *   [Memindahkan situs dengan perubahan URL](https://developers.google.com/search/docs/crawling-indexing/site-move-with-url-changes)
                
            
        *   [Pengujian A/B](https://developers.google.com/search/docs/crawling-indexing/website-testing)
            
        *   [Menjeda atau menonaktifkan situs untuk sementara](https://developers.google.com/search/docs/crawling-indexing/pause-online-business)
            
        
    
*   Peringkat dan tampilan penelusuran
    
    *   [Ringkasan](https://developers.google.com/search/docs/appearance)
        
    *   [Fitur AI](https://developers.google.com/search/docs/appearance/ai-features)
        
    *   [Tanggal baris nama penulis](https://developers.google.com/search/docs/appearance/publication-dates)
        
    *   [Favicon](https://developers.google.com/search/docs/appearance/favicon-in-search)
        
    *   [Cuplikan pilihan](https://developers.google.com/search/docs/appearance/featured-snippets)
        
    *   [Pemberian Sampel Fleksibel](https://developers.google.com/search/docs/appearance/flexible-sampling)
        
    *   [Google Discover](https://developers.google.com/search/docs/appearance/google-discover)
        
    *   [Gambar](https://developers.google.com/search/docs/appearance/google-images)
        
    *   Fitur lokal
        
        *   [Detail bisnis](https://developers.google.com/search/docs/appearance/establish-business-details)
            
        *   [Daftar Tempat Populer](https://developers.google.com/search/docs/appearance/top-places-list)
            
        *   [Menonaktifkan penayangan konten di hasil penelusuran lokal](https://support.google.com/webmasters/answer/3035947)
            
        
    *   Pengalaman halaman
        
        *   [Memahami pengalaman halaman](https://developers.google.com/search/docs/appearance/page-experience)
            
        *   [Core Web Vitals](https://developers.google.com/search/docs/appearance/core-web-vitals)
            
        *   [Interstisial dan dialog](https://developers.google.com/search/docs/appearance/avoid-intrusive-interstitials)
            
        *   [Mulai menggunakan signed exchange di Google Penelusuran](https://developers.google.com/search/docs/appearance/signed-exchange)
            
        
    *   [Sumber pilihan](https://developers.google.com/search/docs/appearance/preferred-sources)
        
    *   Sistem penentuan peringkat
        
        *   [Panduan untuk sistem penentuan peringkat Google Penelusuran](https://developers.google.com/search/docs/appearance/ranking-systems-guide)
            
        *   [Sistem ulasan](https://developers.google.com/search/docs/appearance/reviews-system)
            
        
    *   Pembaruan peringkat
        
        *   [Daftar pembaruan peringkat](https://status.search.google.com/products/rGHU1u87FJnkP6W2GwMi/history)
            
        *   [Pembaruan inti](https://developers.google.com/search/docs/appearance/core-updates)
            
        *   [Pembaruan spam](https://developers.google.com/search/docs/appearance/spam-updates)
            
        
    *   [Nama situs](https://developers.google.com/search/docs/appearance/site-names)
        
    *   [Sitelink](https://developers.google.com/search/docs/appearance/sitelinks)
        
    *   [Cuplikan](https://developers.google.com/search/docs/appearance/snippet)
        
    *   Data terstruktur
        
        *   [Memahami cara kerja data terstruktur](https://developers.google.com/search/docs/appearance/structured-data/intro-structured-data)
            
        *   [Pedoman umum data terstruktur](https://developers.google.com/search/docs/appearance/structured-data/sd-policies)
            
        *   [Hasil penelusuran yang diperkaya](https://developers.google.com/search/docs/appearance/enriched-search-results)
            
        *   [Membuat data terstruktur dengan JavaScript](https://developers.google.com/search/docs/appearance/structured-data/generate-structured-data-with-javascript)
            
        *   Panduan fitur
            
            *   [Semua fitur data terstruktur](https://developers.google.com/search/docs/appearance/structured-data/search-gallery)
                
            *   [Artikel](https://developers.google.com/search/docs/appearance/structured-data/article)
                
            *   [Tindakan buku](https://developers.google.com/search/docs/appearance/structured-data/book)
                
            *   [Breadcrumb](https://developers.google.com/search/docs/appearance/structured-data/breadcrumb)
                
            *   [Carousel](https://developers.google.com/search/docs/appearance/structured-data/carousel)
                
            *   [Daftar kursus](https://developers.google.com/search/docs/appearance/structured-data/course)
                
            *   [Set data](https://developers.google.com/search/docs/appearance/structured-data/dataset)
                
            *   [Forum diskusi](https://developers.google.com/search/docs/appearance/structured-data/discussion-forum)
                
            *   [Tanya Jawab Soal Pelajaran](https://developers.google.com/search/docs/appearance/structured-data/education-qa)
                
            *   [Rating gabungan perusahaan](https://developers.google.com/search/docs/appearance/structured-data/employer-rating)
                
            *   [Cek fakta](https://developers.google.com/search/docs/appearance/structured-data/factcheck)
                
            *   [Peristiwa](https://developers.google.com/search/docs/appearance/structured-data/event)
                
            *   [FAQ](https://developers.google.com/search/docs/appearance/structured-data/faqpage)
                
            *   [Metadata gambar](https://developers.google.com/search/docs/appearance/structured-data/image-license-metadata)
                
            *   [Postingan lowongan](https://developers.google.com/search/docs/appearance/structured-data/job-posting)
                
            *   [Bisnis lokal](https://developers.google.com/search/docs/appearance/structured-data/local-business)
                
            *   [Pemecah soal matematika](https://developers.google.com/search/docs/appearance/structured-data/math-solvers)
                
            *   [Carousel film](https://developers.google.com/search/docs/appearance/structured-data/movie)
                
            *   [Organisasi](https://developers.google.com/search/docs/appearance/structured-data/organization)
                
            *   Belanja
                
                *   [Ringkasan](https://developers.google.com/search/docs/appearance/structured-data/product)
                    
                *   [Cuplikan produk](https://developers.google.com/search/docs/appearance/structured-data/product-snippet)
                    
                *   [Listingan penjual](https://developers.google.com/search/docs/appearance/structured-data/merchant-listing)
                    
                *   [Varian](https://developers.google.com/search/docs/appearance/structured-data/product-variants)
                    
                *   [Program loyalitas](https://developers.google.com/search/docs/appearance/structured-data/loyalty-program)
                    
                *   [Kebijakan pengembalian barang oleh penjual](https://developers.google.com/search/docs/appearance/structured-data/return-policy)
                    
                *   [Kebijakan pengiriman oleh penjual](https://developers.google.com/search/docs/appearance/structured-data/shipping-policy)
                    
                
            *   [Halaman profil](https://developers.google.com/search/docs/appearance/structured-data/profile-page)
                
            *   [Tanya Jawab](https://developers.google.com/search/docs/appearance/structured-data/qapage)
                
            *   [Resep](https://developers.google.com/search/docs/appearance/structured-data/recipe)
                
            *   [Cuplikan ulasan](https://developers.google.com/search/docs/appearance/structured-data/review-snippet)
                
            *   [Aplikasi software](https://developers.google.com/search/docs/appearance/structured-data/software-app)
                
            *   [Dapat diucapkan](https://developers.google.com/search/docs/appearance/structured-data/speakable)
                
            *   [Konten langganan dan paywall](https://developers.google.com/search/docs/appearance/structured-data/paywalled-content)
                
            *   [Rental akomodasi](https://developers.google.com/search/docs/appearance/structured-data/vacation-rental)
                
            *   [Video](https://developers.google.com/search/docs/appearance/structured-data/video)
                
            
        
    *   [Link judul](https://developers.google.com/search/docs/appearance/title-link)
        
    *   Fitur yang diterjemahkan
        
        *   [Hasil terjemahan](https://developers.google.com/search/docs/appearance/translated-results)
            
        *   [Jaringan iklan dan fitur Google Penelusuran terkait terjemahan](https://developers.google.com/search/docs/appearance/ad-network-and-translation)
            
        
    *   [Video](https://developers.google.com/search/docs/appearance/video)
        
    *   [Galeri Elemen Visual](https://developers.google.com/search/docs/appearance/visual-elements-gallery)
        
    *   Cerita Web
        
        *   [Mengaktifkan Cerita Web di Google](https://developers.google.com/search/docs/appearance/enable-web-stories)
            
        *   [Praktik terbaik untuk membuat Cerita Web](https://developers.google.com/search/docs/appearance/web-stories-creation-best-practices)
            
        *   [Kebijakan konten Cerita Web](https://developers.google.com/search/docs/appearance/web-stories-content-policy)
            
        
    *   Program Pengguna Awal
        
        *   [Pelacakan paket](https://developers.google.com/search/docs/appearance/package-tracking)
            
        *   [Carousel data terstruktur (beta)](https://developers.google.com/search/docs/appearance/structured-data/carousels-beta)
            
        
    
*   Pemantauan dan proses debug
    
    *   [Men-debug penurunan traffic Penelusuran](https://developers.google.com/search/docs/monitor-debug/debugging-search-traffic-drops)
        
    *   Memantau dengan Search Console
        
        *   [Mulai menggunakan Search Console](https://developers.google.com/search/docs/monitor-debug/search-console-start)
            
        *   [Meningkatkan SEO dengan diagram balon](https://developers.google.com/search/docs/monitor-debug/bubble-chart-analysis)
            
        *   [Menggunakan data Search Console dan Google Analytics untuk SEO](https://developers.google.com/search/docs/monitor-debug/google-analytics-search-console)
            
        
    *   Men-debug dengan operator penelusuran
        
        *   [Ringkasan](https://developers.google.com/search/docs/monitor-debug/search-operators)
            
        *   [Operator penelusuran site:](https://developers.google.com/search/docs/monitor-debug/search-operators/all-search-site)
            
        *   [Operator penelusuran Google Gambar](https://developers.google.com/search/docs/monitor-debug/search-operators/image-search)
            
        
    *   Mencegah dan memantau penyalahgunaan
        
        *   [Ringkasan](https://developers.google.com/search/docs/monitor-debug/security)
            
        *   [Cegah spam buatan pengguna](https://developers.google.com/search/docs/monitor-debug/prevent-abuse)
            
        *   [Malware dan software yang tidak diinginkan](https://developers.google.com/search/docs/monitor-debug/security/malware)
            
        *   [Mencegah infeksi malware](https://developers.google.com/search/docs/monitor-debug/security/prevent-malware)
            
        *   [Manipulasi psikologis (phishing dan situs yang menipu)](https://developers.google.com/search/docs/monitor-debug/security/social-engineering)
            
        *   [Kebijakan Pelanggar Berulang Google Safe Browsing](https://developers.google.com/search/docs/monitor-debug/security/safe-browsing-repeat-offenders)
            
        
    *   [Mulai menggunakan Google Trends](https://developers.google.com/search/docs/monitor-debug/trends-start)
        
    
*   Panduan khusus situs
    
    *   E-commerce
        
        *   [Ringkasan](https://developers.google.com/search/docs/specialty/ecommerce)
            
        *   [Tempat konten dapat muncul](https://developers.google.com/search/docs/specialty/ecommerce/where-ecommerce-data-can-appear-on-google)
            
        *   [Membagikan data produk](https://developers.google.com/search/docs/specialty/ecommerce/share-your-product-data-with-google)
            
        *   [Menyertakan data terstruktur](https://developers.google.com/search/docs/specialty/ecommerce/include-structured-data-relevant-to-ecommerce)
            
        *   [Meluncurkan situs baru](https://developers.google.com/search/docs/specialty/ecommerce/how-to-launch-an-ecommerce-website)
            
        *   [Menulis ulasan yang berkualitas](https://developers.google.com/search/docs/specialty/ecommerce/write-high-quality-reviews)
            
        *   [Mendesain struktur URL](https://developers.google.com/search/docs/specialty/ecommerce/designing-a-url-structure-for-ecommerce-sites)
            
        *   [Struktur situs e-commerce](https://developers.google.com/search/docs/specialty/ecommerce/help-google-understand-your-ecommerce-site-structure)
            
        *   [Penomoran halaman, pemuatan halaman bertahap, dan Penelusuran](https://developers.google.com/search/docs/specialty/ecommerce/pagination-and-incremental-page-loading)
            
        
    *   Internasional dan multibahasa
        
        *   [Ringkasan](https://developers.google.com/search/docs/specialty/international)
            
        *   [Mengelola situs multiregional dan multibahasa](https://developers.google.com/search/docs/specialty/international/managing-multi-regional-sites)
            
        *   [Memberi tahu Google tentang versi halaman yang dilokalkan](https://developers.google.com/search/docs/specialty/international/localized-versions)
            
        *   [Cara Google meng-crawl halaman adaptif lokal](https://developers.google.com/search/docs/specialty/international/locale-adaptive-pages)
            
        
    *   Konten vulgar
        
        *   [Pedoman untuk situs yang berisi konten vulgar](https://developers.google.com/search/docs/specialty/explicit/guidelines)
            
        *   [Tindakan yang harus dilakukan jika situs Anda keliru ditandai sebagai vulgar](https://developers.google.com/search/docs/specialty/explicit/troubleshooting)
            
        
    

*   Dasar-dasar SEO
*   [Pengantar](https://developers.google.com/search/docs)
    
*   [Dasar-Dasar Penelusuran](https://developers.google.com/search/docs/essentials)
    
*   [Panduan Memulai SEO](https://developers.google.com/search/docs/fundamentals/seo-starter-guide)
    
*   [Cara Kerja Google Penelusuran](https://developers.google.com/search/docs/fundamentals/how-search-works)
    
*   [Apakah Anda membutuhkan SEO?](https://developers.google.com/search/docs/fundamentals/do-i-need-seo)
    
*   Crawling dan pengindeksan
*   [Peta Situs](https://developers.google.com/search/docs/crawling-indexing/sitemaps/overview)
    
*   [robots.txt](https://developers.google.com/search/docs/crawling-indexing/robots/intro)
    
*   [Tag meta](https://developers.google.com/search/docs/crawling-indexing/special-tags)
    
*   [Pengelolaan crawler](https://developers.google.com/search/docs/crawling-indexing/ask-google-to-recrawl)
    
*   [Penghapusan](https://developers.google.com/search/docs/crawling-indexing/control-what-you-share)
    
*   [Kanonikalisasi](https://developers.google.com/search/docs/crawling-indexing/consolidate-duplicate-urls)
    
*   [Pengalihan](https://developers.google.com/search/docs/crawling-indexing/301-redirects)
    
*   [SEO JavaScript](https://developers.google.com/search/docs/crawling-indexing/javascript/javascript-seo-basics)
    
*   Peringkat dan tampilan penelusuran
*   [Galeri Elemen Visual](https://developers.google.com/search/docs/appearance/visual-elements-gallery)
    
*   [Link judul](https://developers.google.com/search/docs/appearance/title-link)
    
*   [Cuplikan](https://developers.google.com/search/docs/appearance/snippet)
    
*   [Gambar](https://developers.google.com/search/docs/appearance/google-images)
    
*   [Video](https://developers.google.com/search/docs/appearance/video)
    
*   [Data terstruktur](https://developers.google.com/search/docs/appearance/structured-data/search-gallery)
    
*   [Favicon](https://developers.google.com/search/docs/appearance/favicon-in-search)
    
*   Panduan khusus situs
*   [E-commerce](https://developers.google.com/search/docs/specialty/ecommerce)
    
*   [Situs internasional dan multibahasa](https://developers.google.com/search/docs/specialty/international)
    
*   Analisis data
*   [Mulai menggunakan Search Console](https://developers.google.com/search/docs/monitor-debug/search-console-start)
    
*   [Men-debug penurunan traffic](https://developers.google.com/search/docs/monitor-debug/debugging-search-traffic-drops)
    
*   [Menggunakan data Search Console dan Google Analytics untuk SEO](https://developers.google.com/search/docs/monitor-debug/google-analytics-search-console)
    
*   [Mulai menggunakan Google Trends](https://developers.google.com/search/docs/monitor-debug/trends-start)
    

*   [Semua pembaruan](https://developers.google.com/search/news)
    
*   [Pembaruan dokumentasi](https://developers.google.com/search/updates)
    
*   [Pembaruan peringkat](https://status.search.google.com/products/rGHU1u87FJnkP6W2GwMi/history)
    
*   [Video YouTube baru](https://www.youtube.com/channel/UCWf2ZlNsCGDS89VBF_awNvA)
    
*   [Episode podcast terbaru](https://pod.link/1512522198)
    

*   [Beranda](https://developers.google.com/?hl=id)
    
*   [Search Central](https://developers.google.com/search?hl=id)
    
*   [Documentation](https://developers.google.com/search/docs?hl=id)
    

Kirim masukan

Pengantar robots.txt
====================

File robots.txt memberi tahu crawler mesin telusur URL mana yang dapat diakses di situs Anda. File ini digunakan terutama agar situs Anda terhindar dari beban permintaan yang terlampau banyak; **file ini bukanlah mekanisme untuk menyembunyikan halaman web dari Google**. Untuk menyembunyikan halaman web dari Google, [blokir pengindeksan dengan `noindex`](https://developers.google.com/search/docs/crawling-indexing/block-indexing?hl=id)
 atau lindungi halaman dengan sandi.

**Jika menggunakan CMS, seperti Wix atau Blogger**, Anda mungkin tidak perlu (atau dapat) mengedit file robots.txt secara langsung. Sebaliknya, CMS Anda mungkin mengekspos halaman setelan penelusuran atau beberapa mekanisme lain untuk memberi tahu mesin telusur agar meng-crawl halaman Anda atau tidak.

Jika ingin menyembunyikan atau memperlihatkan salah satu halaman Anda dari mesin telusur, telusuri petunjuk tentang mengubah visibilitas halaman di mesin telusur di CMS Anda (misalnya, telusuri "cara wix menyembunyikan halaman dari mesin telusur").

Untuk apa file robots.txt digunakan?
------------------------------------

File robots.txt digunakan terutama untuk mengelola traffic crawler ke situs Anda, dan _biasanya_ menyembunyikan halaman dari Google, bergantung pada jenis file-nya:

| Pengaruh robots.txt pada beragam jenis file |     |
| --- | --- |
| Halaman web | Anda dapat menggunakan file robots.txt untuk halaman web (HTML, PDF, atau [format non-media lain yang dapat dibaca Google](https://developers.google.com/search/docs/crawling-indexing/indexable-file-types?hl=id)<br>), untuk mengelola traffic crawling jika menurut Anda server kewalahan menangani permintaan dari crawler Google, atau untuk menghindari crawling halaman yang mirip atau tidak penting di situs Anda.<br><br>**Peringatan**: Jangan gunakan file robots.txt untuk menyembunyikan halaman web Anda (termasuk PDF dan format berbasis teks lainnya yang didukung oleh Google) dari hasil Google Penelusuran.<br><br>Jika halaman lain mengarah ke halaman Anda dengan teks deskriptif, Google masih dapat mengindeks URL tanpa mengunjungi halaman. Jika Anda ingin memblokir halaman Anda dari hasil penelusuran, gunakan metode lain seperti perlindungan dengan sandi atau [`noindex`](https://developers.google.com/search/docs/crawling-indexing/block-indexing?hl=id)<br>.<br><br>**Jika halaman web Anda diblokir dengan file robots.txt**, URL halaman web tersebut masih dapat muncul di hasil penelusuran, tetapi hasil penelusuran tersebut [tidak akan memiliki deskripsi](https://support.google.com/webmasters/answer/7489871?hl=id)<br>. File gambar, file video, PDF, dan file non-HTML lainnya yang disematkan di halaman yang diblokir juga akan dikecualikan dari crawling, kecuali jika dirujuk oleh halaman lain yang diizinkan untuk di-crawl. Jika Anda melihat hasil penelusuran ini untuk halaman Anda dan ingin memperbaikinya, hapus entri robots.txt yang memblokir halaman. Jika Anda ingin menyembunyikan halaman sepenuhnya dari penelusuran, gunakan [metode lain](https://developers.google.com/search/docs/crawling-indexing/remove-information?hl=id#i-control-the-web-page)<br>. |
| File media | Gunakan robots.txt untuk mengelola traffic crawling, serta untuk mencegah file gambar, video, dan audio muncul dalam hasil Google Penelusuran. Langkah ini tidak akan mencegah pengguna atau halaman lain menautkan ke file gambar, video, atau audio Anda.<br><br>*   [Baca lebih lanjut cara mencegah gambar muncul di Google](https://developers.google.com/search/docs/crawling-indexing/prevent-images-on-your-page?hl=id)<br>    .<br>*   [Baca lebih lanjut cara menghapus atau membatasi file video Anda agar tidak muncul di Google.](https://developers.google.com/search/docs/appearance/video?hl=id#remove) |
| File resource | Anda dapat menggunakan file robots.txt untuk memblokir file resource seperti file gambar, skrip, atau gaya yang tidak penting, **jika menurut Anda halaman yang dimuat tanpa resource ini tidak akan terpengaruh secara signifikan oleh ketaktersediaan resource tersebut**. Namun, jika ketaktersediaan resource ini mempersulit crawler Google dalam memahami halaman, jangan blokir resource. Jika resource diblokir, Google tidak dapat menganalisis halaman yang bergantung pada resource tersebut dengan baik. |

Memahami batasan file robots.txt
--------------------------------

Sebelum Anda membuat atau mengedit file robots.txt, Anda harus mengetahui batas metode pemblokiran URL ini. Bergantung pada sasaran dan situasi Anda, sebaiknya pertimbangkan mekanisme lain untuk memastikan URL Anda tidak dapat ditemukan di web.

*   **Aturan robots.txt mungkin tidak didukung oleh semua mesin telusur.**  
    Petunjuk dalam file robots.txt tidak dapat memaksakan perilaku crawler ke situs Anda; crawler-lah yang memilih apakah akan mematuhi petunjuk atau tidak. Meskipun Googlebot dan web crawler ternama lainnya mematuhi petunjuk dalam file robots.txt, crawler lain mungkin tidak mematuhinya. Oleh karena itu, jika Anda ingin menjaga informasi tetap aman dari web crawler, sebaiknya gunakan metode pemblokiran lainnya, seperti [file pribadi yang dilindungi sandi pada server Anda](https://developers.google.com/search/docs/crawling-indexing/control-what-you-share?hl=id)
    .
*   **Crawler yang berbeda menafsirkan sintaksis dengan cara yang berbeda.**  
    Meskipun web crawler ternama mengikuti aturan dalam file robots.txt, setiap crawler mungkin menafsirkan aturan dengan cara yang berbeda. Anda harus mengetahui [sintaksis yang sesuai](https://developers.google.com/search/docs/crawling-indexing/robots/robots_txt?hl=id#syntax)
     untuk menangani berbagai web crawler karena sebagian web crawler mungkin tidak memahami petunjuk tertentu.
*   **Halaman yang tidak diizinkan dalam robots.txt masih dapat diindeks jika ditautkan dari situs lainnya.**  
    Meskipun Google tidak akan meng-crawl atau mengindeks konten yang diblokir oleh file robots.txt, kami mungkin masih menemukan dan mengindeks URL yang tidak diizinkan jika URL tersebut ditautkan dari tempat lain di web. Akibatnya, alamat URL dan, mungkin, informasi lain yang tersedia secara publik seperti teks link dalam link ke halaman masih dapat muncul di hasil Google Penelusuran. Agar URL tidak muncul dalam hasil Google Penelusuran, [lindungi file Anda dengan sandi di server](https://developers.google.com/search/docs/crawling-indexing/control-what-you-share?hl=id)
    , [gunakan header respons atau tag `meta` `noindex`](https://developers.google.com/search/docs/crawling-indexing/block-indexing?hl=id)
    , atau hapus seluruh halaman.

**Perhatian**: Menggabungkan beberapa aturan crawling dan pengindeksan dapat menyebabkan pertentangan antara aturan satu dengan aturan lainnya. Pelajari cara [menggabungkan crawling dengan aturan penayangan dan pengindeksan](https://developers.google.com/search/docs/crawling-indexing/robots-meta-tag?hl=id#combining)
.

Membuat atau memperbarui file robots.txt
----------------------------------------

Jika memutuskan bahwa Anda butuh file robots.txt, pelajari cara [membuat file robots.txt](https://developers.google.com/search/docs/crawling-indexing/robots/create-robots-txt?hl=id)
. Atau, jika Anda sudah memiliki file robots.txt, pelajari cara [memperbaruinya](https://developers.google.com/search/docs/crawling-indexing/robots/submit-updated-robots-txt?hl=id)
.

Ingin mempelajari lebih lanjut? Lihat referensi berikut:

*   [Cara menulis dan mengirimkan file robots.txt](https://developers.google.com/crawling/docs/robots-txt/create-robots-txt?hl=id)
    
*   [Memperbarui file robots.txt](https://developers.google.com/crawling/docs/robots-txt/submit-updated-robots-txt?hl=id)
    
*   [Cara Google menafsirkan spesifikasi robots.txt](https://developers.google.com/crawling/docs/robots-txt/robots-txt-spec?hl=id)
    

Kirim masukan

Kecuali dinyatakan lain, konten di halaman ini dilisensikan berdasarkan [Lisensi Creative Commons Attribution 4.0](https://creativecommons.org/licenses/by/4.0/)
, sedangkan contoh kode dilisensikan berdasarkan [Lisensi Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0)
. Untuk mengetahui informasi selengkapnya, lihat [Kebijakan Situs Google Developers](https://developers.google.com/site-policies?hl=id)
. Java adalah merek dagang terdaftar dari Oracle dan/atau afiliasinya.

Terakhir diperbarui pada 2025-12-18 UTC.

 *    [![LinkedIn](https://developers.google.com/static/search/images/li.png?hl=id)LinkedIn](https://www.linkedin.com/showcase/googlesearchcentral/)
    
    Bergabunglah dengan kami di LinkedIn
    
*    [![YouTube](https://developers.google.com/static/homepage-assets/images/yt.svg?hl=id)YouTube](https://www.youtube.com/channel/UCWf2ZlNsCGDS89VBF_awNvA?hl=id)
    
    Tonton video kami
    
*    [![Blog](https://fonts.gstatic.com/s/i/short-term/release/googlesymbols/rss_feed/default/24px.svg)Blog](https://feeds.feedburner.com/blogspot/amDG)
    
    Berlangganan feed RSS kami
    
*    [![Podcast](https://developers.google.com/static/search/images/search-off-the-record-podcast-logo.png?hl=id)Podcast](https://pod.link/1512522198)
    
    Dengarkan podcast Search Off the Record
    
*    [![X (Twitter)](https://developers.google.com/static/homepage-assets/images/x.svg?hl=id)X (Twitter)](https://twitter.com/googlesearchc)
    
    Bergabunglah dengan kami di X (Twitter)

*   ### Dapatkan dukungan
    
    *   [Buka forum bantuan](https://support.google.com/webmasters/community)
        
    *   [Mengirim pertanyaan untuk waktu konsultasi](https://developers.google.com/search/help/office-hours)
        
    *   [Melaporkan spam, phishing, atau malware](https://developers.google.com/search/help/report-quality-issues)
        
    *   [Referensi dukungan lainnya](https://developers.google.com/search/help)
        
*   ### Referensi
    
    *   [Anda membutuhkan SEO?](https://developers.google.com/search/docs/fundamentals/get-on-google)
        
    *   [Panduan Memulai SEO](https://developers.google.com/search/docs/fundamentals/seo-starter-guide)
        
    *   [Status sistem Penelusuran](https://status.search.google.com/)
        
    *   [Dokumentasi Search Console](https://support.google.com/webmasters)
        
    *   [Studi Kasus](https://developers.google.com/search/case-studies/overview)
        
*   ### Alat
    
    *   [Search Console](https://search.google.com/search-console)
        
    *   [Pengujian Hasil Kaya](https://search.google.com/test/rich-results)
        
    *   [PageSpeed Insights](https://pagespeed.web.dev/)
        
    *   [Pengujian AMP](https://search.google.com/test/amp)
        

[![Google Developers](https://www.gstatic.com/devrel-devsite/prod/vb08cbdb02acf7f66ad9727ddfba9d81df8806422eb5dd63dba194c9c8c7997f7/developers/images/lockup-google-for-developers.svg)](https://developers.google.com/?hl=id)

*   [Android](https://developer.android.com/?hl=id)
    
*   [Chrome](https://developer.chrome.com/home?hl=id)
    
*   [Firebase](https://firebase.google.com/?hl=id)
    
*   [Google Cloud Platform](https://cloud.google.com/?hl=id)
    
*   [Google AI](https://ai.google.dev/?hl=id)
    
*   [Semua produk](https://developers.google.com/products?hl=id)
    

*   [Persyaratan](https://developers.google.com/terms/site-terms?hl=id)
    
*   [Privasi](https://policies.google.com/privacy?hl=id)
    
*   [Manage cookies](https://developers.google.com/search/docs/crawling-indexing/robots/intro?hl=id#)
    

*   English
*   Deutsch
*   Español
*   Español – América Latina
*   Français
*   Indonesia
*   Italiano
*   Polski
*   Português – Brasil
*   Tiếng Việt
*   Türkçe
*   Русский
*   العربيّة
*   हिंदी
*   ภาษาไทย
*   中文 – 简体
*   中文 – 繁體
*   日本語
*   한국어