{"id":1336,"date":"2012-06-19T19:57:16","date_gmt":"2012-06-19T17:57:16","guid":{"rendered":"http:\/\/www.nekuda.co.il\/en\/?page_id=1336"},"modified":"2012-06-19T19:57:16","modified_gmt":"2012-06-19T17:57:16","slug":"robots-txt","status":"publish","type":"page","link":"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/","title":{"rendered":"Robots.txt"},"content":{"rendered":"<p>A file located at the website&#8217;s root and guides <a title=\"Search Engine\" href=\"http:\/\/www.nekuda.co.il\/en\/seo-glossary\/search-engine\/\"><strong>search engines<\/strong><\/a> on the pages that should not be crawled.<\/p>\n<p>Note that some search engines may ignore the Robots.txt guidelines and might display the blocked pages on search results, therefore it is usually recommended to simply not upload to a public server files that should not be crawled by search engines and displayed on search results.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A file located at the website&#8217;s root and guides search engines on the pages that should not be crawled. Note that some search engines may ignore the Robots.txt guidelines and might display the blocked pages on search results, therefore it is usually recommended to simply not upload to a public server files that should not [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"parent":1115,"menu_order":44,"comment_status":"open","ping_status":"closed","template":"","meta":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Robots.txt - nekuda Web Solutions<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Robots.txt - nekuda Web Solutions\" \/>\n<meta property=\"og:description\" content=\"A file located at the website&#8217;s root and guides search engines on the pages that should not be crawled. Note that some search engines may ignore the Robots.txt guidelines and might display the blocked pages on search results, therefore it is usually recommended to simply not upload to a public server files that should not [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/\" \/>\n<meta property=\"og:site_name\" content=\"nekuda Web Solutions\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/Nekuda.WebSolutions\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/\",\"url\":\"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/\",\"name\":\"Robots.txt - nekuda Web Solutions\",\"isPartOf\":{\"@id\":\"https:\/\/www.nekuda.co.il\/en\/#website\"},\"datePublished\":\"2012-06-19T17:57:16+00:00\",\"dateModified\":\"2012-06-19T17:57:16+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"\u05e0\u05e7\u05d5\u05d3\u05d4\",\"item\":\"https:\/\/www.nekuda.co.il\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"SEO Glossary\",\"item\":\"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Robots.txt\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.nekuda.co.il\/en\/#website\",\"url\":\"https:\/\/www.nekuda.co.il\/en\/\",\"name\":\"nekuda Web Solutions\",\"description\":\"nekuda creates, promotes and improves digital assets\",\"publisher\":{\"@id\":\"https:\/\/www.nekuda.co.il\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.nekuda.co.il\/en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.nekuda.co.il\/en\/#organization\",\"name\":\"Nekuda\",\"url\":\"https:\/\/www.nekuda.co.il\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.nekuda.co.il\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.nekuda.co.il\/en\/wp-content\/uploads\/2016\/12\/Logo-Nekuda-Digital-Marketing.png\",\"contentUrl\":\"https:\/\/www.nekuda.co.il\/en\/wp-content\/uploads\/2016\/12\/Logo-Nekuda-Digital-Marketing.png\",\"width\":\"273\",\"height\":\"98\",\"caption\":\"Nekuda\"},\"image\":{\"@id\":\"https:\/\/www.nekuda.co.il\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/Nekuda.WebSolutions\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Robots.txt - nekuda Web Solutions","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/","og_locale":"en_US","og_type":"article","og_title":"Robots.txt - nekuda Web Solutions","og_description":"A file located at the website&#8217;s root and guides search engines on the pages that should not be crawled. Note that some search engines may ignore the Robots.txt guidelines and might display the blocked pages on search results, therefore it is usually recommended to simply not upload to a public server files that should not [&hellip;]","og_url":"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/","og_site_name":"nekuda Web Solutions","article_publisher":"https:\/\/www.facebook.com\/Nekuda.WebSolutions","schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/","url":"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/","name":"Robots.txt - nekuda Web Solutions","isPartOf":{"@id":"https:\/\/www.nekuda.co.il\/en\/#website"},"datePublished":"2012-06-19T17:57:16+00:00","dateModified":"2012-06-19T17:57:16+00:00","breadcrumb":{"@id":"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/robots-txt\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"\u05e0\u05e7\u05d5\u05d3\u05d4","item":"https:\/\/www.nekuda.co.il\/en\/"},{"@type":"ListItem","position":2,"name":"SEO Glossary","item":"https:\/\/www.nekuda.co.il\/en\/seo-glossary\/"},{"@type":"ListItem","position":3,"name":"Robots.txt"}]},{"@type":"WebSite","@id":"https:\/\/www.nekuda.co.il\/en\/#website","url":"https:\/\/www.nekuda.co.il\/en\/","name":"nekuda Web Solutions","description":"nekuda creates, promotes and improves digital assets","publisher":{"@id":"https:\/\/www.nekuda.co.il\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.nekuda.co.il\/en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.nekuda.co.il\/en\/#organization","name":"Nekuda","url":"https:\/\/www.nekuda.co.il\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.nekuda.co.il\/en\/#\/schema\/logo\/image\/","url":"https:\/\/www.nekuda.co.il\/en\/wp-content\/uploads\/2016\/12\/Logo-Nekuda-Digital-Marketing.png","contentUrl":"https:\/\/www.nekuda.co.il\/en\/wp-content\/uploads\/2016\/12\/Logo-Nekuda-Digital-Marketing.png","width":"273","height":"98","caption":"Nekuda"},"image":{"@id":"https:\/\/www.nekuda.co.il\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/Nekuda.WebSolutions"]}]}},"_links":{"self":[{"href":"https:\/\/www.nekuda.co.il\/en\/wp-json\/wp\/v2\/pages\/1336"}],"collection":[{"href":"https:\/\/www.nekuda.co.il\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.nekuda.co.il\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.nekuda.co.il\/en\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nekuda.co.il\/en\/wp-json\/wp\/v2\/comments?post=1336"}],"version-history":[{"count":0,"href":"https:\/\/www.nekuda.co.il\/en\/wp-json\/wp\/v2\/pages\/1336\/revisions"}],"up":[{"embeddable":true,"href":"https:\/\/www.nekuda.co.il\/en\/wp-json\/wp\/v2\/pages\/1115"}],"wp:attachment":[{"href":"https:\/\/www.nekuda.co.il\/en\/wp-json\/wp\/v2\/media?parent=1336"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}