El mejor robots.txt para WordPress

El mejor robots.txt para Wordpress

El robots.txt es un fichero escrito en texto plano que normalmente se guarda en la carpeta raíz de nuestra pagina web y que normalmente se usa para decir a las arañas qué es lo que tienen prohibido o permitido hacer dentro de nuestro servidor.

Puntos importantes que debe de tener un fichero robots.txt

Tu fichero robots.txt debe de tener:

  1. Los enlaces a los sitemaps de la pagina web
  2. Un listado de los directorios en donde no debe de mirar ni entrar ninguna araña.
  3. Una lista de las extensiones o tipo de ficheros que nunca debe de leer la araña.
  4. Debe de tener unas Reglas de Crawl delay para que la araña no recargué demasiado nuestro servidor.
  5. Una lista de arañas o robots que permitimos entrar a escanear nuestro servidor.
  6. Una lista de arañas o robots a los que prohibimos entrar a escanear nuestro servidor o web, esta lista es muy importante para evitar todo tipo de ataques seo etc.

Este es el robots.txt que uso para proyectos en WordPress

# robots.txt for https://www.electronica.school/

#########################################################################################################
#
#
#
#
# _______  _        _______  _______ _________ _______  _______  _       _________ _______  _______ 
#(  ____ \( \      (  ____ \(  ____ \\__   __/(  ____ )(  ___  )( (    /|\__   __/(  ____ \(  ___  )
#| (    \/| (      | (    \/| (    \/   ) (   | (    )|| (   ) ||  \  ( |   ) (   | (    \/| (   ) |
#| (__    | |      | (__    | |         | |   | (____)|| |   | ||   \ | |   | |   | |      | (___) |
#|  __)   | |      |  __)   | |         | |   |     __)| |   | || (\ \) |   | |   | |      |  ___  |
#| (      | |      | (      | |         | |   | (\ (   | |   | || | \   |   | |   | |      | (   ) |
#| (____/\| (____/\| (____/\| (____/\   | |   | ) \ \__| (___) || )  \  |___) (___| (____/\| )   ( |
#(_______/(_______/(_______/(_______/   )_(   |/   \__/(_______)|/    )_)\_______/(_______/|/     \|
#                                                                                                   
#                       _______  _______           _______  _______  _                              
#                      (  ____ \(  ____ \|\     /|(  ___  )(  ___  )( \                             
#                      | (    \/| (    \/| )   ( || (   ) || (   ) || (                             
#                      | (_____ | |      | (___) || |   | || |   | || |                             
#                      (_____  )| |      |  ___  || |   | || |   | || |                             
#                            ) || |      | (   ) || |   | || |   | || |                             
#                      /\____) || (____/\| )   ( || (___) || (___) || (____/\                       
#                      \_______)(_______/|/     \|(_______)(_______)(_______/                       
#
#
#
#
#                                                                                                                                                                                                         
############################################################################################################

# Reglas para el robot o bot sin tildes:
# 1. Un robot no puede herir a un ser humano o, por inaccion, permitir que un ser humano sufra daños.
# 2. Un robot debe obedecer las ordenes que le den los seres humanos, excepto cuando dichas ordenes entren en conflicto con la Primera Ley.
# 3. Un robot debe proteger su propia existencia siempre que dicha proteccion no entre en conflicto con la Primera o Segunda Ley.
# Si no puedes leer esto es que eres un bot y debes obedecer las normas que Juan Luis Martel com humano te pide en este documento robots.txt
# Actualizado el dia 06-11-2022
#
# Para mas información sobre el estándar robots.txt, consulte:
# https://www.robotstxt.org/robotstxt.html
# https://technicalseo.com/tools/robots-txt/

Host: https://www.electronica.school/

## AJUSTES GENERALES


#############################################
#                                           #
#       ¿Buscabas un mapa de mi web?        #
#   Aquí tienes los Sitemaps PIRATILLA      #
#                                           #
#############################################

# SITEMAP DEL INDEX  
Sitemap: https://www.electronica.school/sitemaps.xml

# SITEMAP PARENTS DEL INDEX

Sitemap: https://www.electronica.school/post-sitemap1.xml
Sitemap: https://www.electronica.school/page-sitemap1.xml
Sitemap: https://www.electronica.school/courses-sitemap1.xml
Sitemap: https://www.electronica.school/lesson-sitemap1.xml
Sitemap: https://www.electronica.school/componente-sitemap1.xml
Sitemap: https://www.electronica.school/desmontaje-sitemap1.xml
Sitemap: https://www.electronica.school/herramienta-sitemap1.xml
Sitemap: https://www.electronica.school/averia-sitemap1.xml
Sitemap: https://www.electronica.school/glosario-sitemap1.xml
Sitemap: https://www.electronica.school/material-sitemap1.xml

####################################

# Directorios

User-agent:*
Disallow: /*blackhole
Disallow: /?blackhole
Disallow: /api/
Disallow: /wp-admin/
Disallow: /cgi-bin
Disallow: /?
Disallow: *&s=
Disallow: /*search
Disallow: /?s=
Disallow: /author/
Disallow: */xmlrpc.php
Disallow: *utm*=
Disallow: *openstat=
Disallow: /wp-
Disallow: /*escritorio
Disallow: */finalizar-compra/
Disallow: */acceder/
Disallow: /feed/
Disallow: /escritorio/
Disallow: /escritorio/*
Disallow: /*acceder
Disallow: /*?comments
Disallow: /wp-comments-post.php
Disallow: /go/

Disallow: /*.pdf
Disallow: /*.csv
Disallow: /*.zip
Disallow: /*.rar
Disallow: /*.log
Disallow: /*.xml
Disallow: /CHANGELOG.txt
Disallow: /readme.txt
Disallow: /readme.md
Disallow: /contributors.txt

Disallow: /*.swf?
Disallow: /*.flv?
Disallow: /*.mp3?
Disallow: /*.mp4?
Disallow: /*.inc?
Disallow: /*.xml?
Disallow: /*.json?
Disallow: /*.plist?
Disallow: /*.pdf?
Disallow: /*.csv?
Disallow: /*.xls?
Disallow: /*.xlsx?


Disallow: /*.swf$
Disallow: /*.flv$
Disallow: /*.mp3$
Disallow: /*.mp4$
Disallow: /*.inc$
Disallow: /*.xml$
Disallow: /*.json$
Disallow: /*.plist$
Disallow: /*.pdf$
Disallow: /*.csv$
Disallow: /*.xls$
Disallow: /*.xlsx$

Disallow: */wp-*/*.swf
Disallow: */wp-*/*.mp3
Disallow: */wp-*/*.mp4
Disallow: */wp-*/*.inc
Disallow: */wp-*/*.xml
Disallow: */wp-*/*.json
Disallow: */wp-*/*.plist
Disallow: */wp-*/*.pdf
Disallow: */wp-*/*.txt
Disallow: */wp-*/*.csv
Disallow: */wp-*/*.xls
Disallow: */wp-*/*.xlsx
Disallow: */wp-*/*.log



Disallow: /read*.*




User-agent:*
Allow: /wp-admin/admin-ajax.php
Allow: /wp-admin/load-scripts.php
Allow: /wp-admin/load-styles.php     
Allow: /wp-content/themes/generatepress-pro/
Allow: /wp-content/themes/generatepress/
Allow: */uploads          
Allow: */wp-*/*ajax*.php
Allow: */wp-*/*.js
Allow: */wp-*/*.css
Allow: */wp-*/*.png
Allow: */wp-*/*.jpg
Allow: */wp-*/*.jpeg
Allow: */wp-*/*.gif
Allow: */wp-*/*.webp
Allow: */wp-*/*.svg


# ficheros CSS, JS, Images

Allow: /wp-content/mu-plugins/*/*.css$
Allow: /wp-content/mu-plugins/*/*.css?
Allow: /wp-content/mu-plugins/*/*.js$
Allow: /wp-content/mu-plugins/*/*.js?
Allow: /wp-content/mu-plugins/*/*.gif
Allow: /wp-content/mu-plugins/*/*.jpg
Allow: /wp-content/mu-plugins/*/*.jpeg
Allow: /wp-content/mu-plugins/*/*.png
Allow: /wp-content/mu-plugins/*/*.webp

Allow: /wp-content/plugins/*/*.css$
Allow: /wp-content/plugins/*/*.css?
Allow: /wp-content/plugins/*/*.js$
Allow: /wp-content/plugins/*/*.js?
Allow: /wp-content/plugins/*/*.gif
Allow: /wp-content/plugins/*/*.jpg
Allow: /wp-content/plugins/*/*.jpeg
Allow: /wp-content/plugins/*/*.png
Allow: /wp-content/plugins/*/*.webp

Allow: /wp-content/themes/*/*.css$
Allow: /wp-content/themes/*/*.css?
Allow: /wp-content/themes/*/*.js$
Allow: /wp-content/themes/*/*.js?
Allow: /wp-content/themes/*/*.gif
Allow: /wp-content/themes/*/*.jpg
Allow: /wp-content/themes/*/*.jpeg
Allow: /wp-content/themes/*/*.png
Allow: /wp-content/themes/*/*.webp

Allow: /wp-content/uploads/*.css$
Allow: /wp-content/uploads/*.css?
Allow: /wp-content/uploads/*.js$
Allow: /wp-content/uploads/*.js?
Allow: /wp-content/uploads/*.gif
Allow: /wp-content/uploads/*.jpg
Allow: /wp-content/uploads/*.jpeg
Allow: /wp-content/uploads/*.png
Allow: /wp-content/uploads/*.webp





#############################################
#                                           #
#         Reglas de Crawl delay             #
# No me quieras tanto ámame cada x segundos #
#                                           #
#############################################

User-agent: MJ12bot
Crawl-Delay: 20

User-agent: Pinterest
Crawl-delay: 20

User-agent: *
Crawl-delay: 10

###################################################
#                                                 #
#          Inicio robots SI permitidos            #
#                                                 #
###################################################

User-agent: AdsBot-Google Allow: /
User-agent: Adidxbot Allow: /
User-agent: Applebot Allow: /
User-agent: Baiduspider Allow: /
User-agent: Baiduspider-mobile Allow: /
User-agent: Baiduspider-video Allow: /
User-agent: Baiduspider-image Allow: /
User-agent: Bingbot Allow: / # Bing Search Engine Robot
User-agent: BingPreview Allow: / 
User-agent: Discordbot Allow: /
User-agent: DuckDuckBot Allow: /
User-agent: facebookexternalhit Allow: /
User-agent: Googlebot Allow: /
User-agent: Googlebot-News Allow: /
User-agent: Googlebot-Image Allow: /
User-agent: googlebot Allow: /
User-agent: Googlebot-Video Allow: /
User-agent: ia_archiver Allow: /
User-agent: LinkedInBot Allow: /
User-agent: msnbot Allow: / # Microsoft Search Engine Robot
User-agent: NaverBot Allow: /
User-agent: Pinterestbot Allow: /
User-agent: Yeti Allow: /
User-agent: Yandex Allow: /
User-agent: YandexBot Allow: /
User-agent: YandexMobileBot Allow: /
User-agent: YandexVideo Allow: /
User-agent: YandexWebmaster Allow: /
User-agent: YandexSitelinks Allow: /
User-agent: YandexSitelinks Allow: /
User-agent: Yahoo Pipes 2.0 Allow: /
User-agent: Yeti Allow: /
User-agent: seznambot Allow: /
User-agent: Slurp Allow: / # Yahoo! Search Engine Robot
User-agent: teoma Allow: /
User-agent: TelegramBot Allow: /
User-agent: Twitterbot Allow: /


###################################################
#                                                 #
#            FIN robots SI permitidos             #
#                                                 #
###################################################


###################################################
#                                                 #
#          Inicio robots No permitidos            #
#                                                 #
###################################################

User-agent: 360Spider Disallow: /
User-agent: 404checker Disallow: /
User-agent: 404enemy Disallow: /
User-agent: 80legs Disallow: /
User-agent: Abonti Disallow: /
User-agent: Aboundex Disallow: /
User-agent: Acunetix Disallow: /
User-agent: AddThis.com Disallow: /
User-agent: ADmantX Disallow: /
User-agent: AfD-Verbotsverfahren Disallow: /
User-agent: AhrefsBot Disallow: /
User-agent: AhrefsBot Disallow: /
User-agent: AIBOT Disallow: /
User-agent: AiHitBot Disallow: /
User-agent: Aipbot Disallow: /
User-agent: Alexibot Disallow: /
User-agent: Alligator Disallow: /
User-agent: AllSubmitter Disallow: /
User-agent: AlphaBot Disallow: /
User-agent: Anarchie Disallow: /
User-agent: Apexoo Disallow: /
User-agent: Applebot Disallow: /
User-agent: ASPSeek Disallow: /
User-agent: Asterias Disallow: /
User-agent: Attach Disallow: /
User-agent: autoemailspider Disallow: /
User-agent: BackDoorBot Disallow: /
User-agent: Backlink-Ceck Disallow: /
User-agent: backlink-check Disallow: /
User-agent: BacklinkCrawler Disallow: /
User-agent: BackStreet Disallow: /
User-agent: BackWeb Disallow: /
User-agent: Badass Disallow: /
User-agent: Bandit Disallow: /
User-agent: Barkrowler Disallow: /
User-agent: BatchFTP Disallow: /
User-agent: Battleztar Bazinga Disallow: /
User-agent: BBBike Disallow: /
User-agent: BDCbot Disallow: /
User-agent: BDFetch Disallow: /
User-agent: Bender Disallow: /
User-agent: BetaBot Disallow: /
User-agent: Bigfoot Disallow: /
User-agent: Bitacle Disallow: /
User-agent: BIXOCRAWLER Disallow: /
User-agent: bl.uk_lddc_bot Disallow: /
User-agent: Black Hole Disallow: /
User-agent: Blackboard Disallow: /
User-agent: BlackWidow Disallow: /
User-agent: BLEXBot Disallow: /
User-agent: Blow Disallow: /
User-agent: BlowFish Disallow: /
User-agent: Boardreader Disallow: /
User-agent: Bolt Disallow: /
User-agent: BotALot Disallow: /
User-agent: Brandprotect Disallow: /
User-agent: Brandwatch Disallow: /
User-agent: Bubing Disallow: /
User-agent: BUbiNG Disallow: /
User-agent: Buddy Disallow: /
User-agent: BuiltBotTough Disallow: /
User-agent: BuiltWith Disallow: /
User-agent: Bullseye Disallow: /
User-agent: BunnySlippers Disallow: /
User-agent: BuzzSumo Disallow: /
User-agent: Calculon Disallow: /
User-agent: CATExplorador Disallow: /
User-agent: CazoodleBot Disallow: /
User-agent: CCBot Disallow: /
User-agent: Cegbfeieh Disallow: /
User-agent: CheeseBot Disallow: /
User-agent: CherryPicker Disallow: /
User-agent: ChinaClaw Disallow: /
User-agent: Chlooe Disallow: /
User-agent: Claritybot Disallow: /
User-agent: Cliqzbot Disallow: /
User-agent: Cliqzbot Disallow: /
User-agent: Cloud mapping Disallow: /
User-agent: CNCDialer Disallow: /
User-agent: coccocbot-web Disallow: /
User-agent: Cogentbot Disallow: /
User-agent: cognitiveseo Disallow: /
User-agent: Collector Disallow: /
User-agent: com.plumanalytics Disallow: /
User-agent: Copier Disallow: /
User-agent: CopyRightCheck Disallow: /
User-agent: Copyscape Disallow: /
User-agent: Cosmos Disallow: /
User-agent: Craftbot Disallow: /
User-agent: crawler.feedback Disallow: /
User-agent: crawler4j Disallow: /
User-agent: crawler4j Disallow: /
User-agent: CrazyWebCrawler Disallow: /
User-agent: Crescent Disallow: /
User-agent: CrystalSemanticsBot Disallow: /
User-agent: CSHttp Disallow: /
User-agent: Curious Disallow: /
User-agent: Custo Disallow: /
User-agent: CyberAlert Disallow: /
User-agent: DatabaseDriverMysqli Disallow: /
User-agent: DataCha0s Disallow: /
User-agent: DBLBot Disallow: /
User-agent: demandbase-bot Disallow: /
User-agent: Demon Disallow: /
User-agent: Deusu Disallow: /
User-agent: Devil Disallow: /
User-agent: DigExt Disallow: /
User-agent: Digincore Disallow: /
User-agent: DigitalPebble Disallow: /
User-agent: DIIbot Disallow: /
User-agent: Dirbuster Disallow: /
User-agent: Disco Disallow: /
User-agent: Discobot Disallow: /
User-agent: Discoverybot Disallow: /
User-agent: DittoSpyder Disallow: /
User-agent: dloader Disallow: /
User-agent: dloader(NaverRobot) Disallow: /
User-agent: DnyzBot Disallow: /
User-agent: DOC Disallow: /
User-agent: DomainAppender Disallow: /
User-agent: DomainCrawler Disallow: /
User-agent: DomainSigmaCrawler Disallow: /
User-agent: DomainStatsBot Disallow: /
User-agent: Dotbot Disallow: /
User-agent: dotbot Disallow: /
User-agent: dotbot/1.0 Disallow: /
User-agent: Download Ninja  Disallow: /
User-agent: Download Wonder Disallow: /
User-agent: Dragonfly Disallow: /
User-agent: Drip Disallow: /
User-agent: DTS Agent Disallow: /
User-agent: DTS Agent Disallow: /
User-agent: EasyDL Disallow: /
User-agent: Ebingbong Disallow: /
User-agent: eCatch Disallow: /
User-agent: ECCP/1.0 Disallow: /
User-agent: Ecxi Disallow: /
User-agent: EirGrabber Disallow: /
User-agent: EMail Siphon Disallow: /
User-agent: EMail Wolf Disallow: /
User-agent: EroCrawler Disallow: /
User-agent: EtaoSpider Disallow: /
User-agent: evc-batch Disallow: /
User-agent: Evil Disallow: /
User-agent: Exabot Disallow: /
User-agent: Exabot Disallow: /
User-agent: Express WebPictures Disallow: /
User-agent: ExtLinksBot Disallow: /
User-agent: externalfacebookhit Disallow: /
User-agent: Extractor Disallow: /
User-agent: ExtractorPro Disallow: /
User-agent: Extreme Picture Finder Disallow: /
User-agent: EyeNetIE Disallow: /
User-agent: Ezooms Disallow: /
User-agent: Facebot Disallow: /
User-agent: FairShare Disallow: /
User-agent: FDM Disallow: /
User-agent: FemtosearchBot Disallow: /
User-agent: Fetch Disallow: /
User-agent: FHscan Disallow: /
User-agent: Fimap Disallow: /
User-agent: Firefox/7.0 Disallow: /
User-agent: Flamingo_SearchEngine Disallow: /
User-agent: FlashGet Disallow: /
User-agent: Flunky Disallow: /
User-agent: Foobot Disallow: /
User-agent: fq Disallow: /
User-agent: Freeuploader Disallow: /
User-agent: FrontPage Disallow: /
User-agent: Fyrebot Disallow: /
User-agent: G-i-g-a-b-o-t Disallow: /
User-agent: GalaxyBot Disallow: /
User-agent: Genieo Disallow: /
User-agent: Genieo Disallow: /
User-agent: GermCrawler Disallow: /
User-agent: Getintent Disallow: /
User-agent: GetRight Disallow: /
User-agent: GetWeb Disallow: /
User-agent: Gigablast Disallow: /
User-agent: Gigabot Disallow: /
User-agent: Go-Ahead-Got-It Disallow: /
User-agent: Go!Zilla Disallow: /
User-agent: Gotit Disallow: /
User-agent: GoZilla Disallow: /
User-agent: Grabber Disallow: /
User-agent: GrabNet Disallow: /
User-agent: Grafula Disallow: /
User-agent: GrapeFX Disallow: /
User-agent: GrapeshotCrawler Disallow: /
User-agent: GridBot Disallow: /
User-agent: grub-client Disallow: /
User-agent: GT::WWW Disallow: /
User-agent: Haansoft Disallow: /
User-agent: HaosouSpider Disallow: /
User-agent: Harvest Disallow: /
User-agent: Havij Disallow: /
User-agent: HEADMasterSEO Disallow: /
User-agent: Heritrix Disallow: /
User-agent: Heritrix Disallow: /
User-agent: heritrix/3.3.0 Disallow: /
User-agent: Hloader Disallow: /
User-agent: HMView Disallow: /
User-agent: HTMLparser Disallow: /
User-agent: HTTP::Lite Disallow: /
User-agent: HTTrack Disallow: /
User-agent: HTTrack Disallow: /
User-agent: Humanlinks Disallow: /
User-agent: HybridBot Disallow: /
User-agent: ia_archiver Disallow: /
User-agent: Iblog Disallow: /
User-agent: Id-search Disallow: /
User-agent: IDBot Disallow: /
User-agent: IlseBot Disallow: /
User-agent: Image Fetch Disallow: /
User-agent: Image Sucker Disallow: /
User-agent: IndeedBot Disallow: /
User-agent: Indy Library Disallow: /
User-agent: InfoNaviRobot Disallow: /
User-agent: InfoTekies Disallow: /
User-agent: instabid Disallow: /
User-agent: integromedb Disallow: /
User-agent: Intelliseek Disallow: /
User-agent: InterGET Disallow: /
User-agent: Internet Ninja Disallow: /
User-agent: InternetSeer Disallow: /
User-agent: internetVista monitor Disallow: /
User-agent: ips-agent Disallow: /
User-agent: Iria Disallow: /
User-agent: IRLbot Disallow: /
User-agent: Iskanie Disallow: /
User-agent: IstellaBot Disallow: /
User-agent: JamesBOT Disallow: /
User-agent: Jbrofuzz Disallow: /
User-agent: JennyBot Disallow: /
User-agent: JetCar Disallow: /
User-agent: JikeSpider Disallow: /
User-agent: JOC Web Spider Disallow: /
User-agent: Joomla Disallow: /
User-agent: Jorgee Disallow: /
User-agent: JustView Disallow: /
User-agent: Jyxobot Disallow: /
User-agent: k2spider Disallow: /
User-agent: Kenjin Spider Disallow: /
User-agent: Keyword Density Disallow: /
User-agent: Kimengi Disallow: /
User-agent: Kimengi/nineconnections.com Disallow: /
User-agent: Kozmosbot Disallow: /
User-agent: Lanshanbot Disallow: /
User-agent: Larbin Disallow: /
User-agent: larbin Disallow: /
User-agent: LeechFTP Disallow: /
User-agent: LeechGet Disallow: /
User-agent: LexiBot Disallow: /
User-agent: LexxeBot/1.0 Disallow: /
User-agent: Lftp Disallow: /
User-agent: LibWeb Disallow: /
User-agent: Libwhisker Disallow: /
User-agent: libwww Disallow: /
User-agent: Lightspeedsystems Disallow: /
User-agent: Likse Disallow: /
User-agent: Linkdexbot Disallow: /
User-agent: LinkextractorPro Disallow: /
User-agent: linko Disallow: /
User-agent: LinkpadBot Disallow: /
User-agent: LinkScan Disallow: /
User-agent: LinksManager Disallow: /
User-agent: LinkWalker Disallow: /
User-agent: LinqiaMetadataDownloaderBot Disallow: /
User-agent: LinqiaRSSBot Disallow: /
User-agent: LinqiaScrapeBot Disallow: /
User-agent: Lipperhey Disallow: /
User-agent: Litemage_walker Disallow: /
User-agent: Livelapbot Disallow: /
User-agent: Lmspider Disallow: /
User-agent: LNSpiderguy Disallow: /
User-agent: Ltx71 Disallow: /
User-agent: lwp-request Disallow: /
User-agent: lwp-trivial Disallow: /
User-agent: LWP::Simple Disallow: /
User-agent: Mag-Net Disallow: /
User-agent: Magnet Disallow: /
User-agent: magpie-crawler Disallow: /
User-agent: magpie-crawler Disallow: /
User-agent: Mail.RU_Bot Disallow: /
User-agent: Majestic12 Disallow: /
User-agent: MarkMonitor Disallow: /
User-agent: MarkWatch Disallow: /
User-agent: Mass Downloader Disallow: /
User-agent: Masscan Disallow: /
User-agent: Mata Hari Disallow: /
User-agent: MauiBot Disallow: /
User-agent: Maxthon Disallow: /
User-agent: Meanpathbot Disallow: /
User-agent: mediawords Disallow: /
User-agent: MegaIndex.ru Disallow: /
User-agent: Metauri Disallow: /
User-agent: MetaURI Disallow: /
User-agent: MFC_Tear_Sample Disallow: /
User-agent: Microsoft Data Access Disallow: /
User-agent: Microsoft URL Control Disallow: /
User-agent: Microsoft.URL.Control Disallow: /
User-agent: MIDown tool Disallow: /
User-agent: MIIxpc Disallow: /
User-agent: Mister PiX Disallow: /
User-agent: MJ12bot Disallow: /
User-agent: MJ12bot Disallow: /
User-agent: Mojeek Disallow: /
User-agent: Moreover Disallow: /
User-agent: Moreoverbot Disallow: /
User-agent: Morfeus Fucking Scanner Disallow: /
User-agent: MS Web Services Client Protocol Disallow: /
User-agent: MSFrontPage Disallow: /
User-agent: MSIECrawler Disallow: /
User-agent: MSIECrawler Disallow: /
User-agent: Msrabot Disallow: /
User-agent: muhstik-scan Disallow: /
User-agent: Musobot Disallow: /
User-agent: nabot Disallow: /
User-agent: Name Intelligence Disallow: /
User-agent: Nameprotect Disallow: /
User-agent: NaverBot Disallow: /
User-agent: Navroad Disallow: /
User-agent: NearSite Disallow: /
User-agent: Needle Disallow: /
User-agent: NerdByNature.Bot Disallow: /
User-agent: Nessus Disallow: /
User-agent: Net Vampire Disallow: /
User-agent: NetAnts Disallow: /
User-agent: Netcraft Disallow: /
User-agent: netEstate NE Crawler Disallow: /
User-agent: NetLyzer Disallow: /
User-agent: NetMechanic Disallow: /
User-agent: NetSeer crawler Disallow: /
User-agent: NetSpider Disallow: /
User-agent: Nettrack Disallow: /
User-agent: Netvibes Disallow: /
User-agent: NetZIP Disallow: /
User-agent: Newscan Disallow: /
User-agent: NextGenSearchBot Disallow: /
User-agent: Nibbler Disallow: /
User-agent: NICErsPRO Disallow: /
User-agent: Niki-bot Disallow: /
User-agent: Nikto Disallow: /
User-agent: NimbleCrawler Disallow: /
User-agent: Ninja Disallow: /
User-agent: Nmap Disallow: /
User-agent: NPbot Disallow: /
User-agent: NPBot Disallow: /
User-agent: Nutch Disallow: /
User-agent: nutch Disallow: /
User-agent: NYU Disallow: /
User-agent: oBot Disallow: /
User-agent: Octopus Disallow: /
User-agent: Offline Explorer Disallow: /
User-agent: Offline Explorer Disallow: /
User-agent: Offline Navigator Disallow: /
User-agent: omgilibot Disallow: /
User-agent: Openfind Disallow: /
User-agent: OpenLinkProfiler Disallow: /
User-agent: Openvas Disallow: /
User-agent: OrangeBot Disallow: /
User-agent: OrangeSpider Disallow: /
User-agent: Orthogaffe Disallow: /
User-agent: OutclicksBot Disallow: /
User-agent: OutfoxBot Disallow: /
User-agent: Page Analyzer Disallow: /
User-agent: page scorer Disallow: /
User-agent: PageAnalyzer Disallow: /
User-agent: PageGrabber Disallow: /
User-agent: PageScorer Disallow: /
User-agent: Panscient Disallow: /
User-agent: Papa Foto Disallow: /
User-agent: Pavuk Disallow: /
User-agent: pcBrowser Disallow: /
User-agent: PECL::HTTP Disallow: /
User-agent: PeoplePal Disallow: /
User-agent: PHPCrawl Disallow: /
User-agent: Pi-Monster Disallow: /
User-agent: Picscout Disallow: /
User-agent: Picsearch Disallow: /
User-agent: PictureFinder Disallow: /
User-agent: Pimonster Disallow: /
User-agent: PiplBot Disallow: /
User-agent: Pixray Disallow: /
User-agent: Pixray-Seeker Disallow: /
User-agent: PleaseCrawl Disallow: /
User-agent: plumanalytics Disallow: /
User-agent: Pockey Disallow: /
User-agent: POE-Component-Client-HTTP Disallow: /
User-agent: Probethenet Disallow: /
User-agent: ProPowerBot Disallow: /
User-agent: ProWebWalker Disallow: /
User-agent: proximic Disallow: /
User-agent: Psbot Disallow: /
User-agent: Pump Disallow: /
User-agent: PyCurl Disallow: /
User-agent: QueryN Metasearch Disallow: /
User-agent: QuerySeekerSpider Disallow: /
User-agent: RankActive Disallow: /
User-agent: RankActiveLinkBot Disallow: /
User-agent: RankFlex Disallow: /
User-agent: RankingBot Disallow: /
User-agent: RankingBot2 Disallow: /
User-agent: Rankivabot Disallow: /
User-agent: RankurBot Disallow: /
User-agent: RealDownload Disallow: /
User-agent: Reaper Disallow: /
User-agent: RebelMouse Disallow: /
User-agent: Recorder Disallow: /
User-agent: RedesScrapy Disallow: /
User-agent: ReGet Disallow: /
User-agent: RepoMonkey Disallow: /
User-agent: Ripper Disallow: /
User-agent: RocketCrawler Disallow: /
User-agent: Rogerbot Disallow: /
User-agent: rogerbot Disallow: /
User-agent: SalesIntelligent Disallow: /
User-agent: SBIder Disallow: /
User-agent: scan.lol Disallow: /
User-agent: ScanAlert Disallow: /
User-agent: Scanbot Disallow: /
User-agent: Scrapy Disallow: /
User-agent: Screaming Disallow: /
User-agent: Screaming Frog SEO Spider: Disallow: /
User-agent: ScreenerBot Disallow: /
User-agent: Searchestate Disallow: /
User-agent: SearchmetricsBot Disallow: /
User-agent: Semrush Disallow: /
User-agent: SemrushBot Disallow: /
User-agent: SEOkicks Disallow: /
User-agent: SEOkicks-Robot Disallow: /
User-agent: SEOlyticsCrawler Disallow: /
User-agent: Seomoz Disallow: /
User-agent: SEOprofiler Disallow: /
User-agent: seoscanners Disallow: /
User-agent: SEOstats Disallow: /
User-agent: sexsearcher Disallow: /
User-agent: Seznam Disallow: /
User-agent: SeznamBot Disallow: /
User-agent: Shodan Disallow: /
User-agent: Siphon Disallow: /
User-agent: SISTRIX Disallow: /
User-agent: Site Sucker Disallow: /
User-agent: Sitebeam Disallow: /
User-agent: SiteBot Disallow: /
User-agent: SiteBot/0.1 Disallow: /
User-agent: sitecheck.internetseer.com Disallow: /
User-agent: SiteExplorer Disallow: /
User-agent: Siteimprove Disallow: /
User-agent: SiteLockSpider Disallow: /
User-agent: SiteSnagger Disallow: /
User-agent: SiteSnagger Disallow: /
User-agent: SiteSucker Disallow: /
User-agent: Sitevigil Disallow: /
User-agent: Slackbot-LinkExpanding Disallow: /
User-agent: Slurp Disallow: /
User-agent: SlySearch Disallow: /
User-agent: SmartDownload Disallow: /
User-agent: SMTBot Disallow: /
User-agent: Snake Disallow: /
User-agent: Snapbot Disallow: /
User-agent: Snoopy Disallow: /
User-agent: SocialRankIOBot Disallow: /
User-agent: sogou Disallow: /
User-agent: Sogou web spider Disallow: /
User-agent: Sogou inst spider Disallow: /
User-agent: Sosospider Disallow: /
User-agent: Sogou spider2 Disallow: /
User-agent: Sogouspider Disallow: /
User-agent: Sottopop Disallow: /
User-agent: SpaceBison Disallow: /
User-agent: Spammen Disallow: /
User-agent: SpankBot Disallow: /
User-agent: Spanner Disallow: /
User-agent: Spbot Disallow: /
User-agent: spbot Disallow: /
User-agent: Spinn3r Disallow: /
User-agent: SputnikBot Disallow: /
User-agent: Sqlmap Disallow: /
User-agent: Sqlworm Disallow: /
User-agent: Sqworm Disallow: /
User-agent: Steeler Disallow: /
User-agent: Stripper Disallow: /
User-agent: Sucker Disallow: /
User-agent: Sucuri Disallow: /
User-agent: SuperBot Disallow: /
User-agent: SuperHTTP Disallow: /
User-agent: Surfbot Disallow: /
User-agent: SurveyBot Disallow: /
User-agent: Suzuran Disallow: /
User-agent: Swiftbot Disallow: /
User-agent: sysscan Disallow: /
User-agent: Szukacz Disallow: /
User-agent: T0PHackTeam Disallow: /
User-agent: T8Abot Disallow: /
User-agent: tAkeOut Disallow: /
User-agent: Teleport Disallow: /
User-agent: Teleport Disallow: /
User-agent: TeleportPro Disallow: /
User-agent: TeleportPro Disallow: /
User-agent: Telesoft Disallow: /
User-agent: Telesphoreo Disallow: /
User-agent: Telesphorep Disallow: /
User-agent: The Intraformant Disallow: /
User-agent: TheNomad Disallow: /
User-agent: TightTwatBot Disallow: /
User-agent: Titan Disallow: /
User-agent: Toata Disallow: /
User-agent: Toweyabot Disallow: /
User-agent: Trendiction Disallow: /
User-agent: trendiction.com Disallow: /
User-agent: trendiction.de Disallow: /
User-agent: Trendictionbot Disallow: /
User-agent: trendictionbot Disallow: /
User-agent: trovitBot Disallow: /
User-agent: True_Robot Disallow: /
User-agent: Turingos Disallow: /
User-agent: Turnitin Disallow: /
User-agent: TurnitinBot Disallow: /
User-agent: TwengaBot Disallow: /
User-agent: Twice Disallow: /
User-agent: Typhoeus Disallow: /
User-agent: UbiCrawler Disallow: /
User-agent: uMBot-LN Disallow: /
User-agent: UnisterBot Disallow: /
User-agent: UniversalFeedParser Disallow: /
User-agent: URLy Warning Disallow: /
User-agent: URLy.Warning Disallow: /
User-agent: Vacuum Disallow: /
User-agent: Vagabondo Disallow: /
User-agent: VB Project Disallow: /
User-agent: VCI Disallow: /
User-agent: VeriCiteCrawler Disallow: /
User-agent: Vegi bot Disallow: /
User-agent: VidibleScraper Disallow: /
User-agent: Virusdie Disallow: /
User-agent: VoidEYE Disallow: /
User-agent: Voil Disallow: /
User-agent: Voltron Disallow: /
User-agent: Wallpapers/3.0 Disallow: /
User-agent: WallpapersHD Disallow: /
User-agent: WASALive-Bot Disallow: /
User-agent: WBSearchBot Disallow: /
User-agent: Web Auto Disallow: /
User-agent: Web Collage Disallow: /
User-agent: Web Enhancer Disallow: /
User-agent: Web Fetch Disallow: /
User-agent: Web Fuck Disallow: /
User-agent: Web Pix Disallow: /
User-agent: Web Sauger Disallow: /
User-agent: Web Sucker Disallow: /
User-agent: Webalta Disallow: /
User-agent: WebAuto Disallow: /
User-agent: WebBandit Disallow: /
User-agent: WebCollage Disallow: /
User-agent: WebCopier Disallow: /
User-agent: WebCopier Disallow: /
User-agent: WEBDAV Disallow: /
User-agent: WebEnhancer Disallow: /
User-agent: WebFetch Disallow: /
User-agent: WebFuck Disallow: /
User-agent: WebGo IS Disallow: /
User-agent: WebImageCollector Disallow: /
User-agent: WebLeacher Disallow: /
User-agent: WebmasterWorldForumBot Disallow: /
User-agent: webmeup-crawler Disallow: /
User-agent: WebPix Disallow: /
User-agent: WebReaper Disallow: /
User-agent: WebSauger Disallow: /
User-agent: Webshag Disallow: /
User-agent: Website Quester Disallow: /
User-agent: WebsiteExtractor Disallow: /
User-agent: WebsiteQuester Disallow: /
User-agent: Webster Disallow: /
User-agent: WebStripper Disallow: /
User-agent: WebStripper Disallow: /
User-agent: WebSucker Disallow: /
User-agent: WebWhacker Disallow: /
User-agent: WebZIP Disallow: /
User-agent: WebZIP Disallow: /
User-agent: WeSEE Disallow: /
User-agent: WeSEE:Search Disallow: /
User-agent: wget Disallow: /
User-agent: Whack Disallow: /
User-agent: Whacker Disallow: /
User-agent: Whatweb Disallow: /
User-agent: Who.is Bot Disallow: /
User-agent: Widow Disallow: /
User-agent: WinHTTrack Disallow: /
User-agent: WiseGuys Robot Disallow: /
User-agent: WISENutbot Disallow: /
User-agent: Wonderbot Disallow: /
User-agent: Woobot Disallow: /
User-agent: Wotbot Disallow: /
User-agent: Wotbox Disallow: /
User-agent: Wprecon Disallow: /
User-agent: WPScan Disallow: /
User-agent: WWW-Collector-E Disallow: /
User-agent: WWW-Mechanize Disallow: /
User-agent: WWW::Mechanize Disallow: /
User-agent: WWWOFFLE Disallow: /
User-agent: x09Mozilla Disallow: /
User-agent: x22Mozilla Disallow: /
User-agent: Xaldon WebSpider Disallow: /
User-agent: Xaldon_WebSpider Disallow: /
User-agent: Xenu Disallow: /
User-agent: Xenu Disallow: /
User-agent: xpymep1.exe Disallow: /
User-agent: Yahoo Pipes 1.0 Disallow: /
User-agent: Yasni Disallow: /
User-agent: Yisouspider Disallow: /
User-agent: YoudaoBot Disallow: /
User-agent: Zade Disallow: /
User-agent: Zao Disallow: /
User-agent: Zauba Disallow: /
User-agent: zauba.io Disallow: /
User-agent: Zealbot Disallow: /
User-agent: Zermelo Disallow: /
User-agent: Zeus Disallow: /
User-agent: zgrab Disallow: /
User-agent: Zitebot Disallow: /
User-agent: ZmEu Disallow: /
User-agent: ZumBot Disallow: /
User-agent: ZyBorg Disallow: /

###################################################
#                                                 #
#            FIN robots No permitidos             #
#                                                 #
###################################################
#
#
#
#
#             _______  _                      
#            (  ____ \( \                     
#            | (    \/| (                     
#            | (__    | |                     
#            |  __)   | |                     
#            | (      | |                     
#            | (____/\| (____/\               
#            (_______/(_______/               
#                                             
# _______  _______  ______   _______  _______ 
#(  ____ \(  ___  )(  ___ \ (  ____ \(  ____ )
#| (    \/| (   ) || (   ) )| (    \/| (    )|
#| (_____ | (___) || (__/ / | (__    | (____)|
#(_____  )|  ___  ||  __ (  |  __)   |     __)
#      ) || (   ) || (  \ \ | (      | (\ (   
#/\____) || )   ( || )___) )| (____/\| ) \ \__
#\_______)|/     \||/ \___/ (_______/|/   \__/
#                                             
#             _        _______                
#            ( (    /|(  ___  )               
#            |  \  ( || (   ) |               
#            |   \ | || |   | |               
#            | (\ \) || |   | |               
#            | | \   || |   | |               
#            | )  \  || (___) |               
#            |/    )_)(_______)               
#                                             
# _______  _______           _______  _______ 
#(  ___  )(  ____ \|\     /|(  ____ )(  ___  )
#| (   ) || (    \/| )   ( || (    )|| (   ) |
#| |   | || |      | |   | || (____)|| (___) |
#| |   | || |      | |   | ||  _____)|  ___  |
#| |   | || |      | |   | || (      | (   ) |
#| (___) || (____/\| (___) || )      | )   ( |
#(_______)(_______/(_______)|/       |/     \|
#                                             
# _                 _______  _______  _______ 
#( \      |\     /|(  ____ \(  ___  )(  ____ )
#| (      | )   ( || (    \/| (   ) || (    )|
#| |      | |   | || |      | (___) || (____)|
#| |      | |   | || | ____ |  ___  ||     __)
#| |      | |   | || | \_  )| (   ) || (\ (   
#| (____/\| (___) || (___) || )   ( || ) \ \__
#(_______/(_______)(_______)|/     \||/   \__/
#                                             
#
#
#
#
#
#
Juan Luis Martel | WordPress Las Palmas
Creado por:
Juan Luis Martel
Experto en programación en Wordpress, Php, Pic, Microcontroller, ASM.
Escrito el:
Actualizado el:

¡No te vayas sin valorar el contenido!

¡Haz clic en una estrella para puntuarlo!

Promedio de puntuación 5 / 5. Recuento de votos: 2

Hasta ahora, ¡no hay votos!. Sé el primero en puntuar este contenido.

Ya que has encontrado útil el contenido...

🙏 Ayúdame y compártelo en tus redes sociales ¡Significa mucho para mí! - Gracias

¡Siento que el contenido no te haya sido útil o gustado! 😔

¡Déjame mejorar este contenido!

Dime, ¿cómo crees que puedo mejorar este contenido? 🙏 ¡Significa mucho para mí! - Gracias

Deja un comentario

Seo en WordPress

Nombre de extensiones para seguimiento de descargas en Analytics

Nombre de las extensiones que se consideran una descarga en Google Analytics

como crear un csv con todos los enlaces saliente que hay en una pagina

¿Como crear un CSV desde PHP con todos los enlaces salientes de una URL o pagina web?

×
Selecciona tus preferencias de cookies.
Nosotros y nuestros proveedores de servicios (incluido Google) almacenamos y accedemos a información en su navegador, tales como cookies y archivos similares. Algunas de estas cookies o archivos son necesarios para el correcto funcionamiento de esta Web, otros se emplean con fines estadísticos, para ofrecerte una experiencia personalizada y para mostrarte publicidad relacionada con tus hábitos de navegación en internet. Al hacer click en «Aceptar Cookies» estarás aceptando la instalación de todas estas cookies. Si haces click en «Rechazar Cookies» estarás aceptando la instalación solo de las cookies técnicas. Si lo deseas, puedes configurar o rechazar el uso de todas o de algunas de estas cookies pulsando en el botón «Configuración de Cookies», o desde tu navegador. Puedes obtener más información sobre el uso y tus derecho en la política de cookies.
Configuración de cookies Continuar sin aceptar Aceptar cookies
Selecciona tus preferencias de cookies.
Elige qué tipo de cookies quieres aceptar.
Tu elección te permitirá usar este Portal Web con todas las características o no y será guardada durante un año o hasta que las borres en tu navegador.
Las puedes volver ajustar desde el menu inferior en «Configuración de Cookies». Puedes obtener más información sobre el uso y tus derecho en la política de cookies.
Guardar configuración Continuar sin aceptar Aceptar cookies