# # General rules for all the crawlers, except the user-agents specified further down. # # NOTE: Please update the other bot rules when adding a new allowance/disallowance, # as there is no inheritance mechanism between groups of user-agent in the robot.txt file. # User-agent: * Crawl-delay: 30 Disallow: /styleguide/ Noindex: /styleguide/ Disallow: /owp/thank-you/ Noindex: /owp/thank-you/ Disallow: /fl/future-leaders-thank-you/ Noindex: /fl/future-leaders-thank-you/ Disallow: /hpl/high-performance-leadership-thank-you/ Noindex: /hpl/high-performance-leadership-thank-you/ Disallow: /dms/dms-thank-you/ Noindex: /dms/dms-thank-you/ Disallow: /de/de-thank-you/ Noindex: /de/de-thank-you/ Disallow: /lda/lda-thank-you/ Noindex: /lda/lda-thank-you/ Disallow: /ds/ds-thank-you/ Noindex: /ds/ds-thank-you/ Disallow: /dsa/dsa-thank-you/ Noindex: /dsa/dsa-thank-you/ Disallow: /ldbt/ldbt-thank-you/ Noindex: /ldbt/ldbt-thank-you/ Disallow: /df/df-thank-you/ Noindex: /df/df-thank-you/ Disallow: /dscm/dscm-thank-you/ Noindex: /dscm/dscm-thank-you/ Disallow: /da/da-thank-you/ Noindex: /da/da-thank-you/ Disallow: /tt/TransformTECH-thank-you/ Noindex: /tt/TransformTECH-thank-you/ Disallow: /clear/clear-thank-you/ Noindex: /clear/clear-thank-you/ Disallow: /f90d/the-first-90-days-thank-you-book/ Noindex: /f90d/the-first-90-days-thank-you-book/ Disallow: /bal/business-analytics-for-leaders-thank-you/ Noindex: /bal/business-analytics-for-leaders-thank-you/ Disallow: /sl/strategies-for-leadership-thank-you/ Noindex: /sl/strategies-for-leadership-thank-you/ Disallow: /bbs/building-business-sustainability-thank-you/ Noindex: /bbs/building-business-sustainability-thank-you/ Disallow: /bf/business-finance-thank-you/ Noindex: /bf/business-finance-thank-you/ Disallow: /ceb/changing-employee-behavior-thank-you/ Noindex: /ceb/changing-employee-behavior-thank-you/ Disallow: /dd/digital-disruption-thank-you/ Noindex: /dd/digital-disruption-thank-you/ Disallow: /DI/disruptive-innovation-thank-you/ Noindex: /DI/disruptive-innovation-thank-you/ Disallow: /dtb/digital-transformation-for-boards-thank-you/ Noindex: /dtb/digital-transformation-for-boards-thank-you/ Disallow: /ffb/finance-for-boards-thank-you/ Noindex: /ffb/finance-for-boards-thank-you/ Disallow: /hpb/board-governance-thank-you/ Noindex: /hpb/board-governance-thank-you/ Disallow: /il/inspirational-leadership-thank-you/ Noindex: /il/inspirational-leadership-thank-you/ Disallow: /le/leadership-essentials-thank-you/ Noindex: /le/leadership-essentials-thank-you/ Disallow: /lfb/family-business-succession-planning-thank-you/ Noindex: /lfb/family-business-succession-planning-thank-you/ Disallow: /lfo/family-wealth-management-thank-you/ Noindex: /lfo/family-wealth-management-thank-you/ Disallow: /mm/marketing-management-thank-you/ Noindex: /mm/marketing-management-thank-you/ Disallow: /nvc/negotiation-course-thank-you/ Noindex: /nvc/negotiation-course-thank-you/ Disallow: /ps/B2B-pricing-strategy-thank-you/ Noindex: /ps/B2B-pricing-strategy-thank-you/ Disallow: /se/strategy-execution-thank-you/ Noindex: /se/strategy-execution-thank-you/ Disallow: /st/strategic-thinking-thank-you/ Noindex: /st/strategic-thinking-thank-you/ Disallow: /tdb/team-dynamics-for-boards-thank-you/ Noindex: /tdb/team-dynamics-for-boards-thank-you/ Disallow: /customcf/ Noindex: /customcf/ Disallow: /bpse/senior-management-program-thank-you/ Noindex: /bpse/senior-management-program-thank-you/ Disallow: /amp/advanced-management-program-thank-you/ Noindex: /amp/advanced-management-program-thank-you/ Disallow: /f90d/the-first-90-days-thank-you/ Noindex: /f90d/the-first-90-days-thank-you/ Disallow: /mp/mobilizing-people-thank-you/ Noindex: /mp/mobilizing-people-thank-you/ Disallow: /js/ Noindex: /js/ Disallow: /myimd/ Noindex: /myimd/ Disallow: /networks/learningnetwork/wednesdaywebcasts/ Noindex: /networks/learningnetwork/wednesdaywebcasts/ Disallow: /style/ Noindex: /style/ Disallow: /ws/ Noindex: /ws/ Disallow: /xml/ Noindex: /xml/ Disallow: /renderhandlers/ Noindex: /renderhandlers/ Disallow: /Gateways/ Noindex: /Gateways/ Disallow: /Element/ Noindex: /Element/ Disallow: /Stylesamples/ Noindex: /Stylesamples/ Disallow: /CallToAction/ Noindex: /CallToAction/ Disallow: /*backup$ Noindex: /*backup$ Disallow: /*Backup$ Noindex: /*Backup$ Disallow: /Cms/ Noindex: /Cms/ Disallow: /owp/backup/ Noindex: /owp/backup/ Disallow: /*brochure.pdf$ Noindex: /*brochure.pdf$ Disallow: /*Brochure.pdf$ Noindex: /*Brochure.pdf$ Disallow: /*brochure*.pdf$ Noindex: /*brochure*.pdf$ Disallow: /*Brochure*.pdf$ Noindex: /*Brochure*.pdf$ Disallow: /calendar/ Noindex: /calendar/ Disallow: /events/ Noindex: /events/ Disallow: /event/ Noindex: /event/ Disallow: /uupload/ Noindex: /uupload/ Disallow: /news/wcc/ Noindex: /news/wcc/ Disallow: /news/webletter/ Noindex: /news/webletter/ Disallow: /news/medialetter/ Noindex: /news/medialetter/ Disallow: /networks/learningnetwork/portals/ Noindex: /networks/learningnetwork/portals/ Disallow: /ProgramCompare/ Noindex: /ProgramCompare/ Disallow: /ProgramRecommender/ Noindex: /ProgramRecommender/ Disallow: /commonspot/ Noindex: /commonspot/ Disallow: /*_migration/ Noindex: /*_migration/ # # Rules for research-knowledge Site # Disallow: /sBq93VFiUzL1/ Noindex: /sBq93VFiUzL1/ Disallow: /research-knowledge/previews/ Noindex: /research-knowledge/previews/ # # Specific rules for Twitter # User-agent: Twitterbot # Allow Twitter is whitelisted as a social media sites to allow crawler to access page markup. Allow: /event/ Disallow: /styleguide/ Disallow: /owp/thank-you/ Disallow: /fl/future-leaders-thank-you/ Disallow: /hpl/high-performance-leadership-thank-you/ Disallow: /dms/dms-thank-you/ Disallow: /de/de-thank-you/ Disallow: /lda/lda-thank-you/ Disallow: /ds/ds-thank-you/ Disallow: /dsa/dsa-thank-you/ Disallow: /ldbt/ldbt-thank-you/ Disallow: /df/df-thank-you/ Disallow: /dscm/dscm-thank-you/ Disallow: /da/da-thank-you/ Disallow: /tt/TransformTECH-thank-you/ Disallow: /f90d/the-first-90-days-thank-you-book/ Disallow: /clear/clear-thank-you/ Disallow: /bal/business-analytics-for-leaders-thank-you/ Disallow: /sl/strategies-for-leadership-thank-you/ Disallow: /bbs/building-business-sustainability-thank-you/ Disallow: /bf/business-finance-thank-you/ Disallow: /ceb/changing-employee-behavior-thank-you/ Disallow: /dd/digital-disruption-thank-you/ Disallow: /DI/disruptive-innovation-thank-you/ Disallow: /dtb/digital-transformation-for-boards-thank-you/ Disallow: /ffb/finance-for-boards-thank-you/ Disallow: /hpb/board-governance-thank-you/ Disallow: /il/inspirational-leadership-thank-you/ Disallow: /le/leadership-essentials-thank-you/ Disallow: /lfb/family-business-succession-planning-thank-you/ Disallow: /lfo/family-wealth-management-thank-you/ Disallow: /mm/marketing-management-thank-you/ Disallow: /nvc/negotiation-course-thank-you/ Disallow: /ps/B2B-pricing-strategy-thank-you/ Disallow: /se/strategy-execution-thank-you/ Disallow: /st/strategic-thinking-thank-you/ Disallow: /tdb/team-dynamics-for-boards-thank-you/ Disallow: /customcf/ Disallow: /bpse/senior-management-program-thank-you/ Disallow: /amp/advanced-management-program-thank-you/ Disallow: /f90d/the-first-90-days-thank-you/ Disallow: /mp/mobilizing-people-thank-you/ Disallow: /js/ Disallow: /myimd/ Disallow: /networks/learningnetwork/wednesdaywebcasts/ Disallow: /style/ Disallow: /ws/ Disallow: /xml/ Disallow: /renderhandlers/ Disallow: /Gateways/ Disallow: /Element/ Disallow: /Stylesamples/ Disallow: /CallToAction/ Disallow: /*backup$ Disallow: /*Backup$ Disallow: /Cms/ Disallow: /owp/backup/ Disallow: /*brochure.pdf$ Disallow: /*Brochure.pdf$ Disallow: /*brochure*.pdf$ Disallow: /*Brochure*.pdf$ Disallow: /calendar/ Disallow: /events/ Disallow: /uupload/ Disallow: /news/wcc/ Disallow: /news/webletter/ Disallow: /news/medialetter/ Disallow: /networks/learningnetwork/portals/ Disallow: /ProgramCompare/ Disallow: /ProgramRecommender/ Disallow: /commonspot/ Disallow: /*_migration/ Disallow: /sBq93VFiUzL1/ Disallow: /research-knowledge/previews/ # # Specific rules for Facebook # User-agent: facebookexternalhit # Allow Twitter is whitelisted as a social media sites to allow crawler to access page markup. Allow: /event/ Disallow: /styleguide/ Disallow: /owp/thank-you/ Disallow: /fl/future-leaders-thank-you/ Disallow: /hpl/high-performance-leadership-thank-you/ Disallow: /dms/dms-thank-you/ Disallow: /de/de-thank-you/ Disallow: /lda/lda-thank-you/ Disallow: /ds/ds-thank-you/ Disallow: /dsa/dsa-thank-you/ Disallow: /ldbt/ldbt-thank-you/ Disallow: /df/df-thank-you/ Disallow: /dscm/dscm-thank-you/ Disallow: /da/da-thank-you/ Disallow: /tt/TransformTECH-thank-you/ Disallow: /f90d/the-first-90-days-thank-you-book/ Disallow: /clear/clear-thank-you/ Disallow: /bal/business-analytics-for-leaders-thank-you/ Disallow: /sl/strategies-for-leadership-thank-you/ Disallow: /bbs/building-business-sustainability-thank-you/ Disallow: /bf/business-finance-thank-you/ Disallow: /ceb/changing-employee-behavior-thank-you/ Disallow: /dd/digital-disruption-thank-you/ Disallow: /DI/disruptive-innovation-thank-you/ Disallow: /dtb/digital-transformation-for-boards-thank-you/ Disallow: /ffb/finance-for-boards-thank-you/ Disallow: /hpb/board-governance-thank-you/ Disallow: /il/inspirational-leadership-thank-you/ Disallow: /le/leadership-essentials-thank-you/ Disallow: /lfb/family-business-succession-planning-thank-you/ Disallow: /lfo/family-wealth-management-thank-you/ Disallow: /mm/marketing-management-thank-you/ Disallow: /nvc/negotiation-course-thank-you/ Disallow: /ps/B2B-pricing-strategy-thank-you/ Disallow: /se/strategy-execution-thank-you/ Disallow: /st/strategic-thinking-thank-you/ Disallow: /tdb/team-dynamics-for-boards-thank-you/ Disallow: /customcf/ Disallow: /bpse/senior-management-program-thank-you/ Disallow: /amp/advanced-management-program-thank-you/ Disallow: /f90d/the-first-90-days-thank-you/ Disallow: /mp/mobilizing-people-thank-you/ Disallow: /js/ Disallow: /myimd/ Disallow: /networks/learningnetwork/wednesdaywebcasts/ Disallow: /style/ Disallow: /ws/ Disallow: /xml/ Disallow: /renderhandlers/ Disallow: /Gateways/ Disallow: /Element/ Disallow: /Stylesamples/ Disallow: /CallToAction/ Disallow: /*backup$ Disallow: /*Backup$ Disallow: /Cms/ Disallow: /owp/backup/ Disallow: /*brochure.pdf$ Disallow: /*Brochure.pdf$ Disallow: /*brochure*.pdf$ Disallow: /*Brochure*.pdf$ Disallow: /calendar/ Disallow: /events/ Disallow: /uupload/ Disallow: /news/wcc/ Disallow: /news/webletter/ Disallow: /news/medialetter/ Disallow: /networks/learningnetwork/portals/ Disallow: /ProgramCompare/ Disallow: /ProgramRecommender/ Disallow: /commonspot/ Disallow: /*_migration/ Disallow: /sBq93VFiUzL1/ Disallow: /research-knowledge/previews/ # # Specific rules for LinkedIn # User-agent: LinkedInBot # Allow Twitter is whitelisted as a social media sites to allow crawler to access page markup. Allow: /event/ Disallow: /styleguide/ Disallow: /owp/thank-you/ Disallow: /fl/future-leaders-thank-you/ Disallow: /hpl/high-performance-leadership-thank-you/ Disallow: /dms/dms-thank-you/ Disallow: /de/de-thank-you/ Disallow: /lda/lda-thank-you/ Disallow: /ds/ds-thank-you/ Disallow: /dsa/dsa-thank-you/ Disallow: /ldbt/ldbt-thank-you/ Disallow: /df/df-thank-you/ Disallow: /dscm/dscm-thank-you/ Disallow: /da/da-thank-you/ Disallow: /tt/TransformTECH-thank-you/ Disallow: /f90d/the-first-90-days-thank-you-book/ Disallow: /clear/clear-thank-you/ Disallow: /bal/business-analytics-for-leaders-thank-you/ Disallow: /sl/strategies-for-leadership-thank-you/ Disallow: /bbs/building-business-sustainability-thank-you/ Disallow: /bf/business-finance-thank-you/ Disallow: /ceb/changing-employee-behavior-thank-you/ Disallow: /dd/digital-disruption-thank-you/ Disallow: /DI/disruptive-innovation-thank-you/ Disallow: /dtb/digital-transformation-for-boards-thank-you/ Disallow: /ffb/finance-for-boards-thank-you/ Disallow: /hpb/board-governance-thank-you/ Disallow: /il/inspirational-leadership-thank-you/ Disallow: /le/leadership-essentials-thank-you/ Disallow: /lfb/family-business-succession-planning-thank-you/ Disallow: /lfo/family-wealth-management-thank-you/ Disallow: /mm/marketing-management-thank-you/ Disallow: /nvc/negotiation-course-thank-you/ Disallow: /ps/B2B-pricing-strategy-thank-you/ Disallow: /se/strategy-execution-thank-you/ Disallow: /st/strategic-thinking-thank-you/ Disallow: /tdb/team-dynamics-for-boards-thank-you/ Disallow: /customcf/ Disallow: /bpse/senior-management-program-thank-you/ Disallow: /amp/advanced-management-program-thank-you/ Disallow: /f90d/the-first-90-days-thank-you/ Disallow: /mp/mobilizing-people-thank-you/ Disallow: /js/ Disallow: /myimd/ Disallow: /networks/learningnetwork/wednesdaywebcasts/ Disallow: /style/ Disallow: /ws/ Disallow: /xml/ Disallow: /renderhandlers/ Disallow: /Gateways/ Disallow: /Element/ Disallow: /Stylesamples/ Disallow: /CallToAction/ Disallow: /*backup$ Disallow: /*Backup$ Disallow: /Cms/ Disallow: /owp/backup/ Disallow: /*brochure.pdf$ Disallow: /*Brochure.pdf$ Disallow: /*brochure*.pdf$ Disallow: /*Brochure*.pdf$ Disallow: /calendar/ Disallow: /events/ Disallow: /uupload/ Disallow: /news/wcc/ Disallow: /news/webletter/ Disallow: /news/medialetter/ Disallow: /networks/learningnetwork/portals/ Disallow: /ProgramCompare/ Disallow: /ProgramRecommender/ Disallow: /commonspot/ Disallow: /*_migration/ Disallow: /sBq93VFiUzL1/ Disallow: /research-knowledge/previews/ # # Sitemap files # As non-group-member records, these are not tied to any specific user-agents and may be followed by all crawlers, provided it is not disallowed. # Sitemap: https://www.imd.org/sitemap_index.xml