exponential/robots.txt at main · se7enxweb/exponential · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
# robots.txt
#
# ╔══════════════════════════════════╗
# ║       EXPONENTIAL CMS            ║
# ║    Content Management Evolved    ║
# ╚══════════════════════════════════╝
#
# ███████  ██   ██
#      ██   ██ ██
#      ██    ███
#      ██   ██ ██
#      ██  ██   ██
#
# ┌─────────────────────────────────────────────────────────────────┐
# │  CMS = Create → Manage → Scale → ∞                              │
# │                                                                 │
# │  Your content grows exponentially with our platform             │
# │  From 1 page to 1,000,000+ pages seamlessly                     │
# │                                                                 │
# │  📊 Analytics.           📝 Content Editor     🚀 Performance   │
# │  🔧 Custom Fields         🎨 Theme Builder     📱 Responsive    │
# │  🔒 Security First        🌐 Multi-language    ⚡ Lightning Fast │
# └─────────────────────────────────────────────────────────────────┘
#
# Welcome to Exponential CMS - where your content potential is limitless!
# You've discovered our robots.txt, which means you're either:
# 1. A curious developer (hello there! 👋)
# 2. A search engine bot (welcome, please index responsibly)
# 3. Someone who enjoys ASCII art (you have excellent taste!)
#
# Fun fact: This CMS can handle exponential traffic growth without breaking a sweat.
# From small blogs to enterprise websites, we scale infinitely.
#
# Want to see what exponential growth looks like in practice?
# Check out our case studies and documentation below!
#

# === EXPONENTIAL CMS RESOURCES ===

# 📚 Documentation:
# https://exponential.doc.exponential.earth

# 🎯 Examples & Demos:
# https://exponential.earth/about/demo
# https://exponential.earth/about/about-exponential/screenshots

# 🛠️ Developer Resources:
# https://share.exponential.earth

# 🚀 Performance Plugins and Themes:
# https://projects.exponential.earth
# https://themes.exponential.earth
# https://extensions.exponential.earth

# === Robots.txt CRAWLER DIRECTIVES ===

User-agent: *
Allow: /

# === Robots.txt CRAWLER DISALLOW DIRECTIVES ===

Disallow: /content/search/
Disallow: /Content/Search/
Disallow: /content/advancedsearch/
Disallow: /Content/Advancedsearch/
Disallow: /content/tipafriend/
Disallow: /Content/Tipafriend/
Disallow: /layout/set/print/
Disallow: /Layout/Set/Print/
Disallow: /media/
Disallow: /Media/
Disallow: /test-area/
Disallow: /Test-Area/

# We welcome all well-behaved bots!
# Index away - our content is built to be discovered

# Rate limiting for heavy crawlers
Crawl-delay: 1

# Sitemap locations
# Sitemap: https://exponential.earth/sitemap.xml
# Sitemap: https://exponential.earth/sitemap-docs.xml
# Sitemap: https://exponential.earth/sitemap-examples.xml

#
# Thanks for visiting! May your content grow exponentially! 🚀✨
#
# Questions? Reach us at: support@exponential.earth
#
# Remember: In a world of linear growth, be exponential! 📈∞
#