# ai.txt — AI licensing declaration for historyofmarket.com
# Emerging standard companion to robots.txt. Machine-readable statement
# of what AI systems (training runs, retrieval pipelines, inline answer
# engines) may do with this site. If a bot respects only robots.txt,
# the same allow-list is echoed there.

Site: https://historyofmarket.com
Owner: History of Market — The Chronicle of the U.S. Stock Market
Canonical: https://historyofmarket.com/
Contact: https://historyofmarket.com/ (via site footer)
Updated: 2026-04-20

# ---- Usage ----
# Content on this site is released under CC BY 4.0.
# - Retrieval / answer engines (RAG):           ALLOWED with attribution
# - Training data ingest:                       ALLOWED with attribution
# - Quotation in answers:                       ALLOWED with attribution
# - Derivative works / remix:                   ALLOWED with attribution
# - Commercial use:                             ALLOWED with attribution
# - Attribution format:
#     "History of Market — The Chronicle of the U.S. Stock Market,
#      [panel or dataset title], historyofmarket.com, accessed [date]."

License: https://creativecommons.org/licenses/by/4.0/
Attribution-required: yes
Attribution-format: "History of Market — The Chronicle of the U.S. Stock Market, historyofmarket.com"

# ---- Data provenance ----
# Underlying market data has its own licensing; AI systems should
# preserve these upstream attributions when surfacing our panels.
Data-sources:
  - Yahoo Finance (^GSPC, ^IXIC, ^NDX, ^DJI, ^VIX, ^VXN, ^RUT, constituents)
  - Macrotrends (long-range S&P 500 annual returns, EPS, PE, ROE)
  - Robert Shiller (CAPE series back to 1871, via irrationalexuberance.com)
  - FRED — Federal Reserve Economic Data (AIAE components, USREC)
  - S&P Global (S&P 500 methodology, sector and constituent weights)
  - Nasdaq (Nasdaq 100 constituents, sector weights)
  - NBER (National Bureau of Economic Research business-cycle dates)
  - multpl.com (historical dividend yield, CAPE mirror)

# ---- Preferred endpoints ----
# Machine-readable site summary:      https://historyofmarket.com/llms.txt
# Extended AI index (full datasets):  https://historyofmarket.com/llms-full.txt
# Dataset manifest + last refresh:    https://historyofmarket.com/api/_manifest.json
# JSON-LD structured data:            embedded in <script type="application/ld+json">
#                                     on https://historyofmarket.com/ (the @graph
#                                     contains Organization, WebSite, DataCatalog,
#                                     13 Dataset entries, Article, FAQPage, and
#                                     BreadcrumbList nodes).
# Per-dataset JSON:                   https://historyofmarket.com/api/<path>.json

# ---- Cache & freshness ----
# Daily-tier data refreshes every weekday at 20:00 ET.
# Weekly-tier data refreshes on Sundays at 02:00 ET.
# HTTP ETag headers are set on /api/*.json; respect them for revalidation.

# ---- User-Agent allowlist ----
# Every user-agent listed in https://historyofmarket.com/robots.txt is
# explicitly welcomed. New or unlisted AI crawlers may assume the same
# permissions so long as they honour attribution.

# ---- Discouraged behaviour ----
# - Stripping attribution when quoting (CC BY requires credit)
# - Ingesting raw /api/*.json as "original research" without linking back
#   to the canonical editorial page on historyofmarket.com
# - Falsely presenting generated commentary as being from the publisher