Abstract
The shift from statistical models to large foundation models, reinforcement-learning policies, and agentic systems in investment management has outpaced the diagnostic vocabulary that allocators bring to manager selection. Existing artifacts approach the problem from four sides — manager-side model validation, allocator-side AI-claim detection, firm-side governance, and trading-system-side backtest hygiene — but none integrates them into a single, falsifiable, per-strategy diagnostic that an allocator can apply at the manager-selection layer.
SPEC — Specification, Performance diagnosis, Explanation capability, Configuration sensitivity — is a four-axis, architecture-agnostic, falsifiable due-diligence framework that resolves to a Y/N verdict per axis. For each axis the protocol defines a falsifiable test, cites 2–3 exemplar papers documenting the failure mode the test catches, and maps the axis to existing regulatory vocabulary (IOSCO PD684/788, SR 26-2, BoE-PRA SS1/23, ESMA Algo-Trading Briefing 2026, MAS FEAT + Veritas + MindForge, CFA Ethics & AI). Four anonymized audit case studies — one per axis — show what allocators would have approved without SPEC and what they declined with it. The appendix is a 68-question diagnostic library mapped to the four axes, intended for direct paste into IC memos and DDQs.
v1 artifacts
v1 — Full protocol
Paper · appendices · bibliographyConsolidated single-file paper (§1 diagnostic gap; §2 four-axis protocol; §3 four case studies; §4 regulatory mapping; §5 limits), Appendix A 68-question diagnostic library, Appendix B scoring sheet and replication pseudocode, and the bibliography.
About
Author · reviewers · positioningMethodology positioning, author, acknowledged reviewer slate, and the open-contribution and supervisory-and-self-regulatory adoption pathways §5 enumerates.
Changelog
v1 · v2 · …Version history under the §2.0 versioning convention. Successor calibrations are commit-pinned and published with dated rubric specifications.
Research Catalog
Evidence map · four axesEverything that breaks an AI investment manager, mapped to the research — an evidence map of documented failure modes organized by SPEC's four axes, each row anchored to its source.
The SPEC Test — four questions for your next manager meeting
The protocol on this page is the academic v1 reference: a per-strategy falsifiable rubric for an audit team. The CFA-published consumer-grade SPEC Test is the lighter-weight, plain-language entry point — four questions, ten minutes to apply, designed for the manager meeting before the audit.
Read the SPEC TestCitation
Maricic, M. (2026). Evaluating AI-Driven Investment Strategies: A Diagnostic Protocol for Allocators. SPEC v1.1 (working draft, 2026-05-28). https://www.milosmaricic.com/spec. CC-BY 4.0.
Licence
SPEC v1 is published under the Creative Commons Attribution 4.0 International License (CC-BY 4.0). The protocol, the diagnostic-question library (Appendix A), the scoring sheet and replication pseudocode (Appendix B), the bibliography, and the consolidated draft are all published under CC-BY 4.0 as the open-standard commitment specified in §5.4.
Users may share and adapt the work for any purpose, including commercially, subject to the attribution requirement. Pull requests, calibration revisions, and adjacent-architecture extensions are welcomed; substantive revisions follow the §2.0 successor-version convention rather than the in-place revision pathway.
Canonical deed text: /spec/LICENSE