multimodal

  • 详情 Financializing Compute: The Design of AI Service Trade Markets
    The global AI inference market—reaching approximately $90–100 billion annually and growing at 18% CAGR—operates without organized exchange infrastructure. We document three market failures: resource misallocation (80% of China’s newly built compute capacity sits idle), price opacity (100-fold price dispersion across providers of equivalent quality), and unhedged risk exposure (85% of enterprises miss AI cost forecasts by more than 10%). Following the market design tradition of Roth [2002] and Budish et al. [2015], we propose the AI Service Right (ASR) as a transferable property right on AI compute and the AI Service Unit (ASU) as a quality-adjusted, cross-platform unit of account grounded in hedonic price theory [Rosen, 1974]. The ASU is modality-neutral: billing prices across text, image, video, and speech modalities are unified via eq-token conversion factors (κimg ≈ 2,667 eq-tokens per image; κvid ≈ 2,667 per second of video; κspc ≈ 7 per second of audio), and modality-appropriate benchmark sets (MMLU/HumanEval for language; FID/CLIP Score for image; FVD/CLIPSIM for video; MMBench for multimodal) supply the quality in dex via PCA. We design a hybrid secondary market architecture synthesizing mechanisms from four orthogonal market traditions: foreign exchange markets (cross-platform exchange rates and PPP-analog arbitrage via the ASU); equity markets (Central Limit Order Book, market making, clearing); electricity markets (Compute Locational Marginal Pricing for spatial scarcity signals); and decentralized finance (Automated Market Maker for long-tail liquidity). We establish nine formal propositions: bilateral trading is generically inefficient; Compute Locational Marginal Pricing decomposes nodal prices into system marginal cost, capacity congestion, and bandwidth premia; no-arbitrage equi librium holds with capital constraints (extending Shleifer and Vishny 1997); the ASR market Pareto-improves over bilateral trading; market prices are more in formative under ASR; the hybrid CLOB-AMM architecture weakly dominates either mechanism alone; platform adoption admits multiple equilibria with a coordination trap; financialization may improve or reduce price informativeness depending on speculator-hedger composition; and a hedonic micro-foundation justifies the ASU definition. Calibrated agent-based simulation (500 steps, 30 Monte Carlo runs) provides computational validation: the hybrid architecture reduces price dispersion by 90% relative to bilateral trading, and order-of-magnitude welfare estimates suggest enterprise procurement cost savings of 0.2–20% (net of ASR transaction costs; see Table 7) and potential TFP gains from compute reallocation of up to $29.9 billion annually. We propose a phased implementation roadmap from shadow ledger to full financialization, and we engage critically with the concern that financialization may not reduce intermediation costs [Philippon, 2015].
  • 详情 Emotions and Fund Flows: Evidence from Managers' Live Streams
    Do investors respond to what fund managers say, or how they look saying it? Using 2,000 live-streamed sessions by Chinese ETF managers and multimodal machine learning, we show that managers’ facial expressions, not their words, drive fund flows. A one-standard-deviation increase in positive facial affect raises next-day flows by 0.17pp (260% of mean). Vocal tone shows weak effects; textual sentiment shows none. Critically, facial expressions predict flows but not returns, indicating pure persuasion rather than information transmission. Effects strengthen when investors are emotionally vulnerable (down markets, retail-heavy funds) and persist 2-3 weeks before dissipating. Our findings challenge the emphasis on textual disclosure in finance and raise questions about investor protection as video communication proliferates.
  • 详情 基于多模态混合专家模型的汽车金融信用风险评估实证研究
    随着汽车金融下沉市场的拓展与多源异构数据的爆发,传统信用评分模型在兼顾预测精度与特定场景泛化能力时遭遇瓶颈。本文提出一种基于多模态混合专家模型(Multimodal Mixture of Experts, MMoE)的深度风控框架。该框架依托企业级AI中台,通过动态门控网络(Gating Network)将借款人的结构化征信、非结构化文本语义及动态行为特征智能路由至专属专家网络。基于 LendingClub 公开数据集的实证研究(有效映射汽车金融多模态场景)表明,MMoE 模型在 AUC 与 KS 指标上显著优于 LightGBM 等主流基准模型,且其期望校准误差(ECE)降至 0.015。研究证实,门控路由机制不仅提升了长尾人群的逾期预测准度,更为深度学习在金融领域的应用提供了宏观可解释性视角。本研究为金融机构构建高并发、易扩展的下一代智能风控底座提供了系统性的工程路径与理论支撑。
  • 详情 A multifactor model using large language models and investor sentiment from photos and news: new evidence from China
    This study introduces an innovative approach for constructing multimodal investor sentiment indices and explores their varying impacts on stock market returns. We employ the RoBERTa model to quantify text-based sentiment, the Google Inception(v3) model for image-based sentiment measurement, and a multimodal semantic correlation fusion model to comprehensively consider the interplay between textual and visual sentiment features. These sentiment indices are further categorised into industry-specific investor sentiment and market-wide investor sentiment, enabling separate analyses of their effects on stock markets. Furthermore, we leverage these indices to build a multifactor stock selection model and timing strategies. Our research findings demonstrate that multimodal sentiment analysis yields superior predictive accuracy. Industry-specific investor sentiment exerts bidirectional positive influences on stock market returns, whereas market-wide investor sentiment indices exhibit unidirectional impacts. Integrating industry-specific investor sentiment into our multifactor stock selection model effectively enhances portfolio returns. Furthermore, combining market-wide investor sentiment with timing strategy optimisation further augments this advantage.
  • 详情 Quantum Probability Theoretic Asset Return Modeling: A Novel Schrödinger-Like Trading Equation and Multimodal Distribution
    Quantum theory provides a comprehensive framework for quantifying uncertainty, often applied in quantum finance to explore the stochastic nature of asset returns. This perspective likens returns to microscopic particle motion, governed by quantum probabilities akin to physical laws. However, such approaches presuppose specific microscopic quantum effects in return changes, a premise criticized for lack of guarantee. This paper diverges by asserting that quantum probability is a mathematical extension of classical probability to complex numbers. It isn’t exclusively tied to microscopic quantum phenomena, bypassing the need for quantum effects in returns.By directly linking quantum probability’s mathematical structure to traders’ decisions and market behaviors, it avoids assuming quantum effects for returns and invoking the wave function. The complex phase of quantum probability, capturing transitions between long and short decisions while considering information interaction among traders, offers an inherent advantage over classical probability in characterizing the multimodal distribution of asset returns.Utilizing Fourier decomposition, we derive a Schr¨odinger-like trading equation, where each term explicitly corresponds to implications of market trading. The equation indicates discrete energy levels in financial trading, with returns following a normal distribution at the lowest level. As the market transitions to higher trading levels, a phase shift occurs in the return distribution, leading to multimodality and fat tails. Empirical research on the Chinese stock market supports the existence of energy levels and multimodal distributions derived from this quantum probability asset returns model.