Awesome Multimodal Time Series Analysis

A curated list of paper, code, data, and other resources focus on multimodal time series analysis.

🚀 This repo will be continuously updated.
⭐️ Please Star it if you find it helpful!
🤝 Feel free to submit a PR or open an issue with suggestions or improvements.

---

Table of Contents

• Time Series Forecasting
• Time Series Reasoning
• Time Series Captioning
• Time Series Alignment

---

Time Series Forecasting

Title	Venue	Month	Code
ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data	AAAI	2024.12	Github
Multi-Modal Forecaster: Jointly Predicting Time Series and Textual Data	arXiv	2024.11	Github
From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflection	NeurIPS	2024.09	Github
Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysis	NeurIPS	2024.06	Github
Beyond Trend and Periodicity: Guiding Time Series Forecasting with Textual Cues	arXiv	2024.05	Github
Language Models Still Struggle to Zero-shot Reason about Time Series	arXiv	2024.04	Github
Towards Explainable Traffic Flow Prediction with Large Language Models	arXiv	2024.04	Github
GPT4MTS: Prompt-Based Large Language Model for Multimodal Time-Series Forecasting	AAAI	2024.03	Github

Time Series Reasoning

Title	Venue	Month	Code
ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data	AAAI	2024.12	Github
ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning	arXiv	2024.12	Github
A Picture is Worth A Thousand Numbers: Enabling LLMs Reason about Time Series via Visualization	arXiv	2024.11	Github
TimeSeriesExam: A Time Series Understanding Exam	arXiv	2024.10	HuggingFace
Beyond Forecasting: Compositional Time Series Reasoning for End-to-End Task Execution	arXiv	2024.10	None
Towards Time Series Reasoning with LLMs	arXiv	2024.09	None
Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmark	arXiv	2024.04	None
Language Models Still Struggle to Zero-shot Reason about Time Series	arXiv	2024.04	Github

Time Series Captioning

Title	Venue	Month	Code
Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotation	arXiv	2024.10	None
Towards Time Series Reasoning with LLMs	arXiv	2024.09	None

Time Series Alignment

Title	Venue	Month	Code
CLaSP: Learning Concepts for Time-Series Signals from Natural Language Supervision	arXiv	2024.11	None