Designing Interactions with Generative AI for Art and Creativity: A Systematic Review and Taxonomy

TY - CHAP

T1 - Designing Interactions with Generative AI for Art and Creativity: A Systematic Review and Taxonomy

AU - Hu, Xi

AU - Xing, Yiwen

AU - Cai, Xudong

AU - Zhao, Yihang

AU - Cook, Michael

AU - Borgo, Rita

AU - Neate, Timothy

PY - 2025/6/2

Y1 - 2025/6/2

N2 - Generative Artificial Intelligence (GenAI) applications in artistic and creative domains have gained substantial attention of late. These intelligent interactive systems, shaped by innovations in Large Language Models (LLMs) and Vision Language Models (VLMs), are materially impacting digital creative domains. While initial work to understand this space has highlighted new models and architectures, we lack a holistic view of how interactive GenAI systems are designed for user interactions across various artistic and creative domains. In this paper, we present a systematic review of interactive GenAI system designs for art and creativity in the HCI literature (N = 189), and a detailed taxonomy of interaction paradigms with design components. We shed light on the communities of design focus and decompose the system interaction designs, mapping these characteristics to creative domains, user interaction patterns, GenAI technologies, detailing under-represented spaces, and future directions of designing interactions for GenAI creativity.

AB - Generative Artificial Intelligence (GenAI) applications in artistic and creative domains have gained substantial attention of late. These intelligent interactive systems, shaped by innovations in Large Language Models (LLMs) and Vision Language Models (VLMs), are materially impacting digital creative domains. While initial work to understand this space has highlighted new models and architectures, we lack a holistic view of how interactive GenAI systems are designed for user interactions across various artistic and creative domains. In this paper, we present a systematic review of interactive GenAI system designs for art and creativity in the HCI literature (N = 189), and a detailed taxonomy of interaction paradigms with design components. We shed light on the communities of design focus and decompose the system interaction designs, mapping these characteristics to creative domains, user interaction patterns, GenAI technologies, detailing under-represented spaces, and future directions of designing interactions for GenAI creativity.

KW - Generative AI

KW - art

KW - creativity

KW - systematic review

KW - taxonomy

M3 - Conference paper

BT - Designing Interactive Systems Conference (DIS '25)

PB - ACM

CY - July 5–9, 2025, Funchal, Portugal

ER -