SS2 - Multimodal AI-Mediated Interaction for
Cross-Disciplinary Design Collaboration
Click
here
to download the CFP file.
Design collaboration in complex engineering, urban planning, and product development
increasingly
involves heterogeneous disciplinary teams working with AI-generated multimedia artifacts
—images, physiological biosignals, semantic vectors — as shared mediating objects. Yet existing
multimedia systemsresearch treats these modalities separately: generative AI for creative
ideation, physiological sensing for
affective computing, and semantic processing for coordination tracking are each active subfields
withnointegrating framework.
Topics of Interest
The session invites original research contributions on the following topics:
Generative AI and Visual Mediation in Collaboration
- Text-to-image generation as alignment instruments in multi-stakeholder design
- Image specificity, ambiguity, and their effects on semantic convergence trajectories
- AI-generated images as boundary objects in participatory and cross-disciplinary design
- Trajectory-level analysis of visual mediation effects across iterative cycles
Multimodal Affective Sensing for Collaborative Systems
- Wearable physiological sensing (HRV, EDA, ECG) for real-time affective state monitoring
inteamsettings
- Fusion of semantic and physiological signals for coordination assessment
- Temporal relationships between affective and cognitive coordination dynamics
- Affective feedback display design for collaborative environments
Computational Frameworks for Coordination Assessment
- Semantic embedding methods (BERT,
SBERT, CLIP) for measuring cross-disciplinary alignment
- oordination metrics and
indices for iterative design collaboration
- Trajectory classification: monotonic convergence, delayed convergence, stable
non-convergence
- Decision support systems for early-stage engineering design under
semantic heterogeneity
Human-AI Co-Ideation and Collaborative Creativity
- Human-AI co-creation systems for design ideation and concept exploration
- Tracking the evolution of design ideas across iterative human-AI cycles
- Effects of generative AI on design fixation and divergent thinking
- Interaction design principles for AI-assisted cross-disciplinary teams