My paper Three Stage Drawing Transfer has been published by Proceedings of the ACM on Computer Graphics and Interactive Techniques. I presented this at SIGGRAPH 2022 in Vancouver BC as part of the Art Papers program. It explores creative AI, human imagination, and embodied interaction through an interactive drawing performance.
Robert Twomey. 2022. Three Stage Drawing Transfer: Collaborative Drawing Between a Generative Adversarial Network, Co-robotic Arm, and Five-Year-Old Child. Proc. ACM Comput. Graph. Interact. Tech. 5, 4, Article 36 (September 2022), 7 pages. https://doi.org/10.1145/3533614
I presented Three Stage Drawing Transfer as part of the Demos program at ISEA 2022 in Barcelona, Spain. It was wonderful interacting with the attendees: we had great conversations about creative AI, child art, and human-robot interaction.
We will be presenting our Embodied Code project at CHI’22 as part of the Interactions program. In both online and in-person formats, we will demo the Embodied Coding Environment, and take participants through a short (5 minute) experience with the embodied coding system.
For the FLYOVER Summit at UNL (Ash Smith and Stephanie Sherman), we produced a speculative machine narrative of the event. We had 11 humans, 1 neural net, and billions of anonymous textual tokens to produce a machine narrative to accompany the talks throughout the day. An AI writer’s room.
The Rural AI took over the Carson Center feed for 9 hours on 10/21. Find our micro-narratives and speculative vignettes between:
Start of event: https://twitter.com/carsoncenterunl/status/1451175473308790784
End of event: https://twitter.com/carsoncenterunl/status/1451302007403266060
Joel Ong, Eunsu Kang and I presented an an intervention for Politics of the Machines 2021 in Berlin. With three human and non-human pairs—Joel with his Euglena Gracilis (Emotional Sentiment/Light,Text), Eunsu with her Violet (Viola/Speech), and me with my text and image agent (GPT3 and CLIP/BigGAN/CMA-ES)—we discussed the machinic sublime in a performative roundtable.
I look forward to further development of these projects and ideas with the group.
Exploring Virtual Reality and Embodied Computational Reasoning
A workshop for ICER 2021, the ACM International Computing Education Research conference.
Date: Saturday, August 14, 11:00AM – 1PM PDT
Description: The increasing sophistication and availability of Augmented and Virtual Reality (AR/VR) technologies wield the potential to transform how we teach and learn computational concepts and coding. This workshop examines how AR/VR can be leveraged in computer science (CS) education within the context of embodied learning. It has been theorized that abstract computational concepts, such as data, operators, and loops, are grounded in embodied representations that arise from our sensorimotor experience of the physical world. For instance, researchers have shown that when CS students describe algorithms, conditionals, and other computational structures, they frequently gesture in ways that suggest they are conceptualizing interactions with tangible objects. Can learning to code become a more intuitive process if lessons take into account these types of embodied conceptual phenomena? This two-hour workshop explores 1) theories of embodiment and 2) new and existing tools and practices that support embodied CS learning — ranging from Papert’s LOGO turtles to a preview of an innovative 3D spatial coding platform for AR/VR under development by our group. Other open-source and commercially available resources will also be examined through streamed video demos and a hands-on break-out session for participants.