All posts by Robert

SIGGRAPH SPARKS – Robotics, Electronics, AI

I spoke at the April 30, ACM SIGGRAPH Digital Arts Community SPARKS event on Robotics, Electronics, AI, moderated by Hye Yeon Nam and Jan Searleman.

My talk, From Experimental Human Computer Interaction to Machine Cohabitation: New Directions in Art, Technology, and Intimate Life, explored human-computer cohabitation:

How do we prepare for a future living, working, and learning with machines? What new possibilities arise from the advent of always-on intelligent assistants, affordable co-robotic platforms, and ubiquitous AI? Now that we have invited the machines into our homes, our workplaces, our intimate everyday, how can we reimagine the terms of our human-computer interactions?

Through the presentation of a series of experimental arts projects, this talk addresses our machine cohabitant future. I will show key previous works building affective surrogates, developing inhabitable smart spaces, and situating machine observers with varying degrees of agency within shared environments. These projects lead to the discussion of my current work building embodied interfaces and staging experimental Human-Robot Interactions. I will raise critical concerns with language and communication, embodied intelligence, and the dynamics of model-limited experience within these contexts.

April 30, 2021 | https://dac.siggraph.org/robotics-electronics-ai/

NSF Grant: Embodied Coding

Rendering of proposed system

We did it! We’ve received a 3-year grant from the National Science Foundation to develop and test an Augmented Reality (AR) environment for collaborative coding. After years working on NSF-funded projects, this is my first time as co-PI:

https://nsf.gov/awardsearch/showAward?AWD_ID=2017042

We’ll be working with HS students from underserved communities in SD to study the efficacy of visual, embodied coding compared to traditional approaches, in promoting computational interest and ability. can’t wait to start!

This is the second project with my collaborator Ying Wu.

Measuring Creative AI at ISEA

I’m excited that our workshop, Measuring Computational Creativity: Collaboratively Designing Metrics to Evaluating Creative Machines will be featured at ISEA2020 – Why Sentience? in Montreal in October. Eunsu Kang, Jean Oh, and I, together with ISEA participants, will develop metrics to assess computational creativity. We will address questions including:

How do we make a creative machine? Creativity is not a sudden burst out of blank space. It involves “a multitude of definitions, conceptualizations, domains, disciplines that bear on its study, empirical methods, and levels of analysis, as well as research orientations that are both basic and applied – and applied in varied contexts.” From Newell, Shaw, and Simon’s insights on computational creativity to Boden’s definitions such as combinational creativity, exploratory creativity, and transformational creativity, defining what kind of creativity, which is appropriate for the specific task of a machine, would be a sensible first step to build a creative algorithm/machine. Yet some questions remain. Can we computationally model ambiguity? Would a novelty search result in valuable discoveries? Where is the threshold between randomness and creativity? Last but not least, how do we evaluate the creativity of an algorithm? This workshop is a first attempt to establish evaluation metrics assessing computational creativity in our current international Arts and Machine Learning (ML) research renaissance.

You can read more about the preliminary programming here: http://isea2020.isea-international.org/preliminary-programming/

New Course – Data Science and the Arts

I’m thrilled to offer my new course through the Halicioglu Data Science Institute at UC San Diego. It’s been in the works for about a year now.

StyleGAN trained on Childrens Drawings

This course addresses the intersection of data science and contemporary arts and culture, exploring four main themes of authorship, representation, visualization, and data provenance. The course is not solely an introducing to data science techniques, nor merely an arts practice course, but explores significant new possibilities for both fields arising from their intersection. Students will examine problems from complementary perspectives of artist-researchers and data scientists.

Read more here: dsc160.roberttwomey.com

Cultured Data Symposium

How can data science and the arts and humanities learn from one another?

Two days of events February 7-8 considering the growing digitization of the cultural record and the explosion of new data generation, collection, and analysis practices create a new state of cultured data: culture as data, and data as a driver of culture. Our symposium examines this emerging condition, considering both how analytic techniques enable new understandings of culture, and how the proliferation of data in everyday life changes how culture is produced, distributed, and influenced. In these panels, we wrestle with new modes of scholarship and cultural production enabled by data-forward analysis methods, and consider perspectives from the arts and humanities for data science practice. What can these disciplines teach one another about their possibilities and limits towards realizing a more just, informed, and culturally-rich future?

With 200 RSVPs for both days, and a robust and diverse turnout, the event was a success!

Day 1 Talks @ Atkinson Hall, UC San Diego: https://youtu.be/3qBd5t0iV8c?t=1365

Stay tuned for complete archives of the talks and performances on the website: cultureddata.net

Streaming show @ CalIT2

STREAMING
Curated by DELUGE (Stephanie E. Sherman, Ash E. Smith) and Robert Twomey http://gallery.calit2.net/portal/

Gallery Hours
January 14-March 13, 2020
12pm-5pm Monday-Friday
gallery@calit2 will be closed on UCSD observed holidays

Curator’s Roundtable
Tuesday, January 14th, 2020
5:00-6:00pm Discussion with Jordan Crandall, DELUGE (Stephanie E. Sherman, Ash E. Smith) Robert Twomey, and guests; Calit2 Auditorium. Stream Online: https://www.youtube.com/watch?v=kR3DZh9RjWs

Cultured Data Symposium
Friday, February 7, 2020
1:00pm-5:00pm, Keynote from Shannon Mattern
Calit2 Auditorium 5:00pm-7:00pm Reception and gallery open
cultureddata.net

Eco-Streaming
Thursday, March 12, 2020
5:00pm Eco-streaming with Calum Bowden; gallery@calit2

Stream the exhibition online http://streaming.energy

Culture Report: Data Culture

Digital Humanities Is the Field You Didn’t Know You Needed

What can data science, the arts, and humanities teach one another towards realizing a more just, informed, and culturally-rich future?

Appreciate the chance to think through these issues with Erin Glass  and Julia Dixon Evans for Voice of San Diego.

stay tuned for the #cultureddata symposium in february!

cultureddata.net

https://www.voiceofsandiego.org/topics/arts/culture-report-digital-humanities-is-the-field-you-didnt-know-you-needed/