tcnj wordmark

Conducting Robots

The National Science Foundation’s CreativeIT Program has awarded four TCNJ professors a $360,000 three-year grant to develop a new, research-based multidisciplinary course entitled “Conducting Robots.”

Andrea Salgian, assistant professor of computer science; Teresa Nakra, assistant professor of music; Christopher Ault, assistant professor of interactive multimedia; and Jennifer Wang, associate professor of mechanical engineering, collaborated on the proposal, called “RUI: Giving the Maestro a Human Heart—Fostering Creativity in a Multi-Disciplinary Undergraduate Environment.”

The resultant course is allowing students from each professor’s discipline to construct artificial systems capable of conducting an orchestra and visualizing feedback. In essence, the students will create a robotic “maestro” that mimics the arm movements and facial expressions of a human conductor at work.

Salgian contrasted her ideal conductor with Honda’s “Asimo” robot, programmed to conduct an orchestra in 2008. That robot merely conducted the beat—and lost it. “We want [TCNJ’s] system to have more information about the music,” she said. “Ideally it would also get some feedback and it would be able to use what it hears.”

“Asimo was very cute,” Salgian admitted, “but we want to introduce a different aspect to it.” She speculated on some design possibilities—a “face” represented by computer visualization, for example—but said that the product will ultimately depend on the students. Each of the four or five mixed-major student teams will turn out their own design.

Salgian stressed the focus on collaboration: “The entire system is not necessarily the goal of our research project, it’s more of a vehicle to use to teach students to work together. Our hope is that they will all become more creative by having to integrate knowledge from different fields,” she said.

Philip Tate, director of the TCNJ orchestra, will act as a consultant on the project. The first course will be offered this fall.

Modified from TCNJ Magazine, In Focus, September 2009. By Matt Huston ’12 • Aug 13th, 2009.

For more information:

• To view videos of several semester’s robots, see the Conducting Robots course website

• The Conducting Robots course was featured in the October 2010 issue of SERVO magazine

Dr. Andrea Salgian’s Faculty Profile

Top