Collaboration between humans and robots

human-robot interaction

Most often, humans and robots do not have to work directly together, instead working on different parts in a production pipeline or with the robot performing tasks instead of a human. In such cases any human-robot interaction (HRI) will be superficial. Yet what if humans and robots have to work alongside each other? This is a question which a group of students at MIT’s Computer Science and Artificial Intelligence Lab (CSAIL) have recently studied some answers to.

In their paper on human-robot collaborative tasks (PDF), they cover the three possible models one can use for this kind of interaction: there can be no communication (‘silent’), the communication can be pre-programmed (state machine), or in this case a Markov model-based system. This framework which they demonstrate is called CommPlan and it uses observation data from human subjects to construct a Markov model that can integrate sensor data in order to decide on its next action.

In the experiment they performed (the preparation of a meal; see the embedded video after the break), human subjects had to work alongside a robot. Between the three different approaches, the CommPlan one was the fastest, using voice interaction only when it deemed it to be necessary. The experiment’s subjects expressed hereby a preference for bidirectional communication, much as would occur between human workers.

Continue reading “Teaching Robots Workplace Etiquette” →

02

New framework enables human-robot interaction for broader access to deep sea scientific exploration

Scientific exploration of the deep ocean has largely remained inaccessible to most people because of barriers to access due to infrastructure, training, and physical ability requirements for at-sea oceanographic research.

Now, a new and innovative framework for oceanographic research provides a way for shore-based scientists, citizen scientists, and the general public to seamlessly observe and control robotic sampling processes.

The Shared Autonomy for Remote Collaboration (SHARC) framework “enables remote participants to conduct shipboard operations and control robotic manipulators”—such as on remotely operated vehicles (ROVs)—”using only a basic internet connection and consumer-grade hardware, regardless of their prior piloting experience.”

This is according to a paper in Science Robotics, titled “Enhancing scientific exploration of the deep sea through shared autonomy in remote manipulation.” The framework has been developed by a research team from the Woods Hole Oceanographic Institution (WHOI), the Massachusetts Institute of Technology (MIT), and the Toyota Technological Institute at Chicago (TTIC).

The SHARC framework enables real-time collaboration between multiple remote operators, who can issue goal-directed commands through simple speech and hand gestures while wearing virtual reality goggles in an intuitive three-dimensional workspace representation.

Leave a Reply

Your email address will not be published. Required fields are marked *