Ensuring that robots can smoothly collaborate with humans in real-world environments is a crucial step towards their large-scale deployment. While some robotic systems are already engaging daily with human agents, for instance at partially automated industrial and manufacturing facilities, human-robot collaboration on everyday tasks remains scarce.

Researchers at University of Padova and Mitsubishi Electric Research Laboratories (MERL) in Cambridge have developed a framework that helps to plan tasks that involve human-robot collaboration. This framework, introduced in a paper pre-published on the arXiv server, specifically focuses on tasks that entail the collaborative assembly of complex systems with various underlying components, such as pieces of furniture.

The researchers called their framework DECAF, which stands for Discrete-Event based Collaborative Human-Robot Assembly Framework for furniture. DECAF has various underlying components, including a discrete-event Markov decision process (DE-MDP) model, a HTM description of the assembly process and a Bayesian interference module.

“The human is characterized as an uncontrollable agent, implying, for example, that the agent is not bound by a pre-established sequence of actions and instead acts according to its own preferences,” Giulio Giacomuzzo, Matteo Terreran and their colleagues wrote in their paper. “Meanwhile, the task planner computes reactively the optimal actions for the collaborative robot to efficiently complete the entire assembly task in the least time possible.”

With the newly developed framework, the collaborative assembly process spans across various steps. Firstly, the robot observes the actions performed by the human agent, via a camera or other sensors.

Based on these observations, the DECAF model plans actions for the robot that would maximize the robot-human team’s efficiency in completing the assembly tasks at hand, while also adapting these actions following unpredictable events. The team modeled the assembly of furniture or other objects utilizing a mathematical framework often used to frame specific decision-making processes, known as DE-MDP.

“We formalize the problem as DE-MDP, a comprehensive framework that incorporates a variety of asynchronous behaviors, human change of mind and failure recovery as stochastic events,” wrote Giacomuzzo, Terreran and their colleagues.

“Although the problem could theoretically be addressed by constructing a graph of all possible actions, such an approach would be constrained by computational limitations. The proposed formulation offers an alternative solution utilizing Reinforcement Learning to derive an optimal policy for the robot.”

Essentially, the DE-MDP model is used to break down an assembly task and identify optimal actions that would allow the robot to efficiently tackle in collaboration with a human agent. The second component of the DECAF framework, namely the HTM model, encodes the interdependence between various sub-tasks, thus facilitating the planning process.

Finally, the team integrated a module based on a statistical approach known as Bayesian interference, which is typically used to continuously update the probability that a given hypothesis is true as more information becomes available. This module allows the framework to monitor the actions of the human agent and use them to predict the intentions of a human agent.

The researchers evaluated DECAF in a series of tests, and ran both in simulation and in a real-world setting. For the real experiment, 10 adult participants were asked to assemble a chair purchased from IKEA in collaboration with a 7-DoF robotic manipulator (i.e., the Franka Emika Panda arm).

The findings of initial tests run by the team were highly promising. In simulations, the DECAF framework was found to outperform standard planning policies, while during the real-world experiments it appeared to improve the efficiency and quality of the human-robot collaboration.

“In the future, we plan to include other optimal metrics beyond the execution time, such as human safety, action correlation and human ergonomics,” wrote the researchers.

© 2024 Science X Network

An orca has been born to the southern residents: L128, calf of a first-time, 31-year-old mom, L90.

The baby is tiny, with clear fetal folds, making it probably about three days old. It was seen for the first time on Sunday, said Michael Weiss, research director for the Center for Whale Research, which confirmed the birth on Monday.

Mom and baby appear to be doing fine, Weiss said. The baby is nursing and moving normally, and mom looks physically robust. The pair was seen traveling up and down the west side of San Juan Island all day Monday.

“Any birth is good news,” said Weiss, who helps track the J, K, and L pods that make up the southern residents, a distinct population of fish-eating orcas that frequent the Salish Sea. The orcas, listed as endangered under the Endangered Species Act, have struggled to rebuild their numbers after years of losses.

Everyone is hoping for a female, but the gender of the baby is not yet known. The July 1 census was 73 whales, which does not count the new baby.

Also seen recently was L25, confirming she is still leading the pods as the oldest southern resident—perhaps the oldest orca ever known. Possibly born in 1928, L25 carries the vast generational knowledge of countless miles, traveling and finding fish for her family. The older matriarchs lead the pods, particularly in times when fish are scarce.

New calves face tough odds, with about half of newborns not surviving their first year. One of the challenges is toxins in their mother’s milk, especially for an older, first-time mom like L90. Pollutants are carried to the calf in the fat of the mother’s milk.

The southern residents are battling extinction. They are facing a lack of adequate, regularly available food because of the decline of Chinook salmon throughout their range. Orcas preferentially target Chinook, the biggest, fattiest salmon. They will also eat chum and coho.

Orcas form lifelong family bonds, with the young never leaving their mothers. They are highly social, deeply intelligent top predators. They share language, greeting ceremonies and care of their young. Matriarchs such as L25 also share most of what they catch.

J pod is the pod most likely seen year-round in the waters of the San Juan Islands, British Columbia and even the urban waters of Seattle. According to the Center for Whale Research, J pod has 25 members. K pod has the fewest members, with 15 members. L pod is the largest of the three, with 33 members, not counting the newest baby.

2024 The Seattle Times. Distributed by Tribune Content Agency, LLC.