Human-Robot Collaboration: Unlocking the potential for industrial applications

Human-robot collaboration (HRC) is a widely studied research topic that investigates how humans and robots can work together and achieve a common goal. Over the past few years, HRC has created exciting new applications for robots that can revolutionize manufacturing and introduce them to entirely different domains such as healthcare and agriculture. It is an interdisciplinary research area comprising robotics, artificial intelligence, design and cognitive sciences.
Industrial applications of human-robot collaboration involve collaborative robots which physically interact with humans in shared workspaces to complete tasks such as collaborative manipulation or object handovers. However, in industry to date, HRC has been adopted at a slower pace than expected as collaborative robots need to be safe for interaction with humans. At the same time, they need to be easily programmed by non-experts and to operate in an intelligent and adaptive way.
In this book we present some of the latest state-of-the-art advances in the area of human-robot collaboration, aiming at future industrial applications. The book will be useful for advanced students, researchers, engineers, developers and entrepreneurs interested in human-robot collaboration research and technologies.
- Book DOI: 10.1049/PBCE134E
- Chapter DOI: 10.1049/PBCE134E
- ISBN: 9781839535987
- e-ISBN: 9781839535994
- Page count: 266
- Format: PDF
-
Front Matter
- + Show details - Hide details
-
p.
(1)
-
1 Introduction to human-robot collaboration for industrial applications
- + Show details - Hide details
-
p.
1
–8
(8)
Human-robot collaboration (HRC) is a widely studied research field that has gained attention during the past few years with the ever-increasing availability of collaborative robots (or cobots). Cobots have the sensing capabilities to actively interact with a human partner toward achieving a common task. Some forms of interaction involve direct physical contact, often referred to as physical human-robot interaction (pHRI). A strong focus of the pHRI-related literature is on ensuring safety during the interaction. Despite the continuous advances in HRC research, applications are few and are usually downgraded to basic workspace sharing rather than actual collaborative work. Taking full advantage of cobots in tasks such as collaborative manipulation of heavy objects or collaborative assembly operations has yet to demonstrate tangible results for the industry, as there is still a need for cobots to operate in an intelligent and adaptive way and be easily programmed by nonexperts. This book includes a series of chapters, presenting some of the latest advances in HRC in an effort to unlock its potential for industrial adoption. The book investigates what the needs of the industry are and what steps should be taken in the research toward efficient, safe, and useful HRC.
-
2 Programming industrial robots from few demonstrations
- + Show details - Hide details
-
p.
9
–37
(29)
A wide range of industrial applications can benefit from robots acquiring manipulation skills by interaction with humans. This chapter discusses the challenges that such a learning process encompasses, including the development of intuitive interfaces to acquire meaningful demonstrations, the development of representations for manipulation skills exploiting the structure and geometry of the acquired data in an efficient way, and the development of optimization and optimal control techniques that can adapt to new situations and that can exploit coordination, task variations, and perception uncertainties. The chapter presents an overview of the research lines of the Robot Learning and Interaction group at the Idiap Research Institute. It analyses the barriers that still need to be overcome to move these techniques out of the laboratories by complying with real industrial application constraints. It also proposes a variety of research directions for which further investigations would be required to overcome these barriers.
-
3 A control framework for learning and performing safe human-robot collaborative assembly
- + Show details - Hide details
-
p.
39
–64
(26)
The advent of collaborative robots has enabled new applications where human and robots can work together safely and effectively toward achieving a common goal. However, robots in the industry, and particularly in assembly lines, are still programmed with time-consuming methods, have little to no adaptability to changes in the environment, and still present safety issues in close collaboration with a human, due to stiff control methods utilized to achieve accuracy. In this chapter, we address the problem of learning a pick-and-place task by kinesthetic demonstration and executing it to new and even moving targets, aiming at collaborative assembly lines where operations take place on a moving conveyor. Moreover, the human safety aspect is addressed via a control framework that includes two layers. The first layer is in the form of collision avoidance by altering the executed trajectory, and the second one is achieved by a compliant robot behavior that preserves safety under unintentional contacts, without compromising target-reaching accuracy. For the learning part, we modify the traditional dynamic movement primitive (DMP) formulation for properly encoding the demonstrated task and generalizing it spatially to even moving targets. For the performance and safety part, we propose a control structure incorporating the DMP, the human avoidance signals, and the low stiffness controller of the robot to achieve safety and accuracy. Our approach is validated experimentally in a real-world industrial assembly scenario of a TV manufacturer, where a robot and a human collaboratively achieve the assembly of electronic boards on a TV back plate. This work contributes on a wider scale, as it aims to advance the way toward the adoption of human-robot collaboration in industrial assembly lines.
-
4 Dynamic active constraints construction for enabling human safety during human-robot collaboration
- + Show details - Hide details
-
p.
65
–85
(21)
Collaboration between humans and robots is a critical component of Industry 4.0. Collaborative robots, which combine the incomparable capabilities of humans with the strengths of smart machines to assist operators in performing manual tasks, are currently transforming industrial operations around the world. When working in this environment, occupational health and safety regulations are critical, and active constraints (AC) are a cost-effective and proactive technique to assist robot motion control in achieving human safety while performing collaborative manipulation tasks. A state-of-the-art method for 2D human pose estimation is extended to facilitate accurate human 3D estimation and tracking, which acts as the basis for constructing efficient and resilient AC ensuring safety during human-robot collaboration (HRC).
The AC are described as the surfaces of interest that may cause collisions with the robotic agents participating in the collaborative task. These are the outcomes of tracking human bodies inside the working cell, taking into account context information regarding the collaborative task that is performed by the human worker and robotic agent. The proposed method was deployed in two different setups of industrial tasks that facilitated HRC, and evaluated both qualitatively and quantitatively.
-
5 Time-to-contact for robot safety stop in close collaborative tasks
- + Show details - Hide details
-
p.
87
–104
(18)
Within the next years, industrial collaborative robots will collaborate with human operators, whose safety might be compromised. To ensure a safe collaboration, robots should estimate the risk of collision with respect to the pose and motion of operators within the shared workspace. A common approach is to compute and maintain a minimum distance between humans and robots during tasks' execution. Nevertheless, separation-based solutions do not capture the real dynamics of the human-robot interaction and tend to be rather conservative, avoiding a close human-robot collaboration. In this chapter, we explore the concept of time-to-contact (TTC) as a softer trigger of safety stops in collaborative scenarios where humans and robots are in constant closeness. Particularly, we propose a TTC formulation and study its advantages with respect to two approaches based on the protective distance proposed by the ISO standards. We compared the three methods in some representative cases extracted from an example of a collaborative task. The evaluation is firstly done in simulation and then in a more realistic setup with a simulated human, aiming for repeatability, and a real robot. Furthermore, we showcased our approach in a demo of a complete collaborative task. TTC allows robots to operate closer to humans and for longer times before a safety stop is issued, which benefits long-term productivity. This later stop produces shorter human-robot distances, which might affect safety. However, the increment in time that the robot moves before stopping (productivity) is far greater than the reduction in the distance (safety). Hence, we can state that TTC greatly improves productivity while slightly compromising safety. In conclusion, our work demonstrates that TTC is a smoother, but still safe, collision risk estimator for close human-robot collaboration.
-
6 A human-centered dynamic task scheduling and safe task execution approach for human-robot collaboration scenarios
- + Show details - Hide details
-
p.
105
–130
(26)
The new paradigm of human-robot collaboration has led to the creation of a shared workspace in which humans and robots collaborate to accomplish a common job composed by a set of tasks. Therefore, the safety standards have been updated, addressing these new scenarios. In this context, a proper integration between a task scheduling strategy and a task execution strategy is crucial for an efficient and natural human-robot collaboration. The first must take into account in real time the variability of the two agents during the collaboration. While the second one must explicitly deal with the safety standards, allowing the robot to execute the tasks in a safe and efficient way.
In this chapter, we propose an integrated framework for task scheduling and execution for human-robot collaboration scenarios. The tasks are dynamically scheduled, dealing with the uncertainty of both agents at runtime. Subsequently, at the task execution level, the robot accomplishes the tasks with a behavior that is forced to be compliant with the safety standards, ensuring the safety of the human operator. Furthermore, the information at this level is mutually integrated with the task scheduling strategy, improving the collaboration. The proposed architecture is experimentally validated in a custom collaborative environment.
-
7 Tactile sensing for physical human-robot interaction in shared payload tasks
- + Show details - Hide details
-
p.
131
–157
(27)
Physical human-robot interaction (pHRI) is a major challenge in robotics, especially when related to collaborative operations involving the handling of heavy payloads by potentially dangerous robots. In this chapter, we present a sensing architecture designed for shared payload tasks and implemented to accomplish collaborative car windshield manipulation. The pHRI problem is tackled by implementing voluntary contact recognition leveraging data-driven methodologies, ensuring that robot motion is enabled only when the operator is deliberately interacting with the robot. Test bench experiments are eventually presented to show the functionality of the handles along with the integration of the devices on a vacuum gripper for implementation on an industrial robotic manipulator.
-
8 Online cooperative task execution through human motion capture databases
- + Show details - Hide details
-
p.
159
–173
(15)
This chapter addresses cooperative task executions using a hierarchical database of example human motions. The approach is based on a dual database of example movements, which are gained through demonstrations of human-robot collaborative tasks. Example human movements are encoded in the primary database, which is enhanced with weighted directed graphs. The primary database is used for online human movement recognition through a hierarchical search. The secondary database encodes corresponding robot movements and is used for cooperative robot trajectory synthesis. Smooth and continuous trajectories are gained by encoding them with dynamic movement primitives. The proposed approach was used to execute dynamic cooperative tasks.
-
9 Versatile automation of dense packing with teaching by demonstration and 3D vision
- + Show details - Hide details
-
p.
175
–202
(28)
Recent advances in robotics have paved the way for the automation of many tasks in the manufacturing industry that were previously performed manually. In particular, through the use of collaborative robots, there are many examples of exciting new applications where humans and robots can work together safely and effectively. However, end-of-line automation, where products are packed into cartons and cartons are placed on pallets, is still done using traditional, time-consuming methods of programming the robot's path and calculating the packing plan. Most importantly, such methods do not incorporate perception and do not take full advantage of a robot's capabilities for a flexible automation cell. For example, in a manufacturing line with frequent batch production changes, packing a different product requires reprogramming of the robot.
In this chapter, we propose a versatile solution for automating dense packing tasks in an industrial environment using teaching by demonstration and 3D vision. Teaching enables the user to create the robot's pick-and-place motion pattern in a very short time and without any programming effort. 3D vision with AI gives the robot the ability to recognize its environment, adapt its movements, and remain safe for humans. The system is able to accurately detect and track objects moving on a conveyor by proposing a novel vision pipeline that has high accuracy and can handle partial or complete occlusion of objects by the robot's body. In addition, the system can detect humans in the robot's workspace and adjust the robot's speed to maintain the minimum distance between the robot arm and the human body. We validate the system in a series of experiments with a dense packing task. Our goal is a portable and flexible robotic cell that can be taught by personnel on the production line how to pack products quickly and easily.
-
10 Apprentice: advances toward the development of a cobot helper in assembly lines
- + Show details - Hide details
-
p.
203
–240
(38)
Collaborative robotic manipulators, also known as cobots, are designed to work safely alongside humans, with the objective of taking industrial automation to the next level by increasing the efficiency of a human worker. The worldwide market size for cobots is projected to grow fast, and cobots are expected to accelerate the automation of frequently changing tasks, mainly in medium and small businesses. This brings in many challenges pertaining to (i) how easily such robots can be used and how much programming and design they require, (ii) how user friendly and helpful they are, and (iii) how appealing they are as coworkers.
In this chapter, we present our vision of deploying cobots on the assembly lines toward improving the productivity of the workers. Our vision is based on the observation that human workers are superior to cobots in manipulation tasks and that carrying out the versatile manipulation tasks of an assembly-line worker at the same speed and finesse is likely to remain beyond the reach of cobots in the near future.
Specifically, we report the advances we have made within ÇIRAK and its successor KALFA (Apprentice and Journeymen in Turkish) projects, referred to as an umbrella "Apprentice Project" in the rest of the chapter.
-
11 Wrap up and open research directions
- + Show details - Hide details
-
p.
241
–242
(2)
This book has provided an overview of the latest research and developments in the field of human-robot collaboration, with a particular focus on the potential for industrial adoption. By working together, robots and humans can take advantage of each other's strengths and complement each other's abilities. This will become increasingly important as Industry 5.0, which focuses on the cooperation between humans and machines, becomes more prevalent.
-
Back Matter
- + Show details - Hide details
-
p.
(1)
Related content
