應用生成對抗網路於骨架偵測演算法之改良與應用
摘要
在電腦視覺不斷進步的今日，基於二維影像的人體骨架偵測技術日漸成熟，因此，越來越多的基於人體骨架偵測的應用陸續被開發出來。然而，當輸入影像中的人體被大面積遮擋或是遮蔽物件與人體顏色類似時，皆會對於人體骨架估測結果造成重大的影響。因此本論文希望提出一個基於生成對抗網路 （Generative Adversarial Network） 的演算法，來降低上述的兩大干擾因素，能自動生成人體被遮蔽影響的區塊，使得二維影像的骨架偵測效果能夠被大幅改善。 本論文以居家環境為主要應用情境，在此應用情境中，我們關心的日常生活中常見的動作姿態共有八種，以此為後續分析的目標。由於居家環境中，身體常常容易被各類家具所遮蔽，導致人體骨架估測結果變差。所以，本論文訓練一個生成對抗網路，使得生成對抗網路可以自動生成擬真的圖像，補全原先被遮蔽而可能造成誤判的區塊。藉此進一步改善骨架偵測演算法的準確性。 在不同人的推廣性測試與不同背景下的測試上，本論文提出方法相較於原先直接使用骨架偵測演算法，改善了八成的誤判，證明本系統在遮擋情況下，能有效地提供穩定的填補圖像，改善二維圖像的骨架偵測效果。

關鍵字： 生成對抗網路、骨架偵測、深度學習、姿態辨識

The Application of Generative Adversarial Networks in the Improvements of the Skeleton Detection Algorithm
Abstract
Nowadays, with the continuous advancement of computer vision, human body skeleton detection technology based on two-dimensional images is becoming more and more mature. Therefore, more and more applications based on human skeleton detection have been developed. However, when the human body in the input image is blocked by a large object or the object’s color is similar to the human body, it will result in a significant impact on the estimation of the human skeleton. Therefore, this thesis tries to propose an algorithm based on the Generative Adversarial Network to reduce the above two major interference factors. The proposed algorithm can automatically generate the corresponding blocks that are blocked, so that the 2-D skeleton detection effect can be greatly improved. This thesis takes the home environment as the main application scenario. In this application scenario, there are total of eight common postures in daily life that we care about and these eight postures will be the goal of subsequent analysis. Because of the home environment, the body is often easily occluded by various types of furniture, resulting in poor estimation of the human skeleton. Therefore, this thesis tries to train a generative adversarial network, so that the network can automatically generate the corresponding body image to complement the area that was originally blocked by a furniture. Via this kind of amendment, the accuracy of the skeleton detection algorithm can be further improved. Based on the generalization performance comparisons of different people and different backgrounds, the proposed method improves the 80% misjudgment compared with the original skeleton detection algorithm. These simulation results demonstrate that the proposed algorithm can effectively solve the occlusion problem and provide a stable recovery image so as to improve the performance of the original 2-D skeleton detection algorithm.

Keywords: generative adversarial networks, skeleton detection, deep learning, posture recognition