Automation of the Maritime UAV Command, Control, Navigation Operations, Simulated in Real-Time Using Kinect Sensor: A Feasibility Study

This paper describes the process used in the automation of the Maritime UAV commands using the Kinect sensor. The AR Drone is a Quadrocopter manufactured by Parrot [1] to be controlled using the Apple operating systems such as iPhones and Ipads. However, this project uses the Microsoft Kinect SDK and Microsoft Visual Studio C# (C sharp) software, which are compatible with Windows Operating System for the automation of the navigation and control of the AR drone. The navigation and control software for the Quadrocopter runs on a windows 7 computer. The project is divided into two sections; the Quadrocopter control system and the Kinect sensor control system. The Kinect sensor is connected to the computer using a USB cable from which commands can be sent to and from the Kinect sensors. The AR drone has Wi-Fi capabilities from which it can be connected to the computer to enable transfer of commands to and from the Quadrocopter. The project was implemented in C#, a programming language that is commonly used in the automation systems. The language was chosen because there are more libraries already established in C# for both the AR drone and the Kinect sensor. The study will contribute toward research in automation of systems using the Quadrocopter and the Kinect sensor for navigation involving a human operator in the loop. The prototype created has numerous applications among which include the inspection of vessels such as ship, airplanes and areas that are not accessible by human operators.

Authors:

• Regius Asiimwe
• Amir Anvar

Keywords:

• UAV
• AR drone
• Kinect Sensors
• Automation
• Real time
• C sharp
• Microsoft Kinect SDK.

References:

[1] (2012). Parrot AR. Drone, flying Video Game, Developer SDK 1.5.
Parrot Company.
[2] Adam Salamon, D. H. (2008). Increasing Situational Awareness
Through The Use Of Uxv Teams While Reducing Operator Workload.
Lockheed Martin.
[3] Crawford, S. (2012, October 1). How Microsoft Kinect Works.
Retrieved 10 1, 2012, from How stuf fworks:
http://electronics.howstuffworks.com/microsoft-kinect2.htm
[4] Drone, P. A. (2012). www.Parrot.com. Retrieved 10 2, 2012, from A
Technological first : http://ardrone.parrot.com/parrot-ardrone/
en/technologies
[5] John Stowers, M. H.-S. (2011). Quadrotor Helicopter Flight Control
Using Hough Transform and Depth Map from a Microsoft Kinect
Sensor. Conference on Machine Vision Applications, Nara, JAPAN, 5.
[6] Mariusz Wzorek, D. L. (2006). GSM Technology as a Communication
Media for an Autonomous Unmanned Aerial Vehicle. 21th Bristol UAV
Systems Conference, (p. 15). Link¨oping, Sweden.
[7] Masako Kumano, A. O. (2000). Obstacle Avoidance of Autonomous
Mobile Robot using Stereo Vision Sensor. 6.
[8] Parrot. (2012). Parrot AR. Drone Overview.
[9] Pierre-Jean Bristeau, F. C. (2011). The Navigation and Control
technology inside the AR.Drone micro UAV. 18th IFAC World
Congress, (p. 8). Milano, Italy.
[10] Robotics, M. (2012). Kinect Sensor. Retrieved 10 1, 2012, from
Microsoft: http://msdn.microsoft.com/en-us/library/hh438998.aspx
[11] Sandler, A. A. (2012). How to Control AR.Drone Movements During
Flight. Retrieved 10 1, 2012, from Robot -App Developers:
http://www.robotappstore.com/Knowledge-Base/How-to-Make-
ARDrone-Take-Off-or-Land/97.html
[12] Totilo, S. (2010, 11 4). Review: Kinect. Retrieved 10 11, 2012, from
kotaku: http://kotaku.com/5680501/review-kinect
[13] Walter Hickey, R. J. (2012, 08 17). These Ships Have Russia
Considering A Missile Strike Against Europe. Retrieved 10 11, 2012,
from Business Inside, Military and Defence:
http://www.businessinsider.com/meet-the-destroyers-that-are-thelynchpin-
of-the-european-missile-shield-2012-8?op=1