A Four-Step Ortho-Rectification Procedure for Geo-Referencing Video Streams from a Low-Cost UAV

In this paper, we present a four-step ortho-rectification procedure for real-time geo-referencing of video data from a low-cost UAV equipped with a multi-sensor system. The basic procedures for the real-time ortho-rectification are: (1) decompilation of the video stream into individual frames; (2) establishing the interior camera orientation parameters; (3) determining the relative orientation parameters for each video frame with respect to each other; (4) finding the absolute orientation parameters, using a self-calibration bundle and adjustment with the aid of a mathematical model. Each ortho-rectified video frame is then mosaicked together to produce a mosaic image of the test area, which is then merged with a well referenced existing digital map for the purpose of geo-referencing and aerial surveillance. A test field located in Abuja, Nigeria was used to evaluate our method. Video and telemetry data were collected for about fifteen minutes, and they were processed using the four-step ortho-rectification procedure. The results demonstrated that the geometric measurement of the control field from ortho-images is more accurate when compared with those from original perspective images when used to pin point the exact location of targets on the video imagery acquired by the UAV. The 2-D planimetric accuracy when compared with the 6 control points measured by a GPS receiver is between 3 to 5 metres.

Authors:

• B. O. Olawale
• C. R. Chatwin
• R. C. D. Young
• P. M. Birch
• F. O. Faithpraise
• A. O. Olukiran

Keywords:

• Geo-referencing
• ortho-rectification
• video frame
• self-calibration
• UAV
• target tracking.

References:

[1] M. Kontitsis, M., Valavanis, K., N. Tsourveloudis , “A UAV Vision
System for Airborne Surveillance,” In Proc. of the IEEE International
Conference on Robotics and Automation, 2004, pp. 77–83.
[2] D.W. Casbeer, D.B. Kingston, R.W. Bear , T.W. McLain, and S.M. Li,
“Cooperative Forest Fire Surveillance Using a Team of Small
Unmanned Air Vehicles.”, Intl. Journal of System Science, January
2005, pp 1-18.
[3] B.O. Olawale, C.R. Chatwin, R.C.D. Young, P.M. Birch, F.O.
Faithpraise and A.O. Olukiran, “Real-Time Monitoring Of Buried Oil
Pipeline Right-Of-Way for Third-Party Incursion”, International Journal
of Innovative Science, Engineering & Technology, Vol. 2 Issue
2,February 2015, pp. 163-173.
[4] B. Colfman, M. McCord, and K. Redmill, “Surface Transportation
Surveillance from Unmanned Aerial Vehicles” Proc. Of the 83rd Annual
Meeting of the Transportation Research Board, 2004.
[5] J. Allen, and B. Walsh, “Enhanced Oil Spill Surveillance, Detection and
Monitoring through the Applied Technology of Unmanned Air
Systems”. In: Proceedings of the 2008 international oil spill conference.
[6] R. W. Beard, T. W. McLain, D. B. Nelson, D. Kingston, and D.
Johanson, “Decentralized cooperative aerial surveillance using fixedwing
miniature UAVs,” Proc. IEEE, July 2006, vol. 94, no. 7, pp. 1306–
1323.
[7] Fransaer, D., Vanderhaeghen, F., Everaerts, J., “PEGASUS: Business
Plan for a Stratospheric Long Endurance UAV System for Remote
Sensing”. The International Archives of the Photogrammetry, Remote
Sensing and Spatial Information Sciences, Istanbul, Turkey, GITC,
Lemmer, Netherlands, 2004.
[8] A. Ollero, J. Ferruz, F. Caballero, S. Hurtado, L. Merino, “Motion
Compensation and Object Detection for Autonomous Helicopter Visual
Navigation in the Comets System”. In: Proc. of the IEEE International
Conference on Robotics and Automation, 2004, pp. 19–24.
[9] Anon, “Functional Specification for a Satellite Surveillance System”,
Andrew Palmer and Associates Report NR01003, March 2001.
[10] . M.D.F Bento, “Unmanned Aerial Vehicles: An Overview. Inside GNSS
“, February, 2008, pp. 54-61.
[11] N. Mohamed, I. Jawhar, “A Fault-Tolerant Wired/Wireless Sensor
Network Architecture or Monitoring Pipeline Infrastructures”, in Proc.
Int. Conference on Sensor Technologies and Applications
(SENSORCOMM 2008), Cap Esterel, France,25–31 August 2008; pp.
179-184.
[12] Y. DU, P.M. Teillet, and J.Cihlar, “Radiometric Normalization of Multi-
Temporal High-Resolution Satellite Images with Quality Control for
Land Cover Change Detection: Remote Sensing of Environment”, 2002,
pp. 123–134,
[13] S. Chen, B. Mulgrew, and P. M. Grant, “A Clustering Technique for
Digital Communications Channel Equalization Using Radial Basis
Function Networks,” WASET Trans. Neural Networks, vol. 4, pp. 570–
578, July 1993.
[14] B. Horn Robot Vision, MIT Press, 1986, pp 314 – 315.
[15] K. Kobayashi, C. Mori, “Relations between the Coefficients in the
Projective Transformation Equations and the Orientation Element of the
Photograph”. Journal of Photogrammetric Engineering and Remote
Sensing. Vol. 63, No. 9, September 1997, pp.1121-1127.
[16] Z. Li, J. Chen, and E. Baltsavias. Advances in Photogrammetry, Remote
Sensing and Spatial Information Sciences, 2008 ISPRS Congress Book.
CRC Press, Taylor & Francis Group, Boca Raton, London, New York,
Leiden, p. 527.
[17] E.M Mikhail, J.S. Bethel, J.C. McGlone. Introduction to Modern
Photogrammetry. John Wiley & Sons Inc., New.
[18] http://www.dji.com/product/spreading-wings-s800/spec (Accessed: 11
July 2013).
[19] Z. Guoqing, ‘’Near Real-Time Orthorectification and Mosaic of Small
UAV Video Flow for Time-Critical Event Response’ ’in Proc. o
Geoscience and Remote Sensing, IEEE, 47(3), March 2009.
[20] Y. I. Abdel-Aziz and H. M. Karara, “Direct Linear Transformation from
Comparator Coordinates into Object Space Coordinates in Close-Range
Photogrammetry,” in Proc. Symp. Close-Range Photogrammetry, Falls
Church, VA, 1971, pp. 1–18, Amer. Soc. of Photogrammetry.
[21] J. Skaloud, M. Cramer, and K. P. Schwarz, “Exterior Orientation by
Direct Measurement of Camera and Position,” in Proc. Int. Archives
Photogrammetry Remote Sens., Vienna, Austria, 1996, vol. XXXI, pp.
125-130, Part B3.
[22] Gomarasca, Mario A. Basics of Geomatics. Dordrecht: Springer, 2009.
Print.