Inside a Drone: Computer Vision

News2016-06-23

Sharp vision coupled with incredible smarts is what gives the Phantom 4 its new breakthrough features: Obstacle Avoidance, ActiveTrack, and TapFly. While easy to use when flying, behind these technologies is a complex mix of next-generation hardware and innovative software solutions to create a drone that is capable of both seeing and reacting to its environment.

Vision Positioning System (VPS)

The system that gives the Phantom 4 its ability to see consists of two front-facing and two downward-looking optical sensors, coupled with two dedicated image processors. The system extracts 3D information from the digital images captured by its sensors through stereo vision, or stereopsis as it is called when the human brain does it, comparing the information about a scene from two vantage points and using the difference in position for each object in the two 2D images to triangulate their real-world locations.

Front-facing optical sensors

By working closely together with its satellite positioning system, the aircraft is able to locate itself within this map, with an accuracy of +/- 0.1 m vertically and +/- 0.3 m horizontally. This way, the aircraft is able to maintain and re-adjust its hover position even if it is pushed by an external force or carried away by strong winds. The VPS also increases hover accuracy and makes it possible to fly indoors where no GPS signal is available.

Obstacle Sensing System

The optical sensors give the Phantom a 60° by 50° Field of View that it then re-creates as part of the 3D map. In comparison, ultrasonic sensors generally have a limited range and narrow FoV of around 15°, making them unsuitable for the purpose of obstacle sensing. The distance between the aircraft and all detected objects is instantly captured and monitored to avoid collisions. If an object is projected to be in its path,  the drone will automatically adjust its path to go over or under the obstacle.

In situations where moving objects suddenly enter the path of the Phantom, it is able to quickly sense  change in the scene and stop and hover or go around the obstacle. With a wide effective range of 0.7 m to 15 m, the Phantom 4's Obstacle Sensing System helps it dodge obstacles even when flying at speeds of 10m/s. 


Want to learn more about how drones work? Check out our previous Inside a Drone articles: ESC, Propellers, Brushless Motors.

Learn more about Phantom 4.

We Value Your Privacy
We use cookies and other similar technologies to operate and improve our site, as described in our Cookie Policy. With your consent, our third-party partners also use these technologies to collect information about your activities on our websites for analytics and advertising purposes. You can manage your settings at any time through Cookie Preferences.
Do Not Sell or Share My Personal Information
We do not disclose your personal information to third parties in exchange for monetary consideration. Nevertheless, under certain U.S. state privacy laws, such as the California Consumer Privacy Act ("CCPA") and the Virginia Consumer Data Protection Act ("VCDPA"), disclosing personal information for personalized advertising purposes may be considered a "sale" or "sharing" of personal information, or processing for "targeted advertising" purposes. Residents of these U.S. states have the right to opt out of the "sale" or "sharing" of their personal information or the processing of their personal information for "targeted advertising." This opt-out right may vary by state, but we nevertheless offer a unified option for our U.S. customers to exercise this right.

If you want to opt out of the sale or sharing of your personal information or processing for targeted advertising, please deselect the “Marketing Cookies” checkbox through Cookie Preferences. Please note that you will need to opt out on each browser you use.

You can learn more about how we collect, use, and disclose your personal information, as well as other rights and choices you may have, by reviewing our Cookie Policy.
Cookie Preferences
We use different types of cookies on our websites as listed below. They help us to operate and improve our websites, and enable us to provide certain features of our websites and online services to you. View our Cookie Policy for more information.