CategoriesUncategorized by

Does the Drone Industry Really Need 8K

Does the Drone Industry Really Need 8K?

Pro Read: As a leak indicates that Autel Robotics may be the first to offer a 6/8K camera on a drone, UAS expert and industry leader Douglas Spotted Eagle dives in to what the advantages of 8k may be – and if the drone industry is ready to take advantage of them.

Guest post by Douglas Spotted Eagle, Chief Strategy Officer – KukerRanken

In 2004, Sony released the world’s first low-cost HD camera, known as the HVR-Z1U. The camera featured a standard 1/3” imager, squeezing 1440×1080 pixels (anamorphic/non-square) pixels on to the sensor. This was also the world’s first pro-sumer camera using the MPEG2 compression scheme, with a color sample of 4:2:0, and using a GOP method of frame progression, this new technology set the stage for much higher resolutions and eventually, greater frame rates.

It’s “father,” was the CineAlta HDWF900, which offered three 2/3” CCDs, which was the industry standard for filmmaking for several years, capturing big hits such as the “Star Wars Prequel Trilogy”, “Once Upon a Time in Mexico”, “Real Steel”, “Tomorrowland”, “Avatar”, “Spykids” (1 & 2), and so many others.  The newer HDV format spawned from similar technology found in the HDWF900, and set the stage for extremely high end camera tech to trickle down into the pro-sumer space.

Overtime, camera engineers identified methods of co-siting more pixels on small imagers, binning pixels, or using other techniques to increase the capture resolution on small surfaces. Compression engineers have developed new compression schemes which brought forward AVC (h.263), MP4(h.264), and now HEVC/High Efficiency Video Codec(h.265), and still others soon to be revealed.

Which brings us to the present.

We have to roughly quadruplemegapixels to doubleresolution, so the jump from SD to HD makes sense, while the jump from HD to UHD/4K makes even more sense. Following that theme, jumping to 6K makes sense, while jumping to 8K is perfect theory, and nears the maximum of the human eye’s ability to resolve information.

At NAB 2018, Sony and Blackmagic Design both revealed 8K cameras and in that time frame others have followed suit.

During CommUAV and InterDrone, several folks asked for my opinion on 6 and 8K resolutions. Nearly all were shocked as I expressed enthusiasm for the format.

–          “It’s impossible to edit.”

–          “The files are huge.”

–          “No computer can manage it.”

–          “There is no where to show 8K footage.”

–          “Human eyes can’t resolve that resolution unless sitting very far away from the screen.”

–          “Data cards aren’t fast enough.”

And….so on.

These are all the same comments heard as we predicted the tempo of the camera industry transitioning from SD to HD, and from HD to 4K.  In other words, we’ve been here before.

Video cameras are acquisition devices. For the same reasons major motion pictures are acquired at the highest possible resolutions, and for the same reasons photographers get very excited as resolutions on-camera increase, so should UAS photographers. Greater resolution doesn’t always mean higher grade images. Nor does larger sensor sizes increase quality of images. On the whole, higher resolution systems usually does translate into higher quality images.

Sensor sizes are somewhat important to this discussion, yet not entirely critical. The camera industry has been packing more and more pixels into the same physical space for nearly two decades, without the feared increase in noise. Additionally, better noise-sampling/reduction algorithms, particularly from OEM’s like Sony and Ambarella, have allowed far greater reduction in noise compared to the past. Cameras such as the Sony A7RIV and earlier offer nearly noise-free ISO of 32,000!

Sensor sizes vary of course, but we’ll find most UAS utilize the 1/2.3, or the 1” sensor. (Light Blue and Turquoise sizes respectively, as seen below).

“Imagine an UAS equipped with an 8K camera inspecting a communications tower. Resolution is high, so small specs of rust, pitting, spalling, or other damage which might be missed with lower resolutions or the human eye become apparent with a greater resolution.”

WHY DOES HIGHER RESOLUTION TRANSLATE TO BETTER FINISHED PRODUCT?

Generally, we’re downsampling video or photos to smaller delivery vehicles, for but one reason. In broadcast, 4:2:2 uncompressed color schemes were the grail. Yet, most UAS cameras capture a 4:2:0 color/chroma sample.  However, a 4K capture, downsampled to 1080 at delivery, offers videographers the same “grail” color schema of 4:2:2!

As we move into 6 or 8K, similar results occur. 8K downconverted to HD offers a 4:4:4 color sample.

CROPPING

We gain the ability to crop for post editing/delivery to recompose images without fear of losing resolution. This means that although the aircraft may shoot a wide shot, the image may be recomposed to a tighter image in post, so long as the delivery is smaller than the source/acquisition capture. For example, shooting 4K for 1080 delivery means that up to 75% of the image may be cropped without resolution loss.

As the image above demonstrates, it’s quite possible to edit 8K HEVC streams on a newer laptop. Performance is not optimal without a great deal of RAM and a good video card, as HEVC requires a fair amount of horsepower to decode. The greater point, is that we can edit images with deep recomposition. Moreover, we have more pixels to work with, providing greater color correction, color timing, and depth/saturation.

For public safety, this is priceless. An 8K capture provides great ability to zoom/crop deeply into a scene and deliver much greater detail in HD or 4K delivery.

The same can be said for inspections, construction progress reports, etc. Users can capture at a high resolution and deliver in a lower resolution.

Another benefit of 6 and 8K resolutions is the increase in dynamic range. While small sensors only provide a small increase in dynamic range, a small increase is preferable to no increase.

To address other statements about 6K and 8K resolutions; They human eye has the ability to see around 40megapixels, age-dependent. 8K is approximately 33megapixels. However, the human eye doesn’t see equal resolutions across the surface. The center of our eye sees approximately 8megapixels, where the outer edges are not as deep. High resolution does provide greater smoothing across the spectrum, therefore our eyes see smoother moving pictures.

BEYOND THE HUMAN EYE

Going well-beyond the human eye, higher resolutions are applicable to “computer vision,” benefiting mapping, 3D modeling, and other similar applications. Generally speaking, more pixels equals greater smoothness and geometry. As technology moves deeper into Artificial Intelligence, higher resolutions with more efficient codecs become yet even more important. Imagine an UAS equipped with an 8K camera inspecting a communications tower. Resolution is high, so small specs of rust or other damage which might be missed with lower resolutions or the human eye become more visible with a greater resolution. Now imagine that greater resolution providing input to an AI-aided inspection report that might notify the operator or manager of any problem. Our technology is moving beyond the resolution of the human eye for good reason.

DATA STORAGE

Files from a 6 or 8K camera are relatively small, particularly when compared to uncompressed 8K content (9.62TB per hour). Compression formats, known as “Codecs” have been improving for years, steadily moving forward. For example, when compressions first debuted in physical form, we saw Hollywood movies delivered on DVD. Then we saw HD delivered on Blu-ray. Delivery over disc formats is dead, and now we’ve moved through MPG2, AVC, AVCHD, H.264, and now H.265/HEVC. In the near future we’ll see yet even more compression schemes benefitting our workflows whether delivered via streaming or thumbdrive.  VVC or “Versatile Video Codec”will be the next big thing in codecs for 8K, scheduled to launch early 2022.

Unconventional h.264 and H.265/HEVCare currently being used as delivery codecs for compressed 6 and 8K streams. 8K has been successfully broadcast (in testing environments) at rates as low as 35Mbps for VOD, while NHK has set the standard at 100Mbps for conventional delivery. Using these codecs, downconverting streams to view OTA/Over The Air to tablets, smartphones, or ground station controllers is already possible. It’s unlikely we’ll see 8K streaming from the UAS to the GSC.

U3 Datacards are certainly prepared for 6 and 8K resolutions/datastreams; compression is what makes this possible.  The KenDao 8K and Insta 8K 360 cameras both are recording to U3 cards, available in the market today.

It will be some time before the average consumer will be seeing 8K on screens in their homes. However, 8K delivered for advertising, matching large format footage being shot on Weapon, Monstro, Helium or other camera formats may be less time-consuming when using 8K, even from smaller camera formats carried on an UAS (these cameras may easily be carried on heavy-lift UAS).

Professional UAS pilots will benefit greatly from 5, 6, or 8K cameras, and should not be shy about testing the format. Yes, it’s yet another paradigm shift in an always-fluid era of aerial and visual technology.  There can be no doubt that these higher resolutions provide higher quality in any final product.  Be prepared; 2020 is the year of 5, 6, and 8K cameras on the flying tripods we’re using for our professional and personal endeavors, and I for one, am looking forward to it with great enthusiasm.

CategoriesUncategorized by

Part 91, 101, 103, 105, 107, 137: WHAT’S THE DIFFERENCE?

All these FARs, what’s a drone pilot to do in order to understand them? Do they matter?

YES!

In virtually every aviation pursuit except for sUAS, an understanding of regulations is requisite and part of most testing mechanisms.  As a result, many sUAS pilots holding 

a Remote Pilot Certificate under Part §107 are woefully uninformed, to the detriment of the industry.

Therefore, sUAS pilots would be well-served to inform themselves of how each section of relevant FARs regulate components of aviation.

Let’s start by digging into the intent of each Part.

  • §Part 91 regulates General Operating and Flight Rules.
  • §Part 101 regulates Moored Balloons, Kites, Amateur Rockets, Unmanned Free Balloons, and some types of Model Aircraft.
  • §Public Law Section 336 regulates hobby drones as an addendum to Part 101.
  • §Part 103 regulates Ultra-Light Vehicles, or manned, unpowered aviation.
  • §Part 105 regulates Skydiving.
  • §Part 107 regulates sUAS
  • §Part 137 regulates agricultural aircraft

RELEVANT PARTS (Chapters):

Part §91

This portion of the FARs is barely recognized, although certain sections of Part 91 may come into play in the event of an action by the FAA against an sUAS pilot. For example, the most concerning portion of Part 91 is  91.13, or “Careless or Reckless Operation.” Nearly every action taken against sUAS pilots have included a charge of 91.13 in the past (prior to 107).

Specific to drone actions, The vast majority of individuals charged have also included the specific of a 91.13 charge.

sUAS pilots whether recreational or commercial pilots may be charged with a §91.13 or the more relevant §107.23 (reckless)

It’s pretty simple; if there are consequences to a pilot’s choices and actions, it’s likely those consequences also included a disregard for safety or planning, ergo; careless/reckless. The FAA has recently initiated actions against Masih Mozayan for flying his aircraft near a helicopter and taking no avoidance action. They’ve also taken action against Vyacheslav Tantashov for his actions that resulted in damage to a military helicopter (without seeing the actual action, it’s a reasonable assumption that the action will be a §91.13 or a §107.23 (hazardous operation).

Other parts of Part 91 are relevant as well. For example;

  • §91.1   Applicability.

(a) Except as provided in paragraphs (b), (c), (e), and (f) of this section and §§91.701 and 91.703, this part prescribes rules governing the operation of aircraft within the United States, including the waters within 3 nautical miles of the U.S. coast.

The above paragraph includes sUAS.  Additionally, Part 107 does not exclude Part 91. Airmen (including sUAS pilots) should be aware of the freedoms and restrictions granted in Part 91.

§91.3   Responsibility and authority of the pilot in command.

(a) The pilot in command of an aircraft is directly responsible for, and is the final authority as to, the operation of that aircraft.

(b) In an in-flight emergency requiring immediate action, the pilot in command may deviate from any rule of this part to the extent required to meet that emergency.

(c) Each pilot in command who deviates from a rule under paragraph (b) of this section shall, upon the request of the Administrator, send a written report of that deviation to the Administrator.

§91.7   Civil aircraft airworthiness.

(a) No person may operate a civil aircraft unless it is in an airworthy condition.

(b) The pilot in command of a civil aircraft is responsible for determining whether that aircraft is in condition for safe flight. The pilot in command shall discontinue the flight when unairworthy mechanical, electrical, or structural conditions occur.

§91.15   Dropping objects.

No pilot in command of a civil aircraft may allow any object to be dropped from that aircraft in flight that creates a hazard to persons or property. However, this section does not prohibit the dropping of any object if reasonable precautions are taken to avoid injury or damage to persons or property.

§91.17   Alcohol or drugs.

(a) No person may act or attempt to act as a crewmember of a civil aircraft—

(1) Within 8 hours after the consumption of any alcoholic beverage;

(2) While under the influence of alcohol;

(3) While using any drug that affects the person’s faculties in any way contrary to safety; or

Sound familiar?

SubPart B also carries relevant information/regulation with regard to operation in controlled airspace, operations in areas under TFR ((§91.133), operations in disaster/hazard areas, flights during national events, lighting (§91.209)

PART 101

Part §101 has a few applicable sections.

Subpart (a) under §101.1 restricts model aircraft and tethered aircraft (balloons). Although subpart (a.4. iiv) is applicable to balloon tethers, there is argument that it also applies to sUAS. Subpart (a.5.iii) defines recreational flight for sUAS/model aircraft.

Finally, §101.7 re-emphasizes §91.15 with regard to dropping objects (may not be performed without taking precautions to prevent injury or damage to persons or property).  Public Law 112-95 Section 336 (which may be folded into a “107 lite” version), clarifies sections not added to Part 101.

Bear in mind that unless the pilot follows the rules and guidelines of a NCBO such as the AMA, AND the requirements of that NCBO are met, the flight requirements default to Part 107 requirements.

PART §103

Part §103 regulates Ultralight vehicles (Non powered, manned aviation)

Although no component of Part §103 specifically regulates UAV, it’s a good read as Part 103 contains components of regulation found in Part 107.

PART §105

Part §105 regulates Skydiving.

Part §105 carries no specific regulation to sUAS, an understanding of Part 105 provides great insight to components of Part 107. Part 107 has very few “new” components; most of its components are clipped out of other FAR sections.

PART §107

Although many sUAS pilots “have their 107,” very few have actually absorbed the FAR beyond a rapid read-through. Without a thorough understanding of the FAR, it’s difficult to comprehend the foundation of many rules.

PART §137

Part 137 applies specifically to spraying crops via aerial vehicles.

Those looking into crop spraying via sUAS should be familiar with Part 137, particularly with the limitations on who can fly, where they can fly, and how crops may be sprayed.
One area every ag drone pilot should look at is §137.35 §137.55 regarding limitations and business licenses.

The bottom line is that the more informed a pilot is, the better pilot they can be.  While there are many online experts purporting deep knowledge of aviation regulations and how they specifically apply to sUAS, very few are familiar with the regulations in specific, and even less informed as to how those regulations are interpreted and enforced by ASI’s. We’ve even had Part 61 pilots insist that the FSDO is a “who” and not a “what/where.” Even fewer are aware of an ASI and how they relate to the world of sUAS.

FSIM Volume 16

It is reasonably safe to say that most sUAS pilots are entirely unaware of the Flight Standards Information Management System, aka “FSIMS.” I’ve yet to run across a 107 pilot familiar with the FSIMS, and recently was vehemently informed that “there is nothing beyond FAR Part 107 relative to sUAS. Au contraire…

Familiarity with the FSIMS may enlighten sUAS operator/pilots in how the FAA examines, investigates, and enforces relevant FARs.

Chapter 1 Sections 1, 2  and 4 are a brief, but important read, as is Chapter 2, Section 2.

Chapter 3 Section 1 is informational for those looking to apply for their RPC Part 107 Certificate.

Chapter 4 Sections 2, 5, 7, 8 are of particular value for commercial pilots operating under Part 107.

Volume 17, although related only to manned aviation, also has components related to 107, and should be read through (Chapters 3 & 4) by 107 pilots who want to be informed.

Gaining new information is always beneficial, and even better if the new information is implemented in your workflow and program. Become informed, be the best pilot you can be, and encourage others to recognize the value in being a true professional, informed and aware.