{"id":118799,"date":"2020-06-17T16:04:42","date_gmt":"2020-06-17T16:04:42","guid":{"rendered":"https:\/\/blogs.nvidia.com\/?p=45843"},"modified":"2020-06-17T16:04:42","modified_gmt":"2020-06-17T16:04:42","slug":"checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development","status":"publish","type":"post","link":"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/","title":{"rendered":"Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development"},"content":{"rendered":"<div id=\"bsf_rt_marker\"><p>The NVIDIA DRIVE Labs video series provides an inside look at how self-driving software is developed. One year and <a href=\"https:\/\/www.nvidia.com\/en-us\/self-driving-cars\/drive-labs\/\">20 episodes<\/a> later, it\u2019s clear there\u2019s nearly endless ground to cover.<\/p>\n<p>The series dives into topics ranging from <a href=\"https:\/\/news.developer.nvidia.com\/drive-labs-tracking-objects-with-surround-camera-vision\/\">360-degree perception<\/a> to <a href=\"https:\/\/blogs.nvidia.com\/blog\/2019\/10\/23\/drive-labs-panoptic-segmentation\/\">panoptic segmentation<\/a>, and even <a href=\"https:\/\/blogs.nvidia.com\/blog\/2019\/05\/22\/drive-labs-predicting-future-motion\/\">predicting the future<\/a>. Autonomous vehicles are one of the great computing challenges of our time, and we\u2019re approaching software development one building block at a time.<\/p>\n<p>DRIVE Labs is meant to inform and educate. Whether you\u2019re just beginning to learn about this transformative technology or have been working on it for a decade, the series is a window into what we at NVIDIA view as the most important development challenges and how we\u2019re approaching them for safer, more efficient transportation.<\/p>\n<p>Here\u2019s a brief look at what we\u2019ve covered this past year, and how we\u2019re planning for the road ahead.<\/p>\n<h2><b>A Cross-Section of Perception Networks<\/b><\/h2>\n<p>Before a vehicle plans a path and executes a driving decision, it must be able to see and understand the entire environment around the vehicle.<\/p>\n<p>DRIVE Labs has detailed a variety of the deep neural networks responsible for vehicle perception. Our approach relies on redundant and diverse DNNs \u2014 our models cover a variety of capabilities, like <a href=\"https:\/\/blogs.nvidia.com\/blog\/2019\/05\/10\/drive-labs-intersection-detection\/\">detecting intersections<\/a>, <a href=\"https:\/\/news.developer.nvidia.com\/drive-labs-signnet-and-lighnet-dnns\/\">detecting traffic lights and traffic signs<\/a> and understanding <a href=\"https:\/\/blogs.nvidia.com\/blog\/2020\/05\/27\/drive-labs-how-ai-helps-autonomous-vehicles-understand-intersections\/\">intersection structure<\/a>. They\u2019re also capable of multiple tasks, like <a href=\"https:\/\/blogs.nvidia.com\/blog\/2019\/09\/11\/drive-labs-ai-parking\/\">spotting parking spaces<\/a> or <a href=\"https:\/\/news.developer.nvidia.com\/drive-labs-helping-cameras-see-clearly-with-ai\/\">detecting whether sensors are obstructed<\/a>.<\/p>\n<p><iframe title=\"How AI Helps Autonomous Vehicles Perceive Intersection Structure\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/KPLTA4S_3Yo?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>These DNNs do more than draw bounding boxes around pedestrians and traffic signals. They can <a href=\"https:\/\/blogs.nvidia.com\/blog\/2019\/10\/23\/drive-labs-panoptic-segmentation\/\">break down images pixel by pixel<\/a> for enhanced accuracy, and even <a href=\"https:\/\/news.developer.nvidia.com\/drive-labs-visual-feature-tracking-for-autonomous-vehicles\/\">track those pixels through time<\/a> for precise positioning information.<\/p>\n<p><iframe title=\"Pixel-Perfect Perception: How AI Helps Autonomous Vehicles See Outside the Box\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/HS1wV9NMLr8?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>For nighttime driving, <a href=\"https:\/\/news.developer.nvidia.com\/dnn-based-perception-for-automatic-high-beam-control\/\">AutoHighBeamNet<\/a> enables automated vehicle headlight control, while our<a href=\"https:\/\/blogs.nvidia.com\/blog\/2020\/01\/16\/what-is-active-learning\/\"> active learning approach<\/a> improves pedestrian detection in the dark.<\/p>\n<p><iframe title=\"How Active Learning Improves Nighttime Pedestrian Detection\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/4aq13pB9s7c?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>DNNs also make it possible to <a href=\"https:\/\/blogs.nvidia.com\/blog\/2019\/06\/19\/drive-labs-distance-to-object-detection\/\">extract 3D distances from 2D camera images<\/a> for accurate motion planning.<\/p>\n<p>And our perception capabilities operate all around the vehicle. With <a href=\"https:\/\/news.developer.nvidia.com\/drive-labs-tracking-objects-with-surround-camera-vision\/\">surround camera object tracking<\/a> and <a href=\"https:\/\/news.developer.nvidia.com\/drive-labs-covering-every-angle-with-surround-camera-radar-fusion\/\">surround camera-radar fusion<\/a>, we ensure there are no perception blind spots.<\/p>\n<h2><b>Predicting the Road Ahead<\/b><\/h2>\n<p>In addition to perceiving their environment, autonomous vehicles must be able to understand how other road actors behave to plan a safe path forward.<\/p>\n<p>With <a href=\"https:\/\/blogs.nvidia.com\/blog\/2019\/05\/22\/drive-labs-predicting-future-motion\/\">recurrent neural networks<\/a>, DRIVE Labs has shown how a self-driving car can use past insights about an object\u2019s motion to compute future motion predictions.<\/p>\n<p><iframe title=\"NVIDIA DRIVE Labs: Predicting the Future with RNNs\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/OT_MxopvfQ0?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>Our <a href=\"https:\/\/news.developer.nvidia.com\/drive-labs-eliminating-collisions-with-safety-force-field\/\">Safety Force Field<\/a> collision avoidance software adds diversity and redundancy to planning and control software. It constantly runs in the background to double-check controls from the primary system and veto any action that it deems to be unsafe.<\/p>\n<p><iframe title=\"NVIDIA DRIVE Labs: Eliminating Collisions with Safety Force Field\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/V1f0iXNkyOo?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe><\/p>\n<p>The DNNs and software components are just a sampling of the development that goes into an autonomous vehicle. This monumental challenge requires rigorous training and testing, both in the data center and the vehicle. And as transportation continues to change, the vehicle software must be able to adapt.<\/p>\n<p>We\u2019ll explore these topics and more in upcoming DRIVE Labs episodes. As we continue to advance self-driving car software development, we\u2019ll share those insights with you.<\/p>\n<\/div><p>The post <a rel=\"nofollow\" href=\"https:\/\/blogs.nvidia.com\/blog\/2020\/06\/17\/drive-labs-year-of-self-driving-development\/\">Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development<\/a> appeared first on <a rel=\"nofollow\" href=\"https:\/\/blogs.nvidia.com\/\">The Official NVIDIA Blog<\/a>.<\/p>\n<div class=\"feedflare\">\n<a href=\"http:\/\/feeds.feedburner.com\/~ff\/nvidiablog?a=k4C44BWsJHI:ASdK7396tI4:yIl2AUoC8zA\"><img src=\"http:\/\/feeds.feedburner.com\/~ff\/nvidiablog?d=yIl2AUoC8zA\" border=\"0\"\/><\/a> <a href=\"http:\/\/feeds.feedburner.com\/~ff\/nvidiablog?a=k4C44BWsJHI:ASdK7396tI4:V_sGLiPBpWU\"><img src=\"http:\/\/feeds.feedburner.com\/~ff\/nvidiablog?i=k4C44BWsJHI:ASdK7396tI4:V_sGLiPBpWU\" border=\"0\"\/><\/a>\n<\/div><img src=\"http:\/\/feeds.feedburner.com\/~r\/nvidiablog\/~4\/k4C44BWsJHI\" height=\"1\" width=\"1\" alt=\"\"\/>","protected":false},"excerpt":{"rendered":"<p>The NVIDIA DRIVE Labs video series provides an inside look at how self-driving software is developed. One year and 20 episodes later, it&rsquo;s clear there&rsquo;s nearly endless ground to cover. The series dives into topics ranging from 360-degree perception to panoptic segmentation, and even predicting the future. Autonomous vehicles are one of the great computing <a href=\"https:\/\/blogs.nvidia.com\/blog\/2020\/06\/17\/drive-labs-year-of-self-driving-development\/\">Read article &gt;<\/a><\/p>\n<p>The post <a rel=\"nofollow\" href=\"https:\/\/blogs.nvidia.com\/blog\/2020\/06\/17\/drive-labs-year-of-self-driving-development\/\">Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development<\/a> appeared first on <a rel=\"nofollow\" href=\"https:\/\/blogs.nvidia.com\/\">The Official NVIDIA Blog<\/a>.<\/p>\n","protected":false},"author":302,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_mi_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[343],"tags":[482,12128,4436,4047],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development - WebDomino.NET<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development - WebDomino.NET\" \/>\n<meta property=\"og:description\" content=\"The NVIDIA DRIVE Labs video series provides an inside look at how self-driving software is developed. One year and 20 episodes later, it&rsquo;s clear there&rsquo;s nearly endless ground to cover. The series dives into topics ranging from 360-degree perception to panoptic segmentation, and even predicting the future. Autonomous vehicles are one of the great computing Read article &gt; The post Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development appeared first on The Official NVIDIA Blog.\" \/>\n<meta property=\"og:url\" content=\"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/\" \/>\n<meta property=\"og:site_name\" content=\"WebDomino.NET\" \/>\n<meta property=\"article:published_time\" content=\"2020-06-17T16:04:42+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/feeds.feedburner.com\/~ff\/nvidiablog?d=yIl2AUoC8zA\" \/>\n<meta name=\"author\" content=\"Neda Cvijetic\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Neda Cvijetic\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/\",\"url\":\"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/\",\"name\":\"Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development - WebDomino.NET\",\"isPartOf\":{\"@id\":\"https:\/\/webdomino.net\/#website\"},\"datePublished\":\"2020-06-17T16:04:42+00:00\",\"dateModified\":\"2020-06-17T16:04:42+00:00\",\"author\":{\"@id\":\"https:\/\/webdomino.net\/#\/schema\/person\/85db1b6dfc1f3a5af4657c48d2c25d09\"},\"breadcrumb\":{\"@id\":\"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/webdomino.net\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/webdomino.net\/#website\",\"url\":\"https:\/\/webdomino.net\/\",\"name\":\"WebDomino.NET\",\"description\":\"Global NEWS WordPress site\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/webdomino.net\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/webdomino.net\/#\/schema\/person\/85db1b6dfc1f3a5af4657c48d2c25d09\",\"name\":\"Neda Cvijetic\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/webdomino.net\/#\/schema\/person\/image\/\",\"url\":\"http:\/\/0.gravatar.com\/avatar\/ce16594d3cd0d2115bf55f6e24a596a9?s=96&d=mm&r=g\",\"contentUrl\":\"http:\/\/0.gravatar.com\/avatar\/ce16594d3cd0d2115bf55f6e24a596a9?s=96&d=mm&r=g\",\"caption\":\"Neda Cvijetic\"},\"sameAs\":[\"https:\/\/nvidianews.nvidia.com\"],\"url\":\"http:\/\/webdomino.net\/index.php\/author\/neda-cvijetic\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development - WebDomino.NET","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/","og_locale":"en_US","og_type":"article","og_title":"Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development - WebDomino.NET","og_description":"The NVIDIA DRIVE Labs video series provides an inside look at how self-driving software is developed. One year and 20 episodes later, it&rsquo;s clear there&rsquo;s nearly endless ground to cover. The series dives into topics ranging from 360-degree perception to panoptic segmentation, and even predicting the future. Autonomous vehicles are one of the great computing Read article &gt; The post Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development appeared first on The Official NVIDIA Blog.","og_url":"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/","og_site_name":"WebDomino.NET","article_published_time":"2020-06-17T16:04:42+00:00","og_image":[{"url":"http:\/\/feeds.feedburner.com\/~ff\/nvidiablog?d=yIl2AUoC8zA"}],"author":"Neda Cvijetic","twitter_misc":{"Written by":"Neda Cvijetic","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/","url":"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/","name":"Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development - WebDomino.NET","isPartOf":{"@id":"https:\/\/webdomino.net\/#website"},"datePublished":"2020-06-17T16:04:42+00:00","dateModified":"2020-06-17T16:04:42+00:00","author":{"@id":"https:\/\/webdomino.net\/#\/schema\/person\/85db1b6dfc1f3a5af4657c48d2c25d09"},"breadcrumb":{"@id":"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/"]}]},{"@type":"BreadcrumbList","@id":"http:\/\/webdomino.net\/index.php\/nvidia\/checking-the-rearview-mirror-nvidia-drive-labs-looks-back-at-year-of-self-driving-software-development\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/webdomino.net\/"},{"@type":"ListItem","position":2,"name":"Checking the Rearview Mirror: NVIDIA DRIVE Labs Looks Back at Year of Self-Driving Software Development"}]},{"@type":"WebSite","@id":"https:\/\/webdomino.net\/#website","url":"https:\/\/webdomino.net\/","name":"WebDomino.NET","description":"Global NEWS WordPress site","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/webdomino.net\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/webdomino.net\/#\/schema\/person\/85db1b6dfc1f3a5af4657c48d2c25d09","name":"Neda Cvijetic","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/webdomino.net\/#\/schema\/person\/image\/","url":"http:\/\/0.gravatar.com\/avatar\/ce16594d3cd0d2115bf55f6e24a596a9?s=96&d=mm&r=g","contentUrl":"http:\/\/0.gravatar.com\/avatar\/ce16594d3cd0d2115bf55f6e24a596a9?s=96&d=mm&r=g","caption":"Neda Cvijetic"},"sameAs":["https:\/\/nvidianews.nvidia.com"],"url":"http:\/\/webdomino.net\/index.php\/author\/neda-cvijetic\/"}]}},"_links":{"self":[{"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/posts\/118799"}],"collection":[{"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/users\/302"}],"replies":[{"embeddable":true,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/comments?post=118799"}],"version-history":[{"count":1,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/posts\/118799\/revisions"}],"predecessor-version":[{"id":118800,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/posts\/118799\/revisions\/118800"}],"wp:attachment":[{"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/media?parent=118799"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/categories?post=118799"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/webdomino.net\/index.php\/wp-json\/wp\/v2\/tags?post=118799"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}