{"id":2208,"date":"2016-04-20T10:08:38","date_gmt":"2016-04-20T07:08:38","guid":{"rendered":"http:\/\/local.brightwhiz\/?p=2208"},"modified":"2016-04-20T10:08:38","modified_gmt":"2016-04-20T07:08:38","slug":"cudnn-nvidia-cuda-deep-neural-network","status":"publish","type":"post","link":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/","title":{"rendered":"NVIDIA CUDA Deep Neural Network library (cuDNN)"},"content":{"rendered":"<p>There are programming libraries for almost every conceivable thing out there and deep neural networks have not been left out. The NVIDIA CUDA Deep Neural Network library or cuDNN is one such library that comes with a host of benefits.<\/p>\n<p>cuDNN is part of the NVIDIA Deep Learning SDK provides implementations of standard functions for some of the functions areas such as pooling, normalization, activation layers, forward and backward convolution and more.<!--more--><\/p>\n<h2>So What are the Benefits of NVIDIA cuDNN?<\/h2>\n<p>No developer or researcher wants to spend unnecessary time tuning or optimizing a system when they need not be doing so. They are more interested in focusing on the actual work and getting results for their work.<\/p>\n<p>cuDNN helps in that it takes care of the bare bones stuff thereby freeing the users to work on more important parts of their research such as training neural networks and developing software applications.<\/p>\n<p>cuDNN is capable of accelerating several popular deep learning frameworks such as Theano, TensorFlow, Caffe, Torch, and CNTK among others. You can get a <a href=\"https:\/\/developer.nvidia.com\/deep-learning-frameworks\" target=\"_blank\" rel=\"noopener\">comprehensive list of supported frameworks here<\/a>.<\/p>\n<p>The most up-to-date version available for download is cuDNN 5 Release Candidate. Over previous versions, this release delivers quite a few benefits as highlighted below.<\/p>\n<ul>\n<li>On a single NVIDIA Pascal GPU, you can get over 40% fast training of the deep neural network<\/li>\n<li>You get up to 6 times more speed in Torch on LSTM recurrent neural networks<\/li>\n<li>You can now have accelerated networks with additional routines such as 3&#215;3 convolutions, such as VGG, GoogleNet, and ResNets<\/li>\n<li>Jetson TX1 now has support for cuDNN 5 and above releases<\/li>\n<li>On Pascal GPUs, you now get reduced memory usage with FP16 routines and subsequently increased performance<\/li>\n<\/ul>\n<p>The NVIDIA cuDNN is supported on Windows, Linux and Mac systems with Pascal, Kepler, Maxwell, Tegra K1 or Tegra X1 GPUs.<\/p>\n<p>To get the free NVIDIA cuDNN one would have to register and become a member of the <a href=\"https:\/\/developer.nvidia.com\/accelerated-computing-developer\" target=\"_blank\" rel=\"noopener\">Accelerated Computing Developer Program<\/a>.<\/p>\n<p>Ref:<\/p>\n<p><a href=\"https:\/\/developer.nvidia.com\/cudnn\" target=\"_blank\" rel=\"noopener\" class=\"broken_link\">Further Reading<\/a>: https:\/\/developer.nvidia.com\/cudnn<\/p>\n","protected":false},"excerpt":{"rendered":"<p>There are programming libraries for almost every conceivable thing out there and deep neural networks have not been left out. The NVIDIA CUDA Deep Neural Network library or cuDNN is&#8230;<\/p>\n","protected":false},"author":1,"featured_media":2209,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2,25,16],"tags":[33,111,147,172,184,280,291,319,350,412,433,449,545,591],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.3 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>cuDNN the NVIDIA CUDA Deep Neural Network library<\/title>\n<meta name=\"description\" content=\"Get the scoop on the latest on the NVIDIA CUDA Deep Neural Network library better known as cuDNN and what is has to offer with the latest release\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"cuDNN the NVIDIA CUDA Deep Neural Network library\" \/>\n<meta property=\"og:description\" content=\"Get the scoop on the latest on the NVIDIA CUDA Deep Neural Network library better known as cuDNN and what is has to offer with the latest release\" \/>\n<meta property=\"og:url\" content=\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/\" \/>\n<meta property=\"og:site_name\" content=\"Brightwhiz.com\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/brightwhiz\/\" \/>\n<meta property=\"article:published_time\" content=\"2016-04-20T07:08:38+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"630\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Michael Bright\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@brightwhizmag\" \/>\n<meta name=\"twitter:site\" content=\"@brightwhizmag\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Michael Bright\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#article\",\"isPartOf\":{\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/\"},\"author\":{\"name\":\"Michael Bright\",\"@id\":\"http:\/\/local.brightwhiz\/#\/schema\/person\/81f0f3126f13834ae2e7f381b3028e32\"},\"headline\":\"NVIDIA CUDA Deep Neural Network library (cuDNN)\",\"datePublished\":\"2016-04-20T07:08:38+00:00\",\"dateModified\":\"2016-04-20T07:08:38+00:00\",\"mainEntityOfPage\":{\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/\"},\"wordCount\":338,\"commentCount\":0,\"publisher\":{\"@id\":\"http:\/\/local.brightwhiz\/#organization\"},\"image\":{\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg\",\"keywords\":[\"3D\",\"C++\",\"Computer Program\",\"CUDA\",\"Debugging\",\"GPU\",\"Hardware\",\"Interactive Technics\",\"Libraries\",\"NVIDIA\",\"Optimization\",\"Performance\",\"Software Engineering\",\"Tools\"],\"articleSection\":[\"Articles\",\"Libraries\",\"Technology\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/\",\"url\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/\",\"name\":\"cuDNN the NVIDIA CUDA Deep Neural Network library\",\"isPartOf\":{\"@id\":\"http:\/\/local.brightwhiz\/#website\"},\"primaryImageOfPage\":{\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#primaryimage\"},\"image\":{\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#primaryimage\"},\"thumbnailUrl\":\"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg\",\"datePublished\":\"2016-04-20T07:08:38+00:00\",\"dateModified\":\"2016-04-20T07:08:38+00:00\",\"description\":\"Get the scoop on the latest on the NVIDIA CUDA Deep Neural Network library better known as cuDNN and what is has to offer with the latest release\",\"breadcrumb\":{\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#primaryimage\",\"url\":\"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg\",\"contentUrl\":\"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg\",\"width\":1200,\"height\":630,\"caption\":\"NVIDIA cuDNN\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"http:\/\/local.brightwhiz\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"NVIDIA CUDA Deep Neural Network library (cuDNN)\"}]},{\"@type\":\"WebSite\",\"@id\":\"http:\/\/local.brightwhiz\/#website\",\"url\":\"http:\/\/local.brightwhiz\/\",\"name\":\"Brightwhiz.com\",\"description\":\"Best Tech guides, Tutorials, and News\",\"publisher\":{\"@id\":\"http:\/\/local.brightwhiz\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"http:\/\/local.brightwhiz\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"http:\/\/local.brightwhiz\/#organization\",\"name\":\"Brightwhiz\",\"url\":\"http:\/\/local.brightwhiz\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/local.brightwhiz\/#\/schema\/logo\/image\/\",\"url\":\"http:\/\/local.brightwhiz\/wp-content\/uploads\/2021\/11\/brightwhiz-com-logo-orange.png\",\"contentUrl\":\"http:\/\/local.brightwhiz\/wp-content\/uploads\/2021\/11\/brightwhiz-com-logo-orange.png\",\"width\":706,\"height\":135,\"caption\":\"Brightwhiz\"},\"image\":{\"@id\":\"http:\/\/local.brightwhiz\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/brightwhiz\/\",\"https:\/\/twitter.com\/brightwhizmag\",\"https:\/\/instagram.com\/bright_whiz\/\",\"https:\/\/www.pinterest.com\/sobbayi\/\",\"https:\/\/www.youtube.com\/channel\/UC6sCdP_d_RiTIM7ErFT-PSQ\"]},{\"@type\":\"Person\",\"@id\":\"http:\/\/local.brightwhiz\/#\/schema\/person\/81f0f3126f13834ae2e7f381b3028e32\",\"name\":\"Michael Bright\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"http:\/\/local.brightwhiz\/#\/schema\/person\/image\/\",\"url\":\"http:\/\/1.gravatar.com\/avatar\/da90485875ff0aafa38fdd494abe87d1?s=96&d=mm&r=g\",\"contentUrl\":\"http:\/\/1.gravatar.com\/avatar\/da90485875ff0aafa38fdd494abe87d1?s=96&d=mm&r=g\",\"caption\":\"Michael Bright\"},\"sameAs\":[\"https:\/\/sobbayi.com\"],\"url\":\"http:\/\/local.brightwhiz\/author\/sobbayiadmin\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"cuDNN the NVIDIA CUDA Deep Neural Network library","description":"Get the scoop on the latest on the NVIDIA CUDA Deep Neural Network library better known as cuDNN and what is has to offer with the latest release","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/","og_locale":"en_US","og_type":"article","og_title":"cuDNN the NVIDIA CUDA Deep Neural Network library","og_description":"Get the scoop on the latest on the NVIDIA CUDA Deep Neural Network library better known as cuDNN and what is has to offer with the latest release","og_url":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/","og_site_name":"Brightwhiz.com","article_publisher":"https:\/\/www.facebook.com\/brightwhiz\/","article_published_time":"2016-04-20T07:08:38+00:00","og_image":[{"width":1200,"height":630,"url":"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg","type":"image\/jpeg"}],"author":"Michael Bright","twitter_card":"summary_large_image","twitter_creator":"@brightwhizmag","twitter_site":"@brightwhizmag","twitter_misc":{"Written by":"Michael Bright","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#article","isPartOf":{"@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/"},"author":{"name":"Michael Bright","@id":"http:\/\/local.brightwhiz\/#\/schema\/person\/81f0f3126f13834ae2e7f381b3028e32"},"headline":"NVIDIA CUDA Deep Neural Network library (cuDNN)","datePublished":"2016-04-20T07:08:38+00:00","dateModified":"2016-04-20T07:08:38+00:00","mainEntityOfPage":{"@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/"},"wordCount":338,"commentCount":0,"publisher":{"@id":"http:\/\/local.brightwhiz\/#organization"},"image":{"@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#primaryimage"},"thumbnailUrl":"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg","keywords":["3D","C++","Computer Program","CUDA","Debugging","GPU","Hardware","Interactive Technics","Libraries","NVIDIA","Optimization","Performance","Software Engineering","Tools"],"articleSection":["Articles","Libraries","Technology"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#respond"]}]},{"@type":"WebPage","@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/","url":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/","name":"cuDNN the NVIDIA CUDA Deep Neural Network library","isPartOf":{"@id":"http:\/\/local.brightwhiz\/#website"},"primaryImageOfPage":{"@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#primaryimage"},"image":{"@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#primaryimage"},"thumbnailUrl":"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg","datePublished":"2016-04-20T07:08:38+00:00","dateModified":"2016-04-20T07:08:38+00:00","description":"Get the scoop on the latest on the NVIDIA CUDA Deep Neural Network library better known as cuDNN and what is has to offer with the latest release","breadcrumb":{"@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#primaryimage","url":"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg","contentUrl":"http:\/\/local.brightwhiz\/wp-content\/uploads\/2016\/04\/NVIDIA-cuDNN.jpg","width":1200,"height":630,"caption":"NVIDIA cuDNN"},{"@type":"BreadcrumbList","@id":"http:\/\/local.brightwhiz\/cudnn-nvidia-cuda-deep-neural-network\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"http:\/\/local.brightwhiz\/"},{"@type":"ListItem","position":2,"name":"NVIDIA CUDA Deep Neural Network library (cuDNN)"}]},{"@type":"WebSite","@id":"http:\/\/local.brightwhiz\/#website","url":"http:\/\/local.brightwhiz\/","name":"Brightwhiz.com","description":"Best Tech guides, Tutorials, and News","publisher":{"@id":"http:\/\/local.brightwhiz\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"http:\/\/local.brightwhiz\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"http:\/\/local.brightwhiz\/#organization","name":"Brightwhiz","url":"http:\/\/local.brightwhiz\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/local.brightwhiz\/#\/schema\/logo\/image\/","url":"http:\/\/local.brightwhiz\/wp-content\/uploads\/2021\/11\/brightwhiz-com-logo-orange.png","contentUrl":"http:\/\/local.brightwhiz\/wp-content\/uploads\/2021\/11\/brightwhiz-com-logo-orange.png","width":706,"height":135,"caption":"Brightwhiz"},"image":{"@id":"http:\/\/local.brightwhiz\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/brightwhiz\/","https:\/\/twitter.com\/brightwhizmag","https:\/\/instagram.com\/bright_whiz\/","https:\/\/www.pinterest.com\/sobbayi\/","https:\/\/www.youtube.com\/channel\/UC6sCdP_d_RiTIM7ErFT-PSQ"]},{"@type":"Person","@id":"http:\/\/local.brightwhiz\/#\/schema\/person\/81f0f3126f13834ae2e7f381b3028e32","name":"Michael Bright","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"http:\/\/local.brightwhiz\/#\/schema\/person\/image\/","url":"http:\/\/1.gravatar.com\/avatar\/da90485875ff0aafa38fdd494abe87d1?s=96&d=mm&r=g","contentUrl":"http:\/\/1.gravatar.com\/avatar\/da90485875ff0aafa38fdd494abe87d1?s=96&d=mm&r=g","caption":"Michael Bright"},"sameAs":["https:\/\/sobbayi.com"],"url":"http:\/\/local.brightwhiz\/author\/sobbayiadmin\/"}]}},"_links":{"self":[{"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/posts\/2208"}],"collection":[{"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/comments?post=2208"}],"version-history":[{"count":0,"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/posts\/2208\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/media\/2209"}],"wp:attachment":[{"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/media?parent=2208"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/categories?post=2208"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/local.brightwhiz\/wp-json\/wp\/v2\/tags?post=2208"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}