{"id":979,"date":"2018-01-07T23:53:10","date_gmt":"2018-01-07T23:53:10","guid":{"rendered":"http:\/\/wiki.thomasandsofia.com\/?p=979"},"modified":"2018-03-21T02:29:00","modified_gmt":"2018-03-21T02:29:00","slug":"azure-storage","status":"publish","type":"post","link":"https:\/\/wiki.thomasandsofia.com\/?p=979","title":{"rendered":"Azure Storage"},"content":{"rendered":"<p><a href=\"https:\/\/channel9.msdn.com\/Shows\/TechNet+Radio\/TNR1669\" target=\"_blank\" rel=\"noopener\">https:\/\/channel9.msdn.com\/Shows\/TechNet+Radio\/TNR1669<\/a><\/p>\n<p><a href=\"http:\/\/wiki.thomasandsofia.com\/2018\/01\/22\/azure-for-aws-professionals-menu\/\">Main Menu<\/a><\/p>\n<h2>Azure Storage<\/h2>\n<h3>Overview<\/h3>\n<ul>\n<li>Possibly the #1 use for Aure<\/li>\n<li>Multi-petabyte<\/li>\n<li>2 Flavors\n<ul>\n<li>Azure Standard<\/li>\n<li>Azure Premium<\/li>\n<\/ul>\n<\/li>\n<li>Standard Storage Account (Magnetic based)\n<ul>\n<li>Durable and HA<\/li>\n<li>Blob Object\n<ul>\n<li>Page Blobs\n<ul>\n<li>Acts as a Virtual Hard Disk<\/li>\n<li>VHD Format\n<ul>\n<li>Compatible with Hyper-V and other technologies<\/li>\n<li>1 TB Max per disk, but can stripe multiple disks for more storage.<\/li>\n<li>Up to 64 TB with G-Series VMs<\/li>\n<li><\/li>\n<\/ul>\n<\/li>\n<li>Exact same storage technology\/system used by Blob storage, so 3 copies, very durable.<\/li>\n<li>Up to 64 TB with G-Series VMs<\/li>\n<li>Up to 500 IOPs per disk\n<ul>\n<li>Very fast with striping &#8211; IOPs are added together.<\/li>\n<\/ul>\n<\/li>\n<li>Page B<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>File Storage<\/li>\n<li>Table Storage<\/li>\n<li>Queue Storage<\/li>\n<\/ul>\n<\/li>\n<li>Premium Storage\n<ul>\n<li><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/virtual-machines\/windows\/premium-storage\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.microsoft.com\/en-us\/azure\/virtual-machines\/windows\/premium-storage<\/a><\/li>\n<li>B-series, DS-series, DSv2-series, DSv3-series, GS-series, Ls-series, M-series and Fs-series<\/li>\n<li>High IOPs, SSD Based<\/li>\n<li>Block Storage<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h3>HA<\/h3>\n<ul>\n<li>Every block of data sychronously written to 3 separate physical &#8220;fault domains&#8221; within a Storage Stamp, within a Region.\n<ul>\n<li>Eliminates any Single Point of Failure<\/li>\n<li>If one of the fault domains storage units fails, the remaining 2 continue to read and write while simultaneously rebuilding the failed drive.<\/li>\n<\/ul>\n<\/li>\n<li>Geo-Replicated\n<ul>\n<li>Good for Disaster Recovery<\/li>\n<li>Copies data Asychronously across different regions.<\/li>\n<li>Remote copies also have 3 physical storage devices.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h3>Page Blobs<\/h3>\n<ul>\n<li><span style=\"color: #ff6600;\">AWS EBS<\/span><\/li>\n<li>Acts as a Virtual Hard Disk<\/li>\n<li>VHD Format\n<ul>\n<li>Compatible with Hyper-V and other technologies<\/li>\n<\/ul>\n<\/li>\n<li>1 TB Max per disk, but can stripe multiple disks for more storage.<\/li>\n<li>Exact same storage technology\/system used by Blob storage, so 3 copies, very durable.<\/li>\n<li>Up to 64 TB with G-Series VMs (Via striping)<\/li>\n<li>Up to 500 IOPs per disk\n<ul>\n<li>Very fast with striping &#8211; IOPs are added together.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h3>VMs &amp; Page Blobs<\/h3>\n<p><a href=\"http:\/\/wiki.thomasandsofia.com\/wp-content\/uploads\/2018\/01\/azurepageblobs.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-980\" src=\"http:\/\/wiki.thomasandsofia.com\/wp-content\/uploads\/2018\/01\/azurepageblobs.png\" alt=\"\" width=\"1106\" height=\"554\" srcset=\"https:\/\/wiki.thomasandsofia.com\/wp-content\/uploads\/2018\/01\/azurepageblobs.png 1106w, https:\/\/wiki.thomasandsofia.com\/wp-content\/uploads\/2018\/01\/azurepageblobs-300x150.png 300w, https:\/\/wiki.thomasandsofia.com\/wp-content\/uploads\/2018\/01\/azurepageblobs-768x385.png 768w, https:\/\/wiki.thomasandsofia.com\/wp-content\/uploads\/2018\/01\/azurepageblobs-1024x513.png 1024w, https:\/\/wiki.thomasandsofia.com\/wp-content\/uploads\/2018\/01\/azurepageblobs-150x75.png 150w\" sizes=\"auto, (max-width: 1106px) 100vw, 1106px\" \/><\/a><\/p>\n<ul>\n<li>Root storage is stored as a Page Blob (Windows C:\\ or Linux \/)\n<ul>\n<li>Includes a Host Level disk cache for frequently accessed data<\/li>\n<\/ul>\n<\/li>\n<li>VM gets a Temporary Disk (Windows D:\\ or Linux &#8216;swap&#8217;)\n<ul>\n<li>Ephemeral &#8211; lost on reboot<\/li>\n<li>Not persistently backed to Blob Storage<\/li>\n<li>Do Not Use for anything you need to keep!<\/li>\n<\/ul>\n<\/li>\n<li>Persistent data should be stored to additional Page Blob disks: E:\\, F:\\, etc.\n<ul>\n<li>Possible to Terminate a VM or just shut it down (deallocated state) but keep the data disks\n<ul>\n<li>In De-allocated state:\n<ul>\n<li>Not reserving any CPU, Memory, IP addresses, etc.<\/li>\n<li>No &#8216;Compute&#8217; costs<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h3>Azure Files<\/h3>\n<ul>\n<li><span style=\"color: #ff6600;\">AWS EFS<\/span><\/li>\n<li>SMB 3.0 or CIFS\n<ul>\n<li>The <em>Common Internet File System<\/em> (CIFS) is the standard way that computer users share files across corporate intranets and the Internet. An enhanced version of the Microsoft open, cross-platform Server Message Block (SMB) protocol, CIFS is a native file-sharing protocol in Windows\u00a02000.<\/li>\n<\/ul>\n<\/li>\n<li>No need to spin up File Servers &#8211; works automatically<\/li>\n<li>Shared location between VMs\n<ul>\n<li>Configurations<\/li>\n<li>Common Logs<\/li>\n<li>Web Applications<\/li>\n<\/ul>\n<\/li>\n<li>Maps the same as any other mount location (G:\\, \/mnt\/share, etc.)<\/li>\n<\/ul>\n<h3>Azure Premium Storage<\/h3>\n<p><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/virtual-machines\/windows\/premium-storage\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.microsoft.com\/en-us\/azure\/virtual-machines\/windows\/premium-storage<\/a><\/p>\n<ul>\n<li><span style=\"color: #ff6600;\">AWS Provisioned IOPs<\/span><\/li>\n<li>All SSD<\/li>\n<li>Low Latency, predictable IO throughput\n<ul>\n<li>Single digit millisecond latencies<\/li>\n<\/ul>\n<\/li>\n<li>Up to 1TB blob\/disk size\n<ul>\n<li>Stripe up to 64 disks for 64TB\n<ul>\n<li>more than 84,000 IOPs<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>Designed to be used with specific classes of VMs\n<ul>\n<li>DS &amp; GS\n<ul>\n<li>&#8216;S&#8217; stands for SSD<\/li>\n<li>These have high speed connectivity back to the storage devices.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<table>\n<tbody>\n<tr>\n<th>Disk Types<\/th>\n<th>P4<\/th>\n<th>P6<\/th>\n<th>P10<\/th>\n<th>P20<\/th>\n<th>P30<\/th>\n<th>P40<\/th>\n<th>P50<\/th>\n<\/tr>\n<tr>\n<td>Disk Size<\/td>\n<td>32 GB<\/td>\n<td>64 GB<\/td>\n<td>128 GB<\/td>\n<td>512 GB<\/td>\n<td>1024 GB<\/td>\n<td>2048 GB<\/td>\n<td>4095 GB<\/td>\n<\/tr>\n<tr>\n<td>IOPs\/Disk<\/td>\n<td>120<\/td>\n<td>240<\/td>\n<td>500<\/td>\n<td>2300<\/td>\n<td>5000<\/td>\n<td>7500<\/td>\n<td>7500<\/td>\n<\/tr>\n<tr>\n<td>Throughput\/Disk<\/td>\n<td>25 MBps<\/td>\n<td>50 MBps<\/td>\n<td>100 MBps<\/td>\n<td>150 MBps<\/td>\n<td>200 MBps<\/td>\n<td>250 MBps<\/td>\n<td>250 MBps<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<h2>Storage Accounts<\/h2>\n<ul>\n<li>500 TiB MAXIMUM per Storage Account\n<ul>\n<li>To increase storage, you need more Storage Accounts\n<ul>\n<li>Max 200 Storage Accounts per subscription<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>Require a unique name (globally?)<\/li>\n<li>Deployment Model\n<ul>\n<li>Resource Manager or Classic<\/li>\n<\/ul>\n<\/li>\n<li>Account Kind\n<ul>\n<li>General Purpose\n<ul>\n<li>V1\n<ul>\n<li>All types discussed above<\/li>\n<li>Cannot do Hot\/Cool<\/li>\n<li>Slightly lower cost per transaction than v2<\/li>\n<li>Works in Classic model<\/li>\n<\/ul>\n<\/li>\n<li>V2\n<ul>\n<li>All types discussed above<\/li>\n<li>CAN do hot \/ cool<\/li>\n<li>Recommended<\/li>\n<li>Does not work in Classic Model (ARM only)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>Blob Storage (S3?)\n<ul>\n<li>Access Tier\n<ul>\n<li>Cool &#8211; Infrequently Accessed (Lower cost tier)\n<ul>\n<li>Same Durability and Performance<\/li>\n<li>Charge per GB Read &#8211; Pay to access (AWS IA)<\/li>\n<\/ul>\n<\/li>\n<li>Hot &#8211; Standard S3<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>Performance\n<ul>\n<li>Standard or Premium\n<ul>\n<li>Grayed out when not available<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>Replication\n<ul>\n<li>Locally-redundant storage (LRS) (Default, 3 synchronous writes)\n<ul>\n<li>Fastest<\/li>\n<\/ul>\n<\/li>\n<li>Zone-redundant storage (ZRS)\n<ul>\n<li>For Block Blob storage<\/li>\n<li>Stored in multiple zones within an Azure Region (something like &#8220;multi-AZ&#8221;?)<\/li>\n<\/ul>\n<\/li>\n<li>Geo-redundant (GRS)<\/li>\n<li>Read-Access Geo-Redundant (RA-GRS)<\/li>\n<li>Use Cases\n<ul>\n<li>Objects (Block blobs, queues, tables)\n<ul>\n<li>GRS or RA-GRS<\/li>\n<\/ul>\n<\/li>\n<li>VHDs (Especially with high IOPs requirements)\n<ul>\n<li>LRS<\/li>\n<\/ul>\n<\/li>\n<li>Images or backup copies of VHDs\n<ul>\n<li>GRS<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h2>Managed Disks<\/h2>\n<p><a href=\"https:\/\/buildwindows.wordpress.com\/2017\/05\/31\/azure-managed-vs-unmanaged-disks-the-choice\/\">Azure Managed vs Unmanaged disks : The&nbsp;choice<\/a><\/p>\n<p>This is not part of the training, due to the age of the course.<\/p>\n<table>\n<tr>\n<th>Category<\/th>\n<th>Managed<\/th>\n<th>Storage Account<\/th>\n<\/tr>\n<tr>\n<th>Management<\/th>\n<td>Azure Resource Manager object<\/td>\n<td>Storage Account .vhd file on a blob<\/td>\n<\/tr>\n<tr>\n<th>Size<\/th>\n<td>Pre-determined sizes only<\/td>\n<td>Variable<\/td>\n<\/tr>\n<tr>\n<th>Cost<\/th>\n<td>Pay per size<\/td>\n<td>Pay for what you use<\/td>\n<\/tr>\n<tr>\n<th>Performance<\/th>\n<td>Predictable 500 IOPs<\/td>\n<td>500IOPs but might be impacted by Storage Account Limits\/throttling<\/td>\n<\/tr>\n<tr>\n<th>Availability<\/th>\n<td>Guaranteed different Availability Sets<\/td>\n<td>Not guaranteed<\/td>\n<\/tr>\n<tr>\n<th>Redundancy<\/th>\n<td>LRS<\/td>\n<td>LRS, GRS<\/td>\n<\/tr>\n<tr>\n<th>Encryption<\/th>\n<td>ADE, SSE (coming soon)<\/td>\n<td>ADE, SSE<\/td>\n<\/tr>\n<\/table>\n<p>Managed Disks<\/p>\n<p>&nbsp;<\/p>\n<h2>Storage CLI<\/h2>\n<h3>List all available commands<\/h3>\n<pre>azure storage --help<\/pre>\n<h3>View all available storage accounts<\/h3>\n<pre>azure storage account list<\/pre>\n<h3>Create a new Storage Account<\/h3>\n<pre>azure storage account create  --resource-group  --sku-name &lt;GRS\/LRS\/etc&gt; --location  --kind &lt;storage&gt;<\/pre>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>https:\/\/channel9.msdn.com\/Shows\/TechNet+Radio\/TNR1669 Main Menu Azure Storage Overview Possibly the #1 use for Aure Multi-petabyte 2 Flavors Azure Standard Azure Premium Standard Storage Account (Magnetic based) Durable and HA Blob Object Page Blobs Acts as a Virtual Hard Disk VHD Format Compatible with Hyper-V and other technologies 1 TB Max per disk, but can stripe multiple disks ..<\/p>\n<div class=\"clear-fix\"><\/div>\n<p><a href=\"https:\/\/wiki.thomasandsofia.com\/?p=979\" title=\"read more...\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34,15],"tags":[],"class_list":["post-979","post","type-post","status-publish","format-standard","hentry","category-azure-for-aws-experts","category-storage"],"_links":{"self":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts\/979","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=979"}],"version-history":[{"count":12,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts\/979\/revisions"}],"predecessor-version":[{"id":1316,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts\/979\/revisions\/1316"}],"wp:attachment":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=979"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=979"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=979"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}