{"id":3816,"date":"2022-10-24T00:04:26","date_gmt":"2022-10-24T00:04:26","guid":{"rendered":"https:\/\/wiki.thomasandsofia.com\/?p=3816"},"modified":"2022-10-24T00:50:28","modified_gmt":"2022-10-24T00:50:28","slug":"ns-storage-foundations","status":"publish","type":"post","link":"https:\/\/wiki.thomasandsofia.com\/?p=3816","title":{"rendered":"N&#038;S Storage Foundations"},"content":{"rendered":"<p><a href=\"\/nas-and-san-storage\/\">Home<\/a><\/p>\n<h1>What is Centralized Storage?<\/h1>\n<p><a href=\"https:\/\/learn.flackbox.com\/courses\/81445\/lectures\/5204534\" target=\"_blank\" rel=\"noopener\">https:\/\/learn.flackbox.com\/courses\/81445\/lectures\/5204534<\/a><\/p>\n<ul>\n<li>Storage Types\n<ul>\n<li>DAS &#8211; Direct Attached Storage\n<ul>\n<li>Computer has dedicated storage<\/li>\n<li>Can be internal or external.<\/li>\n<li>Storage does not have it&#8217;s own compute CPU, etc.<\/li>\n<\/ul>\n<\/li>\n<li>SAN &#8211; Storage Area Network<\/li>\n<li>NAS &#8211; Network Attached Storage\n<ul>\n<li>Both provide centralized storage solutions for many computers<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>S &amp; N Hardware\n<ul>\n<li>Very similar to a standard server<\/li>\n<li>Mobo<\/li>\n<li>CPU<\/li>\n<li>Memory<\/li>\n<li>NIC<\/li>\n<li>Disks<\/li>\n<li>Operating system<\/li>\n<\/ul>\n<\/li>\n<li>Smaller systems\n<ul>\n<li>Disks are generally enclosed in the same chassis<\/li>\n<li>Will be built with redundancy<\/li>\n<\/ul>\n<\/li>\n<li>Large Storage systems\n<ul>\n<li>Redundant PS, controllers, etc.<\/li>\n<\/ul>\n<\/li>\n<li>Extra Large made by clustering together<\/li>\n<\/ul>\n<h1>The Benefits of SAN and NAS<\/h1>\n<p><a href=\"https:\/\/learn.flackbox.com\/courses\/81445\/lectures\/5204530\" target=\"_blank\" rel=\"noopener\">https:\/\/learn.flackbox.com\/courses\/81445\/lectures\/5204530<\/a><\/p>\n<p>Disk Utilization with DAS<\/p>\n<ul>\n<li>Requires massive over provisioning to plan for expected growth<\/li>\n<li>Leave room for overhead.\u00a0 Adding storage often requires downtime<\/li>\n<li>Expect ~30% utilization\n<ul>\n<li>Massive wasted space over several servers<\/li>\n<li>Costs very high<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>Using Centralized Storage<\/p>\n<ul>\n<li>Storage systems use a centralized &#8216;pool&#8217; of shared storage<\/li>\n<li>Devices and applications can be allocated storage as required and easily changed on the fly, Non-disruptively<\/li>\n<li>Centralized storage expect ~80% utilization across all servers.\u00a0 Huge savings.<\/li>\n<\/ul>\n<p>Thin Provisioning<\/p>\n<ul>\n<li>Allows you to make it appear to the servers that they have more storage than you actually paid for\n<ul>\n<li>Purchased: 50 disks with 200GB = 10TB Total<\/li>\n<li>Each server thinks is has 500GB<\/li>\n<li>Over all, it looks like there is 25TB of disk, but you really only have 10TB<\/li>\n<\/ul>\n<\/li>\n<li>Use is split up, first come, first serve<\/li>\n<li>Additional space can be added as needed, transparently to the servers<\/li>\n<\/ul>\n<p>Deduplication and Compression<\/p>\n<ul>\n<li>Deduplication detects and eliminates identical blocks\n<ul>\n<li>Eliminated blocks are replaced with a pointer to a single copy of the block on the disk<\/li>\n<\/ul>\n<\/li>\n<li>Compression detects and eliminates redundant data and white space in files.<\/li>\n<li>Huge space savings are possible, dependent on the amount of duplicated blocks and compressible files.<\/li>\n<\/ul>\n<p>Benefits<\/p>\n<ul>\n<li>Pooled storage moves from &#8220;just in case&#8221; to &#8220;just in time&#8221; model for purchasing<\/li>\n<li>Dedupe and compression provide additional space savings<\/li>\n<li>This provides cost savings on hardware, rack space, power and cooling<\/li>\n<li>Savings are multiplied as storage costs tends to come down over time.<\/li>\n<\/ul>\n<p>Performance and Capacity<\/p>\n<ul>\n<li>Access can be slower than DAS since network access can add latency <strong>BUT<\/strong><\/li>\n<li>Data can be striped across many disks<\/li>\n<li>Storage vendors are also at the cutting edge of new storage technologies<\/li>\n<\/ul>\n<p>Resiliency<\/p>\n<ul>\n<li>SAN and SAS storage systems are always built to have very high degrees of resiliency\n<ul>\n<li>They almost always support mission critical systems<\/li>\n<\/ul>\n<\/li>\n<li>If a single component fails, there is a redundant component to take its place.<\/li>\n<\/ul>\n<p>Centralized Management<\/p>\n<ul>\n<li>Much easier to manage all your storage from a centralized location rather than separately across all your servers.<\/li>\n<\/ul>\n<p>Diskless Servers<\/p>\n<ul>\n<li>San protocols allow clients to boot up from a logical disk on the remote storage<\/li>\n<li>Client servers do not need to contain any disks<\/li>\n<li>Popular with blade servers<\/li>\n<\/ul>\n<p>Storage Tiering<\/p>\n<ul>\n<li>Storage systems can have medial with differing attributes, such as SSD and SATA (slower but higher capacity)<\/li>\n<li>Frequently accessed (hot) data can be kept on SSD and &#8216;cold&#8217; data can be archived onto the SATA drives<\/li>\n<\/ul>\n<p>Centralized Backups<\/p>\n<ul>\n<li>Traditional DAS: 50 servers = 50 backups<\/li>\n<li>Centralized has centralized backups\n<ul>\n<li>Reduces backup windows<\/li>\n<li>Does not required loading and unloading of physical media.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>Snapshots<\/p>\n<ul>\n<li>Point in time copy of the filesystem which can be used as a convenient short term backup<\/li>\n<li>Consists of pointers to the original blocks on disk rather than being a new copy of the data, so they initially take up no space and occur nearly instantaneously.\n<ul>\n<li>This is NOT a separate copy!\u00a0 If your storage system burns down, snapshots will also be destroyed.<\/li>\n<\/ul>\n<\/li>\n<li>If data gets corrupted or someone accidentally deletes a file, you can quickly recover from a snapshot<\/li>\n<li>Good for quick and convenient backups and restores.\n<ul>\n<li>Still need real back ups.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>Disaster Recovery<\/p>\n<ul>\n<li>You can replicate data to a DR site<\/li>\n<li>You can load balance incoming client requests for read-only data between different sites\n<ul>\n<li>You cannot do this with writable data since you need to maintain one consistent copy of the data.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p>Virtualization Support &#8211; vMotion<\/p>\n<ul>\n<li>Software such as VMware and Hyper-V allow you to run multiple virutal servers on the same underlying physical hardware server<\/li>\n<li>You can have a Linux Web server, Exchange mail server and SQL database servers all running on the same physical box, transparent to each of those virtual servers.<\/li>\n<li>Killer feature of virtualization is the ability to move virtual servers between physical servers ON THE FLY while they are still running.<\/li>\n<li>Virtual servers can keep on running with no outages even if the underlying physical server fails or is taken down for maintenance.<\/li>\n<li>External storage is a requirement for this feature.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<h1>Storage Media Type<\/h1>\n<p><a href=\"https:\/\/learn.flackbox.com\/courses\/81445\/lectures\/5204531\" target=\"_blank\" rel=\"noopener\">https:\/\/learn.flackbox.com\/courses\/81445\/lectures\/5204531<\/a><\/p>\n<p>&nbsp;<\/p>\n<p>RAID<\/p>\n<p>&nbsp;<\/p>\n<p>Comparing SAN and NAS Storage<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Home What is Centralized Storage? https:\/\/learn.flackbox.com\/courses\/81445\/lectures\/5204534 Storage Types DAS &#8211; Direct Attached Storage Computer has dedicated storage Can be internal or external. Storage does not have it&#8217;s own compute CPU, etc. SAN &#8211; Storage Area Network NAS &#8211; Network Attached Storage Both provide centralized storage solutions for many computers S &amp; N Hardware Very similar ..<\/p>\n<div class=\"clear-fix\"><\/div>\n<p><a href=\"https:\/\/wiki.thomasandsofia.com\/?p=3816\" title=\"read more...\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[80],"tags":[],"class_list":["post-3816","post","type-post","status-publish","format-standard","hentry","category-nas-and-san-storage"],"_links":{"self":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts\/3816","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3816"}],"version-history":[{"count":4,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts\/3816\/revisions"}],"predecessor-version":[{"id":3821,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts\/3816\/revisions\/3821"}],"wp:attachment":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3816"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3816"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3816"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}