{"id":1582,"date":"2018-09-10T02:22:27","date_gmt":"2018-09-10T02:22:27","guid":{"rendered":"http:\/\/wiki.thomasandsofia.com\/?p=1582"},"modified":"2018-09-10T23:03:43","modified_gmt":"2018-09-10T23:03:43","slug":"monitoring-and-alerting-for-aws-ebs","status":"publish","type":"post","link":"https:\/\/wiki.thomasandsofia.com\/?p=1582","title":{"rendered":"Monitoring and Alerting for AWS EBS"},"content":{"rendered":"<p><a href=\"http:\/\/wiki.thomasandsofia.com\/2018\/08\/31\/aws-cloudwatch-masterclass\/\">Main Menu<\/a><\/p>\n<h1>Section Menu<\/h1>\n<ul>\n<li><a href=\"#IntroductiontoElasticBlockStore\">Introduction to Elastic Block Store<\/a><\/li>\n<li><a href=\"#AWSEBSVolumeTypes\">AWS EBS Volume Types<\/a><\/li>\n<li><a href=\"#MonitoringAWSEBSvolumes\">Monitoring AWS EBS volumes<\/a><\/li>\n<li><a href=\"#Quiz\">Quiz<\/a><\/li>\n<\/ul>\n<p><a name=\"IntroductiontoElasticBlockStore\"><\/a><\/p>\n<h1>Important Links<\/h1>\n<p>AWS EBS Metrics Descriptions: <a href=\"https:\/\/docs.aws.amazon.com\/AWSEC2\/latest\/UserGuide\/monitoring-volume-status.html?icmpid=docs_ec2_console\" target=\"_blank\" rel=\"noopener\">https:\/\/docs.aws.amazon.com\/AWSEC2\/latest\/UserGuide\/monitoring-volume-status.html?icmpid=docs_ec2_console<\/a><\/p>\n<h1>Introduction to Elastic Block Store<\/h1>\n<p><a href=\"https:\/\/www.udemy.com\/aws-monitoring-alerting-with-aws-cloudwatch-and-aws-sns\/learn\/v4\/t\/lecture\/7082812?start=0\" target=\"_blank\" rel=\"noopener\">https:\/\/www.udemy.com\/aws-monitoring-alerting-with-aws-cloudwatch-and-aws-sns\/learn\/v4\/t\/lecture\/7082812?start=0<\/a><\/p>\n<h2>Objectives<\/h2>\n<ul>\n<li>Understand AWS EBS<\/li>\n<li>EBS performance factors<\/li>\n<li>EBS storage options<\/li>\n<li>Monitoring EBS<\/li>\n<\/ul>\n<h2>What is EBS<\/h2>\n<ul>\n<li>Elastic Block Storage<\/li>\n<li>Provides block level storage for EC2 instances<\/li>\n<li>There are other options\n<ul>\n<li>Instance Store services\n<ul>\n<li>Temporary Block level storage<\/li>\n<li>Physically attached to the Host<\/li>\n<li>Deleted whenever the VM is stopped.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>EBS volumes can be attached, detached and re-attached to EC2 VMs\n<ul>\n<li>Must be in the same Availability Zone<\/li>\n<li>Add data is preserved<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h2>Types of EBS volumes<\/h2>\n<ul>\n<li>GP2 &#8211; General Purpose SSD\n<ul>\n<li>Default<\/li>\n<li>Balances price vs. performance for a wide variety of transactional workloads<\/li>\n<li>Computing IOPS\n<ul>\n<li>3 IOPS per GB up to 10,000 IOPS<\/li>\n<li>100 IOPS minimum<\/li>\n<li>As volume size increases, speed increases<\/li>\n<li>100GB volume = 300 IOPS<\/li>\n<\/ul>\n<\/li>\n<li>8 GB Minimum size\n<ul>\n<li>Smaller volumes can burst to 3000 IOPS<\/li>\n<\/ul>\n<\/li>\n<li>Maximum throughput of 160MB\/Second<\/li>\n<li>IO Credits represent the available bandwidth that GP2 volumes can use to burst large amounts of IOs when more baseline performance is needed.\n<ul>\n<li>The more credits the volume has for IO, the more time it can burst beyond the baseline performance level.\n<ul>\n<li>With bursting, the better it performs when more performance is needed.<\/li>\n<\/ul>\n<\/li>\n<li>Volumes accumulate IOPS credits at the rate of 3 IOPS per GB of the volume size.<\/li>\n<li>Each volume receives an initial balance of 5.4 million I\/O credits\n<ul>\n<li>This is enough to sustain the maximum burst performance of 3000 IOPs for 30 minutes.<\/li>\n<\/ul>\n<\/li>\n<li>When a volume requires more than the baseline, it draws on its I\/O credits to burst to the required performance level up to a maximum of 3000 IOPS.<\/li>\n<li>When volumes use fewer I\/O credits than it is in a second, unused I\/O credits are added to the credit balance.\n<ul>\n<li>If a volume sits idle, it accumulates credits.<\/li>\n<li>These are then consumed as needed<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>IO1 &#8211; Provisioned IOPS SSD\n<ul>\n<li>Best suited for high performance scenarios and Mission critical applications<\/li>\n<li>Costs more than GP2<\/li>\n<\/ul>\n<\/li>\n<li>ST1 &#8211; Throughput Optimized HDD<\/li>\n<li>SC1 &#8211; Cold HDD<\/li>\n<li>Magnetic (Previous version?)<\/li>\n<\/ul>\n<ul>\n<li>Input\/Output Operations per Second IOPS is standard measurement for EBS performance\n<ul>\n<li>SSD performance measured in blocks of 256KB I\/O Operations (Random)\n<ul>\n<li>Better performance for random operations<\/li>\n<\/ul>\n<\/li>\n<li>HDD performance measured in blocks of 1024KB I\/O Operations (Sequential)\n<ul>\n<li>Better performance for sequential operations<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><a name=\"AWSEBSVolumeTypes\"><\/a><\/p>\n<h1>AWS EBS Volume Types<\/h1>\n<p><a href=\"https:\/\/www.udemy.com\/aws-monitoring-alerting-with-aws-cloudwatch-and-aws-sns\/learn\/v4\/t\/lecture\/7082814?start=0\" target=\"_blank\" rel=\"noopener\">https:\/\/www.udemy.com\/aws-monitoring-alerting-with-aws-cloudwatch-and-aws-sns\/learn\/v4\/t\/lecture\/7082814?start=0<\/a><\/p>\n<h2>io1<\/h2>\n<ul>\n<li>Provisioned SSD<\/li>\n<li>Best suited for throughput intensive workloads<\/li>\n<li>Baseline peformance is 30 IOPS\/GB (10x GP2)\n<ul>\n<li>Maximum 20,000 IOPs<\/li>\n<li>Maximum 320 MB\/Second<\/li>\n<li>No Credit system<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h2>HDD<\/h2>\n<p>Both types designed for hard streaming workloads<\/p>\n<h3>ST1 &#8211; Throughput Optimized<\/h3>\n<ul>\n<li>Frequently accessed data volumes<\/li>\n<li>Optimized for throughput intensive workloads<\/li>\n<\/ul>\n<h3>SC1 &#8211; Cold<\/h3>\n<ul>\n<li>Less frequently accessed workloads<\/li>\n<li>Not good for high disk throughput<\/li>\n<li>Least expensive option available for AWS volumes<\/li>\n<\/ul>\n<p><a name=\"MonitoringAWSEBSvolumes\"><\/a><\/p>\n<h1>Monitoring AWS EBS volumes<\/h1>\n<p><a href=\"https:\/\/www.udemy.com\/aws-monitoring-alerting-with-aws-cloudwatch-and-aws-sns\/learn\/v4\/t\/lecture\/7082816?start=0\" target=\"_blank\" rel=\"noopener\">https:\/\/www.udemy.com\/aws-monitoring-alerting-with-aws-cloudwatch-and-aws-sns\/learn\/v4\/t\/lecture\/7082816?start=0<\/a><\/p>\n<ul>\n<li>Two types\n<ul>\n<li>Basic 5 minute intervals<\/li>\n<li>Detailed 1 minute<\/li>\n<li>io1 sends at 1 min. intervals by default\n<ul>\n<li>This is why best for mission-critical apps.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<li>Status checks\n<ul>\n<li>Help the end user track and manage potential inconsistencies in the data<\/li>\n<li>Automated test that run and return Pass\/Fail every 5 minutes<\/li>\n<li>Status\n<ul>\n<li>Okay &#8211; All checks pass<\/li>\n<li>Impaired &#8211; One or more checks fail\n<ul>\n<li>Disables I\/O between the volume and the VM <del>by default<\/del>\n<ul>\n<li>This can be over-ridden by enabling &#8220;AutoEnableIO&#8221; volume attribute\n<ul>\n<li>EC2 &gt; Volumes &gt; Select volume &gt; Actions &gt; Change Auto-Enable IO Settings<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h2>Demo<\/h2>\n<ul>\n<li>EC2 &gt; Volumes &gt; Select Volume &gt; Status Checks\n<ul>\n<li>Volume Status: Okay<\/li>\n<li>IO Status: Enabled<\/li>\n<li>IO Performance: N\/A (Only available with io1 volumes)<\/li>\n<\/ul>\n<\/li>\n<li>EC2 &gt; Volumes &gt; Select Volume &gt; Monitoring\n<ul>\n<li>R\/W Bandwidth (aka R\/W Throughput)<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><a name=\"Quiz\"><\/a><\/p>\n<h1>Quiz<\/h1>\n<p><a href=\"https:\/\/www.udemy.com\/aws-monitoring-alerting-with-aws-cloudwatch-and-aws-sns\/learn\/v4\/t\/lecture\/7082816?start=0\" target=\"_blank\" rel=\"noopener\">https:\/\/www.udemy.com\/aws-monitoring-alerting-with-aws-cloudwatch-and-aws-sns\/learn\/v4\/t\/lecture\/7082816?start=0<\/a><\/p>\n<h3>AWS EBS stands for<\/h3>\n<ul>\n<li><strong>Elastic Block Store<\/strong><\/li>\n<li>Elastic Balancer Store<\/li>\n<li>Elastic Back Up Store<\/li>\n<li>Elastic Block Stabilizer<\/li>\n<\/ul>\n<h3>AWS provides 2 types of SSD volumes. They are<\/h3>\n<ul>\n<li>io1 and gp1<\/li>\n<li>ios and gp2<\/li>\n<li><strong>io1 and gp2<\/strong><\/li>\n<li>io2 and gp2<\/li>\n<\/ul>\n<h3>&#8220;The Status Checks help the end user to better track and manage potential inconsistencies in the data on an EBS volume&#8221;<\/h3>\n<ul>\n<li><strong>True<\/strong><\/li>\n<li>False<\/li>\n<\/ul>\n<h3>CloudWatch has two tiers of metrics available for EBS volumes. They are:<\/h3>\n<ul>\n<li><strong>Basic and Detailed<\/strong><\/li>\n<li>Load and Detailed<\/li>\n<li>Run and Detailed<\/li>\n<li>Basic and Load<\/li>\n<\/ul>\n<h3>&#8220;When EBS determines that a volume&#8217;s data is potentially inconsistent, it disables the I\/O to the volume from the EC2 instance by default&#8221;<\/h3>\n<ul>\n<li><strong>True<\/strong>\n<ul>\n<li>Trying to talk to the instructor regarding this.\u00a0 Seems it is NOT enabled by default.<\/li>\n<\/ul>\n<\/li>\n<li>False<\/li>\n<\/ul>\n<p><span style=\"color: #ff0000;\"><em>After some research, it appears this setting is <strong>Enabled<\/strong> on Root volumes and <strong>Disabled<\/strong> on additional volumes.<\/em><\/span><br \/>\n<span style=\"color: #ff0000;\">\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Main Menu Section Menu Introduction to Elastic Block Store AWS EBS Volume Types Monitoring AWS EBS volumes Quiz Important Links AWS EBS Metrics Descriptions: https:\/\/docs.aws.amazon.com\/AWSEC2\/latest\/UserGuide\/monitoring-volume-status.html?icmpid=docs_ec2_console Introduction to Elastic Block Store https:\/\/www.udemy.com\/aws-monitoring-alerting-with-aws-cloudwatch-and-aws-sns\/learn\/v4\/t\/lecture\/7082812?start=0 Objectives Understand AWS EBS EBS performance factors EBS storage options Monitoring EBS What is EBS Elastic Block Storage Provides block level storage for EC2 ..<\/p>\n<div class=\"clear-fix\"><\/div>\n<p><a href=\"https:\/\/wiki.thomasandsofia.com\/?p=1582\" title=\"read more...\">Read more<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18,39],"tags":[],"class_list":["post-1582","post","type-post","status-publish","format-standard","hentry","category-amazon-web-services-aws","category-cloudwatch"],"_links":{"self":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts\/1582","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1582"}],"version-history":[{"count":5,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts\/1582\/revisions"}],"predecessor-version":[{"id":1589,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=\/wp\/v2\/posts\/1582\/revisions\/1589"}],"wp:attachment":[{"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1582"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1582"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wiki.thomasandsofia.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1582"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}