Wednesday, July 8, 2020

What Is Amazon Athena - The New Serverless Data Analytics Tool

What Is Amazon Athena - The New Serverless Data Analytics Tool What Is Amazon Athena? The New Serverless Data Analytics Tool Back Home Categories Online Courses Mock Interviews Webinars NEW Community Write for Us Categories Artificial Intelligence AI vs Machine Learning vs Deep LearningMachine Learning AlgorithmsArtificial Intelligence TutorialWhat is Deep LearningDeep Learning TutorialInstall TensorFlowDeep Learning with PythonBackpropagationTensorFlow TutorialConvolutional Neural Network TutorialVIEW ALL BI and Visualization What is TableauTableau TutorialTableau Interview QuestionsWhat is InformaticaInformatica Interview QuestionsPower BI TutorialPower BI Interview QuestionsOLTP vs OLAPQlikView TutorialAdvanced Excel Formulas TutorialVIEW ALL Big Data What is HadoopHadoop ArchitectureHadoop TutorialHadoop Interview QuestionsHadoop EcosystemData Science vs Big Data vs Data AnalyticsWhat is Big DataMapReduce TutorialPig TutorialSpark TutorialSpark Interview QuestionsBig Data TutorialHive TutorialVIEW ALL Blockchain Blockchain TutorialWhat is BlockchainHyperledger FabricWhat Is EthereumEthereum TutorialB lockchain ApplicationsSolidity TutorialBlockchain ProgrammingHow Blockchain WorksVIEW ALL Cloud Computing What is AWSAWS TutorialAWS CertificationAzure Interview QuestionsAzure TutorialWhat Is Cloud ComputingWhat Is SalesforceIoT TutorialSalesforce TutorialSalesforce Interview QuestionsVIEW ALL Cyber Security Cloud SecurityWhat is CryptographyNmap TutorialSQL Injection AttacksHow To Install Kali LinuxHow to become an Ethical Hacker?Footprinting in Ethical HackingNetwork Scanning for Ethical HackingARP SpoofingApplication SecurityVIEW ALL Data Science Python Pandas TutorialWhat is Machine LearningMachine Learning TutorialMachine Learning ProjectsMachine Learning Interview QuestionsWhat Is Data ScienceSAS TutorialR TutorialData Science ProjectsHow to become a data scientistData Science Interview QuestionsData Scientist SalaryVIEW ALL Data Warehousing and ETL What is Data WarehouseDimension Table in Data WarehousingData Warehousing Interview QuestionsData warehouse architectureTalend T utorialTalend ETL ToolTalend Interview QuestionsFact Table and its TypesInformatica TransformationsInformatica TutorialVIEW ALL Databases What is MySQLMySQL Data TypesSQL JoinsSQL Data TypesWhat is MongoDBMongoDB Interview QuestionsMySQL TutorialSQL Interview QuestionsSQL CommandsMySQL Interview QuestionsVIEW ALL DevOps What is DevOpsDevOps vs AgileDevOps ToolsDevOps TutorialHow To Become A DevOps EngineerDevOps Interview QuestionsWhat Is DockerDocker TutorialDocker Interview QuestionsWhat Is ChefWhat Is KubernetesKubernetes TutorialVIEW ALL Front End Web Development What is JavaScript â€" All You Need To Know About JavaScriptJavaScript TutorialJavaScript Interview QuestionsJavaScript FrameworksAngular TutorialAngular Interview QuestionsWhat is REST API?React TutorialReact vs AngularjQuery TutorialNode TutorialReact Interview QuestionsVIEW ALL Mobile Development Android TutorialAndroid Interview QuestionsAndroid ArchitectureAndroid SQLite DatabaseProgramming ... AWS Architect Certif ication Training (56 Blogs) Become a Certified Professional AWS Global Infrastructure Introduction To Cloud Computing What Is Cloud Computing?Cloud Computing Services: A Deeper Dive Into Cloud ComputingCloud Security: A Guide for Cloud Users Getting Started With Cloud Engineering How To Become A Cloud Engineer?Skills You Should Learn To Become A Cloud EngineerCloud Engineer : Roles Responsibilities And All You Need To KnowCloud Engineer Salary: All You Need To Know Getting Startred With AWS What is AWS? â€" An Introduction to AWSAWS Tutorial: Introduction to Cloud ComputingAWS vs Azure: What Is The Difference?Top 10 Reasons To Learn AWSAWS Certification â€" All you need to knowAWS Resume: How To Make Your Professional Parchment Look Attractive?AWS Salary: How Much Does An AWS Professional Make?AWS Pricing â€" An Introduction to AWS PricingAWS Console: Deep Dive Into AWS Management InterfaceWhat is AWS CLI? Know its Applications and BenefitsWhat is AWS CLI and how to use it? Everything You Need To Know About Instances In AWS AWS Compute Services AWS EC2 Tutorial : Amazon Elastic Compute CloudHow To Restore EC2 From Snapshot?AWS Lambda Tutorial: Your Guide To Amazon Serverless ComputingHow to Launch an EC2 Instance From a Custom AMI?AWS Elastic Beanstalk â€" Application Deployment Made EasyAmazon Lightsail Tutorial â€" An IntroductionAWS Fargate â€" A Compute Engine For ECSBuilding A Kubernetes App With Amazon EKSElastic Load Balancer Tutorial â€" One step solution for the uncertainAll You Need To Know About Application Load BalancerAll you need to know about Amazon's Network Load Balancer AWS Storage Services AWS S3 Tutorial: Deep Dive into Amazon Simple Storage ServiceAWS Migration: Migrating An On-Premise Application To Cloud AWS Networking Amazon VPC Tutorial- Secure Your AWS Environment AWS Database Services Amazon DynamoDB Tutorial â€" A Complete GuideRDS AWS Tutorial: Getting Started With Relational Database ServiceAWS Data Pipeline Tutori al â€" A Data Workflow Orchestration ServiceWhat Is Amazon Athena? â€" The New Era Of Data AnalysisHow To Create Hadoop Cluster With Amazon EMR? AWS Services Amazon Route 53: All You Need To Know About Latency Based RoutingAWS Snowball and Snowmobile TutorialAmazon CloudWatch â€" A Monitoring Tool By AmazonHow To Develop A Chat Bot Using Amazon Lex? AWS DevOps Services AWS DevOps: Introduction to DevOps on AWSAWS Certified DevOps Engineer : A Perfect AmalgamationAWS CodeCommit â€" A New Home For Your RepositoryAWS CodeDeploy: How To Automate Code Deployment?AWS CodeStar Tutorial: First Glance At AWS CodeStarIntroduction to AWS OpsWorks Running Docker In Production Using Amazon ECS AWS Interview Questions Top AWS Architect Interview Questions In 2020Cloud Computing Topics CoveredAWS Architect Certification Training (47 Blogs)AWS Development (10 Blogs)SFDC Administration Foundation (3 Blogs)Salesforce Admin and Dev Foundation (9 Blogs)SEE MORE What Is Amazon Athena? The New S erverless Data Analytics Tool Last updated on Apr 24,2020 5K Views Priyaj Kumar Priyaj Kumar is an AWS aspirant working as a Research Analyst at... Priyaj Kumar is an AWS aspirant working as a Research Analyst at Edureka. He is working on different AWS services and has good knowledge... Bookmark 4 / 5 Blog from AWS Database Services Become a Certified Professional Data analysis is a very complex process and there has always been attempts to ease it.There are many tools for analytics, and even the popular tech giant Amazon provides an AWS service named Amazon Athena. This Amazon Athena tutorial will guide you through the basics and advance usage of Amazon Athena.Amazon Athena is an interactive data analysis tool used to process complex queries in relatively less time. It is server-less hence, there is no hassle of setting up and doesnt require managing the infrastructure. It is not a Database service hence, you just pay for the queries you run. You just point your data in S3, define the schema required and with a standard SQL you are good to go.The topics covered in this article are as follows:Introduction to Amazon AthenaDifference between Microsoft SQL Server andAmazon AthenaUse of Amazon AthenaAccess Amazon AthenaFeatures of AthenaDemo I(Creating Table In Athena)Demo II (Comparison Between MySQL And Athena)Introduction To Amazon AthenaOn November 20, 2016, Amazon launched Athena as one of its services. As described earlier, Amazon Athena is a serverless query service that makes analysis of data, using standard SQL, stored in Amazon S3 simpler. With few clicks in the AWS Management Console, customers can point Amazon Athena at their data stored in Amazon S3 andrun queries using standard SQL to get results in seconds. With Amazon Athena, there is no infrastructure to set up or manage, and the customer pays only for the queries they run. Amazon Athena scales automatically, executing queries in parallel, which gives fast results, even with a large datas etand complex queries. Now, that you what is Amazon Athena let me take you through the difference it has compared to SQL Server.Difference Between Microsoft SQL Server And Amazon AthenaFeaturesMicrosoft SQL ServerAmazon AthenaDEFINITIONMicrosoft SQL Server is a database management and analysis system.Amazon Athena is an interactive query service that makes data analysis easy.USAGEUsed for DML, DCL, DDL and TCL operations on Database.Used for DML operations on Database.BENEFITS1. Reliable and easy to use.2. High performance.3. Easy to maintain.4. Easy server installation.5. Multiple tools integration possible.1. Easy to use.2. High performance.3. No maintenance required.4. No server configuration required.5. Multiple tools integration possible.INTEGRATION1. Sequlize2. SQLDep3. Presto1. Amazon S32. AWS Glue3. PrestoLIMITATIONS1. Limited RDS storage.2. Limitedinstances.3. Can not handle recursion.1. No DDLs supported.2. Works with external table only.3. User Defined Functions not suppo rted.MySQL vs Amazon Athena Use Of Amazon AthenaIf you are a Data Analyst and have an experience of analyzing data stored on S3, you will relate to this, Data Analysts/Developers: Do you offer Storage? AWS: Yes. Data Analysts/Developers: Do you have tools for Analytics? AWS: Not sure.Amazon worked on this and came up with Amazon Athena. Now, you have a tool to play with your data.Athena helps you analyze unstructured, semi-structured and structured data that is stored in Amazon S3. Using Athena you can create dynamic queries for your dataset. Athena also works with AWS Glue to give you a better way to store the metadata in S3. Using AWS CloudFormation and Athena, you can use named queries. Named query allows you to name your query and then call it using the name.This interactive service from AWS can be used by Data Scientists,developers to take a sneak peak into the table instead of running the complete query. It is also used to fetch data from S3, load it to different data stores u sing Athena JDBC driver,for log storage/analysis and Data Warehousing events.Now that you know Athena is an interesting tool, lets find out in this Amazon Athena tutorial how to get your hands on this amazing service from Amazon.Accessing Amazon AthenaAccessing Athena is very easy and it can be done by either:AWS ConsoleAWS CLIAthena with your JDBCThese are few of the ways to access Amazon Athena. By now, you pretty much know everything important about Amazon Athena. Lets me walk you through the different features of Athena.Features Of AthenaOut of the many services provided by Amazon, Athena is one of the services. It has many features that makes it suitable for Data Analysis. Lets take a look at the different features one by one.Easy Implementation: Athena doesnt require installation. It can be accessed directly from the AWS Console also directly by AWS CLI.Serverless: It is serverless,so the end-user doesnt need to worry about infrastructure, configuration, scaling or failure. At hena takes care of everything on its own.Pay per query: Athena charges you only for the query you run, i.e. the amount of data that is managed per query. You can save a lot if you can compress them and format your dataset accordingly.Fast: Athena is a very fast analytics tool. It can perform complex queries in less time by breaking the complex queries into simpler ones and run them parallelly, then combine the results to give the desired output.Secure: With the help of IAM policies and AWS Identity, Athena gives you complete control over the data set. As the data is stored in S3 buckets, IAM policies can help you manage control to users.Highly available: With the assurance of AWS, Athena is highly available and the user can execute queries round the clock. As AWS is 99.999% available, so is Athena.Integration: The best feature of Athena is that it can be integrated with AWS Glue. AWS Glue will help the user to create a better-unified data repository. This helps you create better ver sioning of data, better tables, views, etc.Great isnt it? Athena provides many features at the same time, it is cost-efficient.By now you must be impressed by AWS Athena. Now that you know quite a lot about Athena. Lets roll our sleeves and understand the working of Athena by performing a small demo. In this Amazon Athena tutorial, we will work on two Demos, lets find out what are they.Demo I (Creating Tables In Athena)As you know all about Amazon Athena, lets take a dive on how to query your data stored as .json file in Amazon S3 using Athena.Create multipleJSON files containing entriesStore the files to S3 bucketCreate an external table for the files stored in S3Write a Query for accessing the dataLets understand how to do the above-said tasks one by one.Create JSON Files. (Create the data without using newline character) JSON File- Amazon Athena Tutorial We will access S3 bucket using AWS CLIConfigure IAM User Create S3 Bucket Copy files to S3 Bucket Create External Table in Athena.There are two ways of doing this:Using AWS Glue CrawlerManuallyWe will create it manually:Create table. Amazon Athena Console Create a new database if you dont have one. Give a table name. Give the location of your file. Amazon Athena ConsoleSelectthe type of file you will be working with. Select the architecture of the data in your file. Amazon Athena ConsoleAs the entered data is not that complex, we dont need a partition. Click on Create Table. Amazon Athena Console Amazon Athena TutorialAthena will auto-generate the Query for creating External Table and run it. Amazon Athena Console You have your external table ready.We write a query to select all data from the table.select * from testdb;Click on Run Query and you have all the information in your table. Amazon Athena TutorialDemo II(Comparison Between Amazon Athena And MySQL)In this Amazon Athena tutorial, now we will compare MySQL and Athena and understand as to how even simple queries take less time to execute in Athena.Loading CSV file to MySQL took around 1 hour but in Athena, it took just 3 mins to upload the CSV file to S3 and 0.42 seconds to create a table for the same.Select query. select * from table.Select query in Athena.Select query in MySQL.Selecting a specific column from the table.Select a specific column in Athena Selecta specific column in MySQL.Getting the count of a specific column.Count of a specific column in Athena.Count of a specific column in MySQL.Counting number of records in the table.Count all records in Athena. Count all records in MySQL.Select query with a specified range.Select query within the said range in Athena. Select query within the said range in MySQL.That was a brief comparison on basic SQL commands between MySql and Amazon Athena.I hope th is blog was informative and helped in gaining an idea about AWS Athena. Choose a career in AWS and get certified in AWS Architect which will boost your professional career. Take a look at the different use case which are revolutionizing business. All The Best!If you wish to learn more about AWS and the amazing services like Athena, then check out our AWS Architect Coursewhichcomes with instructor-led live training and real-life project experience.This training will help you understand the different services offered by AWS in depth and help you achieve mastery over the subject.Got aquestionfor us? Please mention it in the comments section of Amazon Athena and we will get back to you.Recommended videos for you Efficient Disaster Recovery with Cloud Computing Watch Now Power The Hadoop Cluster With AWS Cloud Watch Now Architecting in Cloud-III Watch Now Microsoft Azure Tutorial Step-By-Step Tutorial In Azure Watch Now What Is Cloud Computing? A Beginners Guide To Understanding Cloud Watch Now AWS vs Google Cloud Cloud Platform Compared Watch Now Cloud Computing with AWS II Watch Now AWS Tutorial A Complete Tutorial On Amazon Web Services Watch Now AWS Vs Azure Cloud Platform Comparison Watch Now Building Scalable Application on Cloud Watch Now What Is AWS Getting Started With AWS Watch Now AWS Certifications All You Need To Know Watch Now Architecting in Cloud-II Watch NowRecommended blogs for you Everything You Need To Know About Instances In AWS Read Article ServiceNow Developer Training An Introduction To ServiceNow Scripting Read Article Microservices Tutorial Learn all about Microservices with Example Read Article Microservices vs API : How Do These Two Fare Together? Read Article Salesforce Tutorial: Learn To Create Your Own Salesforce App Read Article Amazon Route 53: All You Need To Know About Latency Based Routing Read Article Instance Metadata in the Elastic Compute Cloud Read Article AWS CodeCommit A New Home For Your Repository Read Article Top 10 Reasons Why You Should Learn Microservices Read Article What Is Microservices Introduction To Microservice Architecture Read Article What is IoT (Internet of Things)? IoT Architecture Explained Read Article Amazon Lightsail Tutorial An Introduction Read Article Azure Virtual Network For Beginners Securing Your Applications Using VPC Read Article Real World IoT Applications in Different Domains Read Article Salesforce Certifications: Jump-Start Your Career In Salesforce Read Article How To Restore EC2 From Snapshot? Read Article Transfer files from Windows to Amazon EC2 instance Read Article Amazon DynamoDB Tutorial â€" A Complete Guide Read Article Building A Kubernetes App With Amazon EKS Read Article AWS vs Azure: What Is The Difference? Read Article Comments 0 Comments Trending Courses in Cloud Computing Microsoft Certified Expert: Azure Solutions A ...6k Enrolled LearnersWeekendLive Class Reviews 5 (2250)

No comments:

Post a Comment

Note: Only a member of this blog may post a comment.