Big Data (Redshift)

Question 1

How large can RedShift scale?

Answer 1

16 Petabytes

Question 2

What is EMR and what should you use it for?

Answer 2

• Elastic Map Reduce
• Allows you to process VAST amounts of data from various platforms
• Stores the result in S3
• Run in a managed fleet of EC2 instances running
  
  • Big Data: Hadoop or Spark
  • BI: Hive and PIG
• https://tutorialsdojo.com/amazon-emr/

Question 3

• When using EMR, where does it run?

Answer 3

• EC2 Fleets.
• EC2 rules apply.

Question 4

What is AWS Kinesis

Answer 4

• Allows you to ingest process and analyze real time streaming data,

Question 5

What are the two forms of Kinesis

Answer 5

• Kinesis Data Streams
  
  • Real time
  • Unlimited destinations
  • Roll-your-own with the Kinesis SDK
• Kinesis Firehose
  
  • Near real time (60s)
  • Limited destinations
  • Plug and play

Question 6

What are the valid destinations of Kinesis Firehose?

Answer 6

• S3
• Redshift
• Elastisearch
• Splunk

Question 7

What is Kinesis Data Analytics

Answer 7

• Pair this with Firehose or Datatream
• Analyze with SQL
• Fully managed

Question 8

How do you choose Kinesis v SQS?

Answer 8

• Kinesis is real-time

Question 9

Which one scales automatically? Kinesis Data Streams or Kinesis Firehose

Answer 9

• Kinesis Firehose

Question 10

What is AWS Glue

Answer 10

• ETL Tool
• Allows you to cleanse data for a data warehouse or data lake.