Amazon Athena
Redshift
Redshift Cluster
Redshift – Snapshots & DR
Redshift Spectrum
Amazon OpenSearch Service
Amazon EMR
Amazon QuickSight
AWS Glue
AWS Lake Formation
Kinesis Data Analytics (SQL application)
Kinesis Data Analytics for Apache Flink
Run any Apache Flink application on a managed cluster on AWS
* provisioning compute resources, parallel computation, automatic scaling
* application backups (implemented as checkpoints and snapshots)
* Use any Apache Flink programming features
* Flink does not read from Firehose (use Kinesis Analytics for SQL instead)*
Amazon Managed Streaming for Apache
Kafka (Amazon MSK)
Alternative to Amazon Kinesis
* Fully managed Apache Kafka on AWS
* Allow you to create, update, delete clusters
* MSK creates & manages Kafka brokers nodes & Zookeeper nodes for you
* Deploy the MSK cluster in your VPC, multi-AZ (up to 3 for HA)
* Automatic recovery from common Apache Kafka failures
* Data is stored on EBS volumes for as long as you want
* MSK Serverless
* Run Apache Kafka on MSK without managing the capacity
* MSK automatically provisions resources and scales compute & storage
Consumers: Glue, Lambda, EC2,EKS, ecs, KinesisDataAnalytids for Apache f
Kinesis Data Streams vs. Amazon MSK
Big Data Ingestion Pipeline