May 23, 2020

Kinesis Vs Kafka Vs SQS



KinesisKafka
Messaging systemMessaging system
Stream/ShardTopic/Partition
ProprietaryOpen Source
No operational overloadHeavy operational overload
Stores upto 7 days (default 1 day)Can store data indefinitely
Kinesis Client LibraryVarious Kafka clients
Log compaction
KinesisSQS
Messaging systemMessaging system
AWSAWS
No operational overloadNo operational overload
State tracking by clientState tracking by SQS
Message can be read many timesProcessed message is deleted
Unified log/stream processingBalancing tasks among workers



No comments:

Post a Comment