Fundamentals
- https://aws.amazon.com/blogs/big-data/optimize-spark-streaming-to-efficiently-process-amazon-kinesis-streams/
- https://aws.amazon.com/kinesis/streams/faqs/
- http://spark.apache.org/docs/latest/streaming-kinesis-integration.html
Spark Streaming - NRT:
- Very low values for batchInterval (~10ms)
- blockInterval = batchInterval
- TBD!
No comments:
Post a Comment