tl;d(r|w): Make the log a first class citizen and then turn everything into stream processing.
I agree that making the log a first class citizen is a good idea. But I believe he over states the benefit. In particular, this forces eventual consistency on developers, which isn’t ideal for all use-cases. On top of that, it hasn’t solved cache invalidation, it’s just made it less important by being eventually consistent. The fact that he doesn’t ever talk about the consistency model really turns me off. It’s my pet peeve of database papers, talks, articles. If you can’t tell me about your consistency model I don’t believe you Get It ™.
During the Q&A someone brings up transactions (stronger consistency model) and the speaker just sort of says “oh add transactions on top of this”. I’m very suspicious of going back to distributed transactions, especially at the scale the speaker has in mind.
All-in-all, it’s a great talk about the ideas in Samza. Seems great for data processing. I think databases should make their transaction log a first class citizen. I am skeptical that this is a viable model to replace our current database use-cases.
tl;d(r|w): Make the log a first class citizen and then turn everything into stream processing.
I agree that making the log a first class citizen is a good idea. But I believe he over states the benefit. In particular, this forces eventual consistency on developers, which isn’t ideal for all use-cases. On top of that, it hasn’t solved cache invalidation, it’s just made it less important by being eventually consistent. The fact that he doesn’t ever talk about the consistency model really turns me off. It’s my pet peeve of database papers, talks, articles. If you can’t tell me about your consistency model I don’t believe you Get It ™.
During the Q&A someone brings up transactions (stronger consistency model) and the speaker just sort of says “oh add transactions on top of this”. I’m very suspicious of going back to distributed transactions, especially at the scale the speaker has in mind.
All-in-all, it’s a great talk about the ideas in Samza. Seems great for data processing. I think databases should make their transaction log a first class citizen. I am skeptical that this is a viable model to replace our current database use-cases.