Comments on: BigTable Thoughts http://www.pythian.com/news/1034/bigtable-thoughts/ News and views from Pythian DBAs Sat, 20 Mar 2010 20:27:09 +0000 http://wordpress.org/?v=2.8.4 hourly 1 By: Alex Gorbachev http://www.pythian.com/news/1034/bigtable-thoughts/#comment-209531 Alex Gorbachev Sat, 31 May 2008 20:14:23 +0000 http://www.pythian.com/blogs/1034/bigtable-thoughts#comment-209531 <i>So using this thinking, every time someone I follow (say, @paulandstorm) makes a comment, it not only writes to their shard, but to mine. Now, that may not work given that the system also has to send messages at the same time, and that there can be numerous followers — dozens, hundreds, thousands.</i> And here is when async processing might come useful -- when paulandstorm makes a comment, it's written to its own shard and queued for propagation to the followers. This queue can be worked off in a more optimal way in the background. So using this thinking, every time someone I follow (say, @paulandstorm) makes a comment, it not only writes to their shard, but to mine. Now, that may not work given that the system also has to send messages at the same time, and that there can be numerous followers — dozens, hundreds, thousands.

And here is when async processing might come useful — when paulandstorm makes a comment, it’s written to its own shard and queued for propagation to the followers. This queue can be worked off in a more optimal way in the background.

]]>