Storage Infrastructure Behind Facebook Messages : HBase and Haystack; all data LZO-compressed; very interesting approach to testing — they ‘shadow the real production workload into the test cluster to test before going into production’. This catches a ‘high percentage’ of issues before production. nice
(tags: testing shadowing haystack hbase facebook scalability lzo messaging sms via:james-hamilton)