Exactly-once Semantics is Possible: Here’s How Apache Kafka Does it
How does this feature work? Under the covers it works in a way similar to TCP; each batch of messages sent to Kafka will contain a sequence number which the broker will use to dedupe any duplicate send. Unlike TCP, though—which provides guarantees only within a transient in-memory connection—this sequence number is persisted to the replicated log, so even if the leader fails, any broker that takes over will also know if a resend is a duplicate. The overhead of this mechanism is quite low: it’s just a few extra numeric fields with each batch of messages. As you will see later in this article, this feature add negligible performance overhead over the non-idempotent producer.
(tags: kafka sequence-numbers dedupe deduplication unique architecture distcomp streaming idempotence)
Top 5 ways to improve your AWS EC2 performance
A couple of bits of excellent advice from Datadog (although this may be a slightly old post, from Oct 2016): 1. Unpredictable EBS disk I/O performance. Note that gp2 volumes do not appear to need as much warmup or priming as before. 2. EC2 Instance ECU Mismatch and Stolen CPU. advice: use bigger instances The other 3 ways are a little obvious by comparison, but worth bookmarking for those two anyway.
(tags: ops ec2 performance datadog aws ebs stolen-cpu virtualization metrics tips)
Can The Best Financial Tips Fit On An Index Card? : All Tech Considered : NPR
‘A couple of years ago, University of Chicago professor Harold Pollack did an online video chat with personal finance writer Helaine Olen. The topic was how regular people get steered into bad investments by financial advisers. Pollack said that the best personal finance advice “can fit on a 3-by-5 index card, and is available for free in the library — so if you’re paying someone for advice, almost by definition, you’re probably getting the wrong advice, because the correct advice is so straightforward.” After they posted the video, the emails started pouring in — people wanted to know, where could they get this index card? What was this fantastic yet simple advice for managing their money?’ These seem like pretty solid tips, and relatively portable to the Irish markets too. I need to take a look at this stuff…
(tags: finance money advice npr 401k pensions financial-advisors)
“Galway, the graveyard of ambition”
The etymology of this odd little phrase
(tags: galway ambition career life etymology phrases ireland)
swill’s tech leadership essentials – Medium
very useful tips and advice from Stephanie Williams (nee Dean), who was instrumental in setting up the ops teams in Amazon Dublin, by all accounts
(tags: management stephanie-dean stephanie-williams managing teams work hiring)