What Parents Can Do When Bullying is Downplayed at School | Psychology Today
Despite the “Bully-Free Zone” posters that line the school cafeteria walls and the Zero-Tolerance policy that was boasted about during last September’s Back-to-School night, your experience is that the school would rather not address the problem at all. The responses you get from your child’s teacher include bland lip service […]
Good advice for this nasty situation — I’m thankfully not facing it myself, but bookmarking just in case…(tags: bullying kids school education psychology children parenting)
Cyclists: Let’s Talk About Shoaling
You’re stopped at a red light with a bunch of folks on bikes, when someone who’s just arrived sails past everyone, right to the head of the class. It’s a lot like seeing somebody in the Whole Foods express lane with too many things. In other words, it’s the kind of behavior that triggers toothy-toddler rages in otherwise emotionally competent adults.
Oh god. This drives me nuts. (via Mark)(tags: shoaling cycling commuting bikes red-lights commute rage)
Commodore 64 Raspberry Pi Case with working power LED
3D-printed retro-pi cases (via Oisin)
(tags: via:oisin 3d-printing retropi cases raspberry-pi hardware cute)
Justin's Linklog Posts
-
‘AWS Lambda cheatsheet’ — a quick ref card for Lambda users
(tags: aws lambda ops serverless reference quick-references)
Turtle Bunbury – THE NIGHT OF THE BIG WIND, 1839 (Reprise)
The Night of the Big Wind was the most devastating storm ever recorded in Irish history. Known in As Gaeilge as ‘Oiche na Gaoithe Moire’, the hurricane of 6th and 7th January 1839 made more people homeless in a single night than all the sorry decades of eviction that followed it.
(tags: 1839 1830s 19th-century ireland turtle-bunbury history storms weather hurricanes)
One person’s history of Twitter, from beginning to end – Mike Monteiro
Twitter, which was conceived and built by a room of privileged white boys (some of them my friends!), never considered the possibility that they were building a bomb. To this day, Jack Dorsey doesn’t realize the size of the bomb he’s sitting on. Or if he does, he believes it’s metaphorical. It’s not. He is utterly unprepared for the burden he’s found himself responsible for. The power of Oppenheimer-wide destruction is in the hands of entitled men-children, cuddled runts, who aim not to enhance human communication, but to build themselves a digital substitute for physical contact with members of the species who were unlike them. And it should scare you.
(tags: politics twitter mike-monteiro history silicon-valley trump)
A history of the neural net/tank legend in AI, and other examples of reward hacking
@gwern: “A history of the neural net/tank legend in AI: https://t.co/2s4AOGMS3a (Feel free to suggest more sightings or examples of reward hacking!)”
(tags: gwern history ai machine-learning ml genetic-algorithms neural-networks perceptron learning training data reward-hacking)
-
I want to talk about why this vulnerability continues to exist so many years after WPA was standardized. And separately, to answer a question: how did this attack slip through, despite the fact that the 802.11i handshake was formally proven secure?
Over The Air – Vol. 2, Pt. 3: Exploiting The Wi-Fi Stack on Apple Devices
This is the most amazing hack.
Upon successful execution, the exploit exposes APIs to read and write the host’s physical memory directly over-the-air, by mapping in any requested address to the controlled DART L2 translation table, and issuing DMA accesses to the corresponding mapped IO-Space addresses.
(tags: hacks exploits security ios wifi apple iphone kernel)
How to operate reliable AWS Lambda applications in production
running a reliable Lambda application in production requires you to still follow operational best practices. In this article I am including some recommendations, based on my experience with operations in general as well as working with AWS Lambda.
Amazon Shipping Filter – Chrome Web Store
a user script to determine when Amazon.{com,co.uk,fr,de,it,etc} will not deliver to your chosen delivery address, which is a common risk for Irish users
(tags: ireland shipping amazon buying extensions chrome userscripts shopping)
Spotify’s Discover Weekly: How machine learning finds your new music
Not sure how accurate this is (it’s not written by a Spotify employee), but seems pretty well researched — according to this Discover Weekly is a mix of 3 different algorithms
(tags: discover-weekly spotify nlp music ai ml machine-learning)
Study: wearing hi-viz clothing does not reduce risk of collision for cyclists
Journal of Transport & Health, 22 March 2017:
This study found no evidence that cyclists using conspicuity aids were at reduced risk of a collision crash compared to non-users after adjustment for confounding, but there was some evidence of an increase in risk. Bias and residual confounding from differing route selection and cycling behaviours in users of conspicuity aids are possible explanations for these findings. Conspicuity aids may not be effective in reducing collision crash risk for cyclists in highly-motorised environments when used in the absence of other bicycle crash prevention measures such as increased segregation or lower motor vehicle speeds.
(tags: health safety hi-viz clothing cycling commute visibility collision crashes papers)
-
Not a very good review of Hazelcast’s CAP behaviour from Aphyr. see also https://twitter.com/MarcJBrooker/status/917437286639329280 for more musings from Marc Brooker on the topic (“PA/EC is a confusing and dangerous behaviour for many cases”)
(tags: jepsen aphyr testing hazelcast cap-theorem reliability partitions network pacelc marc-brooker)
House Six, the Heartbeat of Student Life – The University Times
Dilapidated but beloved, House Six shapes student life in Trinity and has for decades been the backdrop to changes in Irish society.
Ah, memories — in my case mostly of all-night Civ games in Publications(tags: history tcd trinity house-six csc tcdsu dublin buildings landmarks)
London’s Hidden Tunnels Revealed In Amazing Cutaways | Londonist
these really are remarkable. I love the Renzo Picassos in particular
(tags: design history london 3d cutaways diagrams comics mid-century)
Kremlin info-ops measured to have a total reach of 340 million with dark, divisive ads
when the virality and resharing is measured, it’s far higher than previously estimated, according to this Washington Post article
-
This week I took a crack at writing a branchless UTF-8 decoder: a function that decodes a single UTF-8 code point from a byte stream without any if statements, loops, short-circuit operators, or other sorts of conditional jumps. […] Why branchless? Because high performance CPUs are pipelined. That is, a single instruction is executed over a series of stages, and many instructions are executed in overlapping time intervals, each at a different stage.
Neat hack (via Tony Finch)(tags: algorithms optimization unicode utf8 branchless coding c via:fanf)
Internet speed guarantees must be realistic, says Ofcom | Hacker News
Good news from the UK. Hope this comes to Ireland soon, too
“Why We Built Our Own Distributed Column Store” (video)
“Why We Built Our Own Distributed Column Store” by Sam Stokes of Honeycomb.io — Retriever, inspired by Facebook’s Scuba
(tags: scuba retriever storage data-stores columnar-storage honeycomb.io databases via:charitymajors)
-
A deep dive on how we were using our existing databases revealed that they were frequently not used for their relational capabilities. About 70 percent of operations were of the key-value kind, where only a primary key was used and a single row would be returned. About 20 percent would return a set of rows, but still operate on only a single table. With these requirements in mind, and a willingness to question the status quo, a small group of distributed systems experts came together and designed a horizontally scalable distributed database that would scale out for both reads and writes to meet the long-term needs of our business. This was the genesis of the Amazon Dynamo database. The success of our early results with the Dynamo database encouraged us to write Amazon’s Dynamo whitepaper and share it at the 2007 ACM Symposium on Operating Systems Principles (SOSP conference), so that others in the industry could benefit. The Dynamo paper was well-received and served as a catalyst to create the category of distributed database technologies commonly known today as “NoSQL.”
That’s not an exaggeration. Nice one Werner et al!(tags: dynamo history nosql storage databases distcomp amazon papers acm data-stores)
The world’s first cyber-attack, on the Chappe telegraph system, in Bordeaux in 1834
The Blanc brothers traded government bonds at the exchange in the city of Bordeaux, where information about market movements took several days to arrive from Paris by mail coach. Accordingly, traders who could get the information more quickly could make money by anticipating these movements. Some tried using messengers and carrier pigeons, but the Blanc brothers found a way to use the telegraph line instead. They bribed the telegraph operator in the city of Tours to introduce deliberate errors into routine government messages being sent over the network. The telegraph’s encoding system included a “backspace” symbol that instructed the transcriber to ignore the previous character. The addition of a spurious character indicating the direction of the previous day’s market movement, followed by a backspace, meant the text of the message being sent was unaffected when it was written out for delivery at the end of the line. But this extra character could be seen by another accomplice: a former telegraph operator who observed the telegraph tower outside Bordeaux with a telescope, and then passed on the news to the Blancs. The scam was only uncovered in 1836, when the crooked operator in Tours fell ill and revealed all to a friend, who he hoped would take his place. The Blanc brothers were put on trial, though they could not be convicted because there was no law against misuse of data networks. But the Blancs’ pioneering misuse of the French network qualifies as the world’s first cyber-attack.
(tags: bordeaux hacking history security technology cyber-attacks telegraph telegraphes-chappe)
Slack 103: Communication and culture
Interesting note on some emergent Slack communications systems using emoji: “redirect raccoon”, voting, and “I’m taking a look at this”
This Future Looks Familiar: Watching Blade Runner in 2017
I told a lot of people that I was going to watch Blade Runner for the first time, because I know that people have opinions about Blade Runner. All of them gave me a few watery opinions to keep in mind going in—nothing that would spoil me, but things that would help me understand what they assured me would be a Very Strange Film. None of them told me the right things, though.
(tags: culture movies film blade-runner politics slavery replicants)
-
‘Sampling tools like oprofile or dtrace’s profile provider don’t really provide methods to see what [multithreaded] programs are blocking on – only where they spend CPU time. Though there exist advanced techniques (such as systemtap and dtrace call level probes), it is overkill to build upon that. Poor man doesn’t have time. Poor man needs food.’ Basically periodically grabbing stack traces from running processes using gdb.
(tags: gdb profiling linux unix mark-callaghan stack-traces performance)
Report an Issue Online | Dublin City Council
handy self-service issue report portal, more direct possibly than FixMyStreet.ie
(tags: dcc dublin city council reporting civic traffic-lights roads paths)
Intel pcj library for persistent memory-oriented data structures
This is a “pilot” project to develop a library for Java objects stored in persistent memory. Persistent collections are being emphasized because many applications for persistent memory seem to map well to the use of collections. One of this project’s goals is to make programming with persistent objects feel natural to a Java developer, for example, by using familiar Java constructs when incorporating persistence elements such as data consistency and object lifetime. The breadth of persistent types is currently limited and the code is not performance-optimized. We are making the code available because we believe it can be useful in experiments to retrofit existing Java code to use persistent memory and to explore persistent Java programming in general.
(via Mario Fusco)(tags: persistent-memory data-structures storage persistence java coding future)
Google and Facebook Have Failed Us – The Atlantic
There’s no hiding behind algorithms anymore. The problems cannot be minimized. The machines have shown they are not up to the task of dealing with rare, breaking news events, and it is unlikely that they will be in the near future. More humans must be added to the decision-making process, and the sooner the better.
(tags: algorithms facebook google las-vegas news filtering hoaxes 4chan abuse breaking-news responsibility silicon-valley)
the execution of James Connolly in cake form
As depicted in the Decobake 1916 commemorative cake competition. Amazing scenes of edible history
(tags: odd funny decobake 1916 history ireland republican nationalism james-connolly executions omgwtf cake)
Cashing in on ATM Malware – A Comprehensive Look at Various Attack Types
rather unnerving report from Trend Micro / Europol. ‘As things stand, it looks like different criminal groups have already graduated from physical to virtual skimming via malware, thanks to the lack of security measures implemented by commercial banks worldwide. This is common in Latin America and Eastern Europe, but these criminals are exporting the technique and have started to victimize other countries.’
(tags: atms banking security trend-micro banks europol exploits)
Your Morning Sucks. Here’s How to Create a Dream Morning Routine.
this is fucking hilarious
(tags: funny self-parody morning routines via:dorothy hydration trampolines wtf manic)
The copyright implications of a publicly curated online archive of Oireachtas debates
“a publicly curated online archive of Oireachtas debates is so obviously in the public interest that copyright law should not prevent it.” (via Aileen)
(tags: via:aileen copyright oireachtas debates ireland parliament archival history)
Share scripts that have dependencies with Nix
Nice approach to one-liner packaging invocations using nix-shell
In 1973, I invented a ‘girly drink’ called Baileys
The creation of the iconic booze:
‘We bought a small bottle of Jamesons Irish Whiskey and a tub of single cream and hurried back. It was a lovely May morning. 1973. Underdogs Sunderland had just won the FA Cup. We mixed the two ingredients in our kitchen, tasted the result and it was certainly intriguing, but in reality bloody awful. Undaunted, we threw in some sugar and it got better, but it still missed something. We went back to the store, searching the shelves for something else, found our salvation in Cadbury’s Powdered Drinking Chocolate and added it to our formula. Hugh and I were taken by surprise. It tasted really good. Not only this, but the cream seemed to have the effect of making the drink taste stronger, like full-strength spirit. It was extraordinary.’
(tags: whiskey cream booze drinks baileys 1970s history 1973 chocolate cocktails)
-
restore a versioned S3 bucket to the state it was at at a specific point in time
(tags: ops s3 restore backups versioning history tools scripts unix)
-
Importing an EV from the UK into Ireland (specifically the Nissan Leaf). A little dated (2013) but possibly useful all the same
The Israeli Digital Rights Movement’s campaign for privacy | Internet Policy Review
This study explores the persuasion techniques used by the Israeli Digital Rights Movement in its campaign against Israel’s biometric database. The research was based on analysing the movement’s official publications and announcements and the journalistic discourse that surrounded their campaign within the political, judicial, and public arenas in 2009-2017. The results demonstrate how the organisation navigated three persuasion frames to achieve its goals: the unnecessity of a biometric database in democracy; the database’s ineffectiveness; and governmental incompetence in securing it. I conclude by discussing how analysing civil society privacy campaigns can shed light over different regimes of privacy governance. [….] 1. Why the database should be abolished: because it’s not necessary – As the organisation highlighted repeatedly throughout the campaign with the backing of cyber experts, there is a significant difference between issuing smart documents and creating a database. Issuing smart documents effectively solves the problem of stealing and forging official documents, but does it necessarily entail the creation of a database? The activists’ answer is no: they declared that while they do support the transition to smart documents (passports and ID cards) for Israeli citizens, they object to the creation of a database due to its violation of citizens’ privacy. 2. Why the database should be abolished: because it’s ineffective; […] 3. Why the database should be abolished: because it will be breached – The final argument was that the database should be abolished because the government would not be able to guarantee protection against security breaches, and hence possible identity theft.
(tags: digital-rights privacy databases id-cards israel psc drm identity-theft security)
-
Unroll a long twitter thread with a single tweet. I like it
-
a new common C++ library from Google, Apache-licensed.
(tags: c++ coding abseil google commons libraries open-source asl2 c++17)
Anthony Levandowski has founded an AI religion
In September 2015, the multi-millionaire engineer at the heart of the patent and trade secrets lawsuit between Uber and Waymo, Google’s self-driving car company, founded a religious organization called Way of the Future. Its purpose, according to previously unreported state filings, is nothing less than to “develop and promote the realization of a Godhead based on Artificial Intelligence.”
this article is full of bananas.(tags: google crazy uber waymo self-driving-cars cars religion way-of-the-future ai god)
LambCI — a serverless build system
Run CI builds on Lambda:
LambCI is a tool I began building over a year ago to run tests on our pull requests and branches at Uniqlo Mobile. Inspired at the inaugural ServerlessConf a few weeks ago, I recently put some work into hammering it into shape for public consumption. It was borne of a dissatisfaction with the two current choices for automated testing on private projects. You can either pay for it as a service (Travis, CircleCI, etc)?—?where 3 developers needing their own build containers might set you back a few hundred dollars a month. Or you can setup a system like Jenkins, Strider, etc and configure and manage a database, a web server and a cluster of build servers . In both cases you’ll be under- or overutilized, waiting for servers to free up or paying for server power you’re not using. And this, for me, is where the advantage of a serverless architecture really comes to light: 100% utilization, coupled with instant invocations.
-
Later, in clinic, I see patients ranging from a stoical university student to a devastated father to the frail octogenarian who can’t remember the day, let alone that he has cancer – each patient an illustration of a recent Macmillan Cancer Support UK finding that it is more common for an individual to be diagnosed with cancer than to get married or have a first child. One in two people will encounter a cancer diagnosis in their lifetime, which is why the report says that, alongside marriage, parenthood, retirement and the death of a parent, cancer is now “a common life milestone”.
-
looks like a nice web-based database, FileMaker Pro-style
(tags: filemaker collaboration database tools web sharing teams)
-
occupants in open-plan offices (>6 persons) had 62% more days of sickness absence (RR 1.62, 95% CI 1.30-2.02).
(tags: health office workplace data sickness open-plan work offices)
Legendary aquarium “piscamel” thread from the GotMead forums
I thought I had detected a studied disinterest for my March 28 questions about raising fish and making mead in the same aquarium — now I realize that you mazers probably thought I was drunk. My hypothesis was that fish manures would provide valuable fertilizer to the yeast, the aquarium bubbler would keep O2 levels high, and the fish would get a nice honey drink. The result, instead, was 3 “piscamels” flavored by rotting fish.
This sounds utterly revolting. Mead made with biohazard waste. Those poor fish! (via John Looney)(tags: via:johnlooney biohazard mead fish aquarium gotmead forums brewing disgusting)
Relicensing React, Jest, Flow, and Immutable.js | Engineering Blog | Facebook Code
This decision comes after several weeks of disappointment and uncertainty for our community. Although we still believe our BSD + Patents license provides some benefits to users of our projects, we acknowledge that we failed to decisively convince this community.
(tags: facebook opensource react patents swpats bsd licensing)
‘Monitoring Cloudflare’s planet-scale edge network with Prometheus’ (preso)
from SRECon EMEA 2017; how Cloudflare are replacing Nagios with Prometheus and grafana
(tags: metrics monitoring alerting prometheus grafana nagios)
European Commission study finds no link between piracy and lower sales of digital content
According to the report, an average of 51% of adults and 72% of minors in the EU have pirated digital content, with Poland and Spain averaging the highest rates of all countries surveyed. Nevertheless, displacement rates (the impact of piracy on legitimate sales) were found to be negligible or non-existent for music, books and games, while rates for films and TV were in line with previous digital piracy studies. Most interesting is the fact that the study found that illegal game downloads actually lead to an increase in legal purchases. The report concludes that tactics like video game microtransactions are proving effective in converting illegal users to paying users. The full report goes in-depth regarding potential factors influencing piracy and the challenges of accurately tracking its impact on legitimate sales, but the researchers ultimately conclude that there is no robust statistical evidence that illegal downloads reduce legal sales. That’s big news, which makes it all the more troubling that the EU effectively buried it for two years.
(tags: piracy eu studies downloads ec games movies books content)
Understanding Uber: It’s Not About The App
the next time you see a link to a petition or someone raging about this decision being ‘anti-innovation’, remember Greyball. Remember the Metropolitan Police letter [regarding several sexual assaults which Uber didn’t report to police]. Remember that this is about holding ULL, as a company, to the same set of standards to which every other mini-cab operator in London already complies. Most of all though remember: it is not about the app.
(tags: uber ull safety crime london assault greyball taxis cabs apps)
-
“in iOS 11 and later, when you toggle the Wi-Fi or Bluetooth buttons in Control Center, your device will immediately disconnect from Wi-Fi and Bluetooth accessories. Both Wi-Fi and Bluetooth will continue to be available.” That is because Apple wants the iPhone to be able to continue using AirDrop, AirPlay, Apple Pencil, Apple Watch, Location Services, and other features, according to the documentation.
(tags: wifi bluetooth iphone ios security fail off-means-off)
Wiggle | Panaracer RibMo Folding City Tyre | City Tyres
Recommended for city commuting by a couple of ppl on ITS
Gas Pump Skimmers – learn.sparkfun.com
For those who don’t want to read through the gritty details here’s the summary: These skimmers are cheap and are becoming more common and more of a nuisance across north america. The skimmer broadcasts over bluetooth as HC-05 with a password of 1234. If you happen to be at a gas pump and happen to scan for bluetooth devices and happen to see an HC-05 listed as an available connection then you probably don’t want to use that pump. The bluetooth module used on these skimmers is extremely common and used on all sorts of legitimate products end educational kits. If you detect one in the field you can confirm that it is a skimmer (and not some other device) by sending the character ‘P’ to the module over a terminal. If you get a ’M’ in response then you have likely found a skimmer and you should contact your local authorities.
(tags: crime hardware bluetooth security electronics skimmers gas-stations usa petrol-stations hc-05)
Locking, Little’s Law, and the USL
Excellent explanatory mailing list post by Martin Thompson to the mechanical-sympathy group, discussing Little’s Law vs the USL:
Little’s law can be used to describe a system in steady state from a queuing perspective, i.e. arrival and leaving rates are balanced. In this case it is a crude way of modelling a system with a contention percentage of 100% under Amdahl’s law, in that throughput is one over latency. However this is an inaccurate way to model a system with locks. Amdahl’s law does not account for coherence costs. For example, if you wrote a microbenchmark with a single thread to measure the lock cost then it is much lower than in a multi-threaded environment where cache coherence, other OS costs such as scheduling, and lock implementations need to be considered. Universal Scalability Law (USL) accounts for both the contention and the coherence costs. http://www.perfdynamics.com/Manifesto/USLscalability.html When modelling locks it is necessary to consider how contention and coherence costs vary given how they can be implemented. Consider in Java how we have biased locking, thin locks, fat locks, inflation, and revoking biases which can cause safe points that bring all threads in the JVM to a stop with a significant coherence component.
(tags: usl scaling scalability performance locking locks java jvm amdahls-law littles-law system-dynamics modelling systems caching threads schedulers contention)
“HTML email, was that your fault?”
jwz may indeed have invented this feature way back in Netscape Mail. FWIW I think he’s right — Netscape Mail was the first usage of HTML email I recall
Undercover operation ‘Close Pass’ reduced cyclist injuries by 20% in a year
An initiative to protect cyclists from dangerous overtaking has been praised, after reducing the amount of cyclists killed or seriously injured on the roads by 20% over the last year. Operation ‘Close Pass’ was devised by West Midlands Police as a low cost way of preventing accidents caused by motorists who are driving too close for comfort.
(Via Tony Finch)Normietivity: A Review of Angela Nagle’s Kill all Normies
Due to a persistent vagueness in targets and refusal to respond to the best arguments presented by those she loosely groups together, Nagle does not provide the thoroughgoing and immanent treatment of the left which would be required to achieve the profound intervention she clearly intended. Nor does she grapple with the difficult implications figures like Greer (with her transphobic campaign against a vulnerable colleague) and Milo (with his direct advocacy for the nativist and carceral state) present for free speech absolutists. And indeed, the blurring their specifically shared transphobia causes for distinguishing between left and right wing social analysis. In genre terms, Nagle’s writing is best described as travel writing for internet culture. Kill All Normies provides a string of curios and oddities (from neo-nazi cults, to inscrutably gendered teenagers) to an audience expected to find them unfamiliar, and titillating. Nagle attempts to cast herself as an aloof and wry explorer, but at various points her commitments become all too clear. Nagle implicitly casts her reader as the eponymous normies, overlooking those of us who live through lives with transgenders, in the wake of colonialism, despite invisible disabilities (including depression), and all the rest. This is both a shame and a missed opportunity, because the deadly violence the Alt-Right has proven itself capable of is in urgent need of evaluation, but so too are the very real dysfunctions which afflict the left (both online and IRL). After this book patient, discerning, explanatory, and immanent readings of internet culture remain sorely needed. The best that can be said for Kill All Normies is, as the old meme goes, “An attempt was made.”
(tags: angela-nagle normies books reading transphobia germaine-greer milo alt-right politics internet 4chan)
-
Java 8 HotSpot feature to monitor and diagnose native memory leaks
(tags: java jvm memory native-memory malloc debugging coding nmt java-8 jcmd)
This Heroic Captain Defied His Orders and Stopped America From Starting World War III
Captain William Bassett, a USAF officer stationed at Okinawa on October 28, 1962, can now be added alongside Stanislav Petrov to the list of people who have saved the world from WWIII:
By [John] Bordne’s account, at the height of the Cuban Missile Crisis, Air Force crews on Okinawa were ordered to launch 32 missiles, each carrying a large nuclear warhead. […] The Captain told Missile Operations Center over the phone that he either needed to hear that the threat level had been raised to DEFCON 1 and that he should fire the nukes, or that he should stand down. We don’t know exactly what the Missile Operations Center told Captain Bassett, but they finally received confirmation that they should not launch their nukes. After the crisis had passed Bassett reportedly told his men: “None of us will discuss anything that happened here tonight, and I mean anything. No discussions at the barracks, in a bar, or even here at the launch site. You do not even write home about this. Am I making myself perfectly clear on this subject?”
(tags: wwiii history nukes cuban-missile-crisis 1960s usaf okinawa missiles william-bassett)
malware piggybacking on CCleaner
On September 13, 2017 while conducting customer beta testing of our new exploit detection technology, Cisco Talos identified a specific executable which was triggering our advanced malware protection systems. Upon closer inspection, the executable in question was the installer for CCleaner v5.33, which was being delivered to endpoints by the legitimate CCleaner download servers. Talos began initial analysis to determine what was causing this technology to flag CCleaner. We identified that even though the downloaded installation executable was signed using a valid digital signature issued to Piriform, CCleaner was not the only application that came with the download. During the installation of CCleaner 5.33, the 32-bit CCleaner binary that was included also contained a malicious payload that featured a Domain Generation Algorithm (DGA) as well as hardcoded Command and Control (C2) functionality. We confirmed that this malicious version of CCleaner was being hosted directly on CCleaner’s download server as recently as September 11, 2017.
Malicious typosquatting packages in PyPI
skcsirt-sa-20170909-pypi vulnerability announcement from SK-CSIRT:
SK-CSIRT identified malicious software libraries in the official Python package repository, PyPI, posing as well known libraries. A prominent example is a fake package urllib-1.21.1.tar.gz, based upon a well known package urllib3-1.21.1.tar.gz. Such packages may have been downloaded by unwitting developer or administrator by various means, including the popular “pip” utility (pip install urllib). There is evidence that the fake packages have indeed been downloaded and incorporated into software multiple times between June 2017 and September 2017.
London police’s use of AFR facial recognition falls flat on its face
A “top-of-the-line” automated facial recognition (AFR) system trialled for the second year in a row at London’s Notting Hill Carnival couldn’t even tell the difference between a young woman and a balding man, according to a rights group worker invited to view it in action. Because yes, of course they did it again: London’s Met police used controversial, inaccurate, largely unregulated automated facial recognition (AFR) technology to spot troublemakers. And once again, it did more harm than good. Last year, it proved useless. This year, it proved worse than useless: it blew up in their faces, with 35 false matches and one wrongful arrest of somebody erroneously tagged as being wanted on a warrant for a rioting offense. […] During a recent, scathing US House oversight committee hearing on the FBI’s use of the technology, it emerged that 80% of the people in the FBI database don’t have any sort of arrest record. Yet the system’s recognition algorithm inaccurately identifies them during criminal searches 15% of the time, with black women most often being misidentified.
(tags: face-recognition afr london notting-hill-carnival police liberty met-police privacy data-privacy algorithms)
Universal adversarial perturbations
in today’s paper Moosavi-Dezfooli et al., show us how to create a _single_ perturbation that causes the vast majority of input images to be misclassified.
(tags: adversarial-classification spam image-recognition ml machine-learning dnns neural-networks images classification perturbation papers)
“Use trees. Not too deep. Mostly ensembles.”
snarky summary of ‘Data-driven Advice for Applying Machine Learning to Bioinformatics Problems’, a recent analysis paper of ML algorithms
(tags: algorithms machine-learning bioinformatics funny advice classification)
“You Can’t Stay Here: The Efficacy of Reddit’s 2015 Ban Examined Through Hate Speech”
In 2015, Reddit closed several subreddits—foremost among them r/fatpeoplehate and r/CoonTown—due to violations of Reddit’s anti-harassment policy. However, the effectiveness of banning as a moderation approach remains unclear: banning might diminish hateful behavior, or it may relocate such behavior to different parts of the site. We study the ban of r/fatpeoplehate and r/CoonTown in terms of its effect on both participating users and affected subreddits. Working from over 100M Reddit posts and comments, we generate hate speech lexicons to examine variations in hate speech usage via causal inference methods. We find that the ban worked for Reddit. More accounts than expected discontinued using the site; those that stayed drastically decreased their hate speech usage—by at least 80%. Though many subreddits saw an influx of r/fatpeoplehate and r/CoonTown “migrants,” those subreddits saw no significant changes in hate speech usage. In other words, other subreddits did not inherit the problem. We conclude by reflecting on the apparent success of the ban, discussing implications for online moderation, Reddit and internet communities more broadly.
(Via Anil Dash)(tags: abuse reddit research hate-speech community moderation racism internet)
The Immortal Myths About Online Abuse – Humane Tech – Medium
After building online communities for two decades, we’ve learned how to fight abuse. It’s a solvable problem. We just have to stop repeating the same myths as excuses not to fix things.
Here are the 8 myths Anil Dash picks out: 1. False: You can’t fix abusive behavior online. 2. False: Fighting abuse hurts free speech! 3. False: Software can detect abuse using simple rules. 4. False: Most people say “abuse” when they just mean criticism. 5. False: We just need everybody to use their “real” name. 6. False: Just charge a dollar to comment and that’ll fix things. 7. False: You can call the cops! If it’s not illegal, it’s not harmful. 8. False: Abuse can be fixed without dedicated resources.(tags: abuse comments community harassment racism reddit anil-dash free-speech)
-
Simon McGarr and John Looney’s slides from their SRECon ’17 presentation
(tags: simon-mcgarr data-privacy privacy data-protection gdpr slides presentations)
The React license for founders and CTOs – James Ide – Medium
Decent explanation of _why_ Facebook came up with the BSD+Patents license: “Facebook’s patent grant is about sharing its code while preserving its ability to defend itself against patent lawsuits.”
The difficulty of open sourcing code at Facebook, including React in 2013, was one of the reasons the company’s open-source contributions used to be a fraction of what they are today. It didn’t use to have a strong reputation as an open-source contributor to front-end technologies. Facebook wanted to open source code, though; when it grew communities for projects like React, core contributors emerged to help out and interview candidates often cited React and other Facebook open source as one of the reasons they were interested in applying. People at Facebook wanted to make it easier to open source code and not worry as much about patents. Facebook’s solution was the Facebook BSD+Patents license.
(tags: facebook bsd licenses licensing asf patents swpats react license software-patents open-source rocksdb)
HN thread on the new Network Load Balancer AWS product
looks like @colmmacc works on it. Lots and lots of good details here
(tags: nlb aws load-balancing ops architecture lbs tcp ip)
Java Flame Graphs Introduction: Fire For Everyone!
lots of good detail on flame graph usage in Java, and the Honest Profiler (honest because it’s safepoint-free)
(tags: profiling java safepoints jvm flame-graphs perf measurement benchmarking testing)
Teaching Students to Code – What Works
Lynn Langit describing her work as part of Microsoft Digigirlz and TKP to teach thousands of kids worldwide to code. Describes a curriculum from “K” (4-6-year olds) learning computational thinking with a block-based programming environment like Scratch, up to University level, solving problems with public clouds like AWS’ free tier.
(tags: education learning coding teaching tkp lynn-langit scratch kids)
So much for that Voynich manuscript “solution”
boo.
The idea that the book is a medical treatise on women’s health, however, might turn out to be correct. But that wasn’t Gibbs’ discovery. Many scholars and amateur sleuths had already reached that conclusion, using the same evidence that Gibbs did. Essentially, Gibbs rolled together a bunch of already-existing scholarship and did a highly speculative translation, without even consulting the librarians at the institute where the book resides. Gibbs said in the TLS article that he did his research for an unnamed “television network.” Given that Gibbs’ main claim to fame before this article was a series of books about how to write and sell television screenplays, it seems that his goal in this research was probably to sell a television screenplay of his own. In 2015, Gibbs did an interview where he said that in five years, “I would like to think I could have a returnable series up and running.” Considering the dubious accuracy of many History Channel “documentaries,” he might just get his wish.
(tags: crypto history voynich-manuscript historians tls)
How to Optimize Garbage Collection in Go
In this post, we’ll share a few powerful optimizations that mitigate many of the performance problems common to Go’s garbage collection (we will cover “fun with deadlocks” in a follow-up). In particular, we’ll share how embedding structs, using sync.Pool, and reusing backing arrays can minimize memory allocations and reduce garbage collection overhead.
Firms involved in biometric database in India contracted by Irish government
Two tech firms – one owned by businessman Dermot Desmond – involved in the creation of a controversial biometric database in India, are providing services for the Government’s public services card and passports. Known as the Aadhaar project, the Indian scheme is the world’s largest ever biometric database involving 1.2 billion citizens. Initially voluntary, it became mandatory for obtaining state services, for paying taxes and for opening a bank account. […] Dermot Casey, a former chief technology officer of Storyful, said that if the Daon system was used to store the data and carry out the facial matching then the Government “appears to have purchased a biometric database system which can be extended to include voice, fingerprint and iris identification at a moment’s notice”. Katherine O’Keefe, a data protection consultant with Castlebridge, said if the departments were using images of people’s faces to single out or identify an individual, they were “by legal definition processing biometric data”.
(tags: biometrics databases aadhar id-cards ireland psc daon morpho)
-
racist tries to make a “Blue Lives Matter” tee shirt as gaeilge, accidentally writes “Black Lives Matter” instead. perfect
(tags: racists duh stupid translation fail daoine-gorme irish blm cops funny)
New Network Load Balancer – Effortless Scaling to Millions of Requests per Second | AWS Blog
Looks like the EC2 Networking team got their way and got to rewrite LBs in AWS
(tags: load-balancing aws elb alb nlb networking ec2 ops architecture)
The solution to the Voynich manuscript
To those who have studied medieval medicine, and possess a good knowledge of its origins, the classical physicians Galen (AD 129–210), Hippocrates (460–370 BC) and Soranus (AD 98–138) among them, the Voynich manuscript’s incorporation of an illustrated herbarium (collection of plant remedies), Zodiac charts, instructions on thermae (baths) and a diagram showing the influence of the Pleiades side by side will not be surprising. They are all in tune with contemporary medical treatises, part and parcel of the medieval world of health and healing. Bathing as a remedy is a time-honoured tradition: practised by the Greeks and the Romans, advocated by the classical physicians, and sustained during the Middle Ages. The central theme of the Voynich manuscript is just such an activity, and one of its chief characteristics is the presence of naked female figures immersed in some concoction or other. Classical and medieval medicine had separate divisions devoted to the complaints and diseases of women, mostly but not exclusively in the area of gynaecology, and covered other topics such as hygiene, food, purgatives, bloodletting, fumigations, tonics, tinctures and even cosmetics and perfumes: all involved “taking the waters”, by bathing or ingesting.
(tags: history voynich-manuscript codes medieval-medicine thermae herbaria)
-
You do not need to be a Stanford student or faculty or staff member to access the vast treasures of the Rumsey Map collection, nor do you need to visit the university or its new Center. Since 1996, the Rumsey collection’s online database has been open to all, currently offering anyone with an internet connection access to 67,000 maps from all over the globe, spanning five centuries of cartography.
(via Oisin)(tags: via:oisin maps art graphics open-access mapping history david-rumsey collections)
-
TJ McIntyre nails the problem here:
‘Mandatory but not compulsory”. This ill-judged hair-splitting seems likely to stick to Social Protection Minister Regina Doherty in the same way that “an Irish solution to an Irish problem” and “on mature recollection” did to politicians before her. The minister used that phrase to defend against the criticism that the public services card (PSC) is being rolled out as a national ID card by stealth, without any clear legal basis or public debate. She went on to say that the PSC is not compulsory as “nobody will drag you kicking and screaming to have a card”. This is correct, but irrelevant. The Government’s strategy is one of making the PSC effectively rather than legally compulsory – by cutting off benefits such as pensions and refusing driving licences and passports unless a person registers. Whether or not the PSC is required by law is immaterial if you cannot function in society without it.
(tags: psc id-cards ireland social-welfare id privacy data-protection)
The data for the Irish theory driving test is stored in the US
Prometric is the company which adminsters the test and they appear to store it on US-based servers
(tags: prometric data privacy data-protection driving-test ireland theory-test)
-
‘It is our intention to open source all of Basho’s products and all of the source code that they have been working on. We’ll do this as quickly as we are able to organise it, and we would appreciate some input from the community on how you would like this done.’
Britta Blvd – The Marauders’ Map
lovely bit of papercraft
(tags: harry-potter papercraft origami kids)
How to Easily Unsubscribe from Bulk Emails in Gmail – Unroll.me Alternative
nice Google Script which runs in the background and scrapes out unsubscribe links. I’m drowning in single-opt-in mainsleaze newsletters at this stage so this is very welcome
(tags: mainsleaze unsubscribe spam gmail google email one-bite-of-the-apple)
-
Log analyser and visualiser for the HotSpot JIT compiler. Inspect inlining decisions, hot methods, bytecode, and assembly. View results in the JavaFX user interface.
(tags: analysis java jvm performance tools debugging optimization jit)
-
‘Reviews of U2F [Universal Second Factor] devices’ — ie. Yubico keys et al.
(tags: u2f totp oath otp one-time-passwords authentication devices gadgets security 2fa)
-
good set of tourist tips for a foodie Dublin weekender
(tags: dublin tourism food eating dining restaurants tips weekend)
Linux Load Averages: Solving the Mystery
Nice bit of OS archaeology by Brendan Gregg.
In 1993, a Linux engineer found a nonintuitive case with load averages, and with a three-line patch changed them forever from “CPU load averages” to what one might call “system load averages.” His change included tasks in the uninterruptible state, so that load averages reflected demand for disk resources and not just CPUs. These system load averages count the number of threads working and waiting to work, and are summarized as a triplet of exponentially-damped moving sum averages that use 1, 5, and 15 minutes as constants in an equation. This triplet of numbers lets you see if load is increasing or decreasing, and their greatest value may be for relative comparisons with themselves.
(tags: load monitoring linux unix performance ops brendan-gregg history cpu)
-
Gabriel recently bought a distillery in Barbados, where he says the majority of his team is of African descent. “The sugar industry is a painful past for them, but my understanding, from my team, is that they do see it as the past,” Gabriel explained. “There was great suffering, but their take is like, ‘We built this island.’ They are reclaiming it, and we are seeing that in efforts to preserve farming land and not let it all go to tourism.” I rather liked this narrative, or at least the potential of it. Slavery was appalling across the board, but countries and cultures throughout the African Diaspora have managed their paths forward in ways that don’t mimic the American aftermath. A plurality of narratives was possible here, which was thrilling to me. I am often disappointed by the mainstream perception of one-note blackness. One could easily argue the root of colonization is far from removed in the Caribbean. But if I understood Gabriel, and if he accurately captured the sentiments of his Barbadian colleagues, plantation sugarcane offered career opportunities to some, and was perhaps not solely a distressing connection to a shared global history. We chewed on this thought, together, in silence.
(tags: history distilling rum barbados african-diaspora slavery american-history booze language etymology)
-
‘Easy to use tool that automatically replaces some or even all on-demand AutoScaling group members with similar or larger identically configured spot instances in order to generate significant cost savings on AWS EC2, behaving much like an AutoScaling-backed spot fleet.’
(tags: asg autoscaling ec2 aws spot-fleet spot-instances cost-saving scaling)
Going Multi-Cloud with AWS and GCP: Lessons Learned at Scale
Metamarkets splits across AWS and GCP, going into heavy detail here
Cycling to work: major new study suggests health benefits are staggering
We found that cycling to work was associated with a 41% lower risk of dying overall compared to commuting by car or public transport. Cycle commuters had a 52% lower risk of dying from heart disease and a 40% lower risk of dying from cancer. They also had 46% lower risk of developing heart disease and a 45% lower risk of developing cancer at all.
(tags: cycling transport health medicine science commuting life statistics)
NASA’s Sound Suppression Water System
If you’ve ever watched a rocket launch, you’ve probably noticed the billowing clouds around the launch pad during lift-off. What you’re seeing is not actually the rocket’s exhaust but the result of a launch pad and vehicle protection system known in NASA parlance as the Sound Suppression Water System. Exhaust gases from a rocket typically exit at a pressure higher than the ambient atmosphere, which generates shock waves and lots of turbulent mixing between the exhaust and the air. Put differently, launch ignition is incredibly loud, loud enough to cause structural damage to the launchpad and, via reflection, the vehicle and its contents. To mitigate this problem, launch operators use a massive water injection system that pours about 3.5 times as much water as rocket propellant per second. This significantly reduces the noise levels on the launchpad and vehicle and also helps protect the infrastructure from heat damage.
(tags: water rockets launch nasa space sound-suppression sound science)
The White Lies of Craft Culture – Eater
Besides field laborers, [Southern US] planter and urban communities both depended on proficient carpenters, blacksmiths, gardeners, stable hands, seamstresses, and cooks; the America of the 1700s and 1800s was literally crafted by people of color. Part of this hidden history includes the revelation that six slaves were critical to the operation of George Washington’s distillery, and that the eponymous Jack Daniel learned to make whiskey from an enslaved black man named Nathan “Nearest” Green. As Clay Risen reported for the New York Times last year, contrary to the predominant narrative that views whiskey as an ever “lily-white affair,” black men were the minds and hands behind American whiskey production. “In the same way that white cookbook authors often appropriated recipes from their black cooks, white distillery owners took credit for the whiskey,” he writes. Described as “the best whiskey maker that I know of” by his master, Dan Call, Green taught young Jack Daniel how to run a whiskey still. When Daniel later opened his own distillery, he hired two of Green’s sons. The popular image of moonshine is a product of the white cultural monopoly on all things ‘country’ Over time, that legacy was forgotten, creating a gap in knowledge about American distilling traditions — while English, German, Scottish, and Irish influences exist, that combination alone cannot explain the entirely of American distilling. As bourbon historian Michael Veach suggests, slave culture pieces together an otherwise puzzling intellectual history.
(tags: history craft-beer craft-culture food drink whiskey distilling black-history jack-daniels nathan-nearest-green)
Meet the Espresso Tonic, Iced Coffee’s Bubbly New Cousin
Bit late on this one but YUM
To make the drink, Box Kite baristas simply load a glass with ice, fill it about three quarters of the way with chilled tonic, and then top it off with an espresso shot — typically from roasters like Madcap (MI) and Ritual (SF). Often, baristas pull the espresso shot directly on top of the tonic and ice mixture, forgoing the process of first pulling it into a cup and then pouring the espresso from cup to glass.
(tags: tonic-water recipes espresso coffee drinks cocktails)
-
Foursquare’s open source repo, where they extract reusable components for open sourcing — I like the approach of using a separate top level module path for OSS bits
(tags: open-source oss foursquare libraries maintainance coding git monorepos)
GTK+ switches build from Autotools to Meson
‘The main change is that now GTK+ takes about ? of the time to build compared to the Autotools build, with likely bigger wins on older/less powerful hardware; the Visual Studio support on Windows should be at least a couple of orders of magnitude easier (shout out to Fan Chun-wei for having spent so, so many hours ensuring that we could even build on Windows with Visual Studio and MSVC); and maintaining the build system should be equally easier for everyone on any platform we currently support.’ Looking at http://mesonbuild.com/ it appears to be Python-based and AL2-licensed open source. On the downside, though, the Meson file is basically a Python script, which is something I’m really not fond of :( more details at http://taint.org/2011/02/18/001527a.html .
-
good thread on fitting out a bike with crazy LED light tape; see also EL string. Apparently it’ll run off a 4.5V (3xAAA) battery pack nowadays which makes it pretty viable!
(tags: bikes cycling safety led-lights el-tape led-tape hacks via:mathowie)
-
a beautifully-glitched photo of the moon by Giacomo Carmagnola; more on his art at http://www.bleaq.com/2015/giacomo-carmagnola . (Via Archillect)
(tags: via:archillect art giacomo-carmagnola glitch-art moon glitch images)
-
From the aptly-named Aliholic.com. Thanks, Elliot — the last thing I needed was something to feed my addiction to cheap tat from China!
(tags: china aliexpress dealextreme gearbest gadgets buying tat aliholic stuff)
TIL you shouldn’t use conditioner if you get nuked
If you shower carefully with soap and shampoo, Karam says [Andrew Karam, radiation expert], the radioactive dust should wash right out. But hair conditioner has particular compounds called cationic surfactants and polymers. If radioactive particles have drifted underneath damaged scales of hair protein, these compounds can pull those scales down to create a smooth strand of hair. “That can trap particles of contamination inside of the scale,” Karam says. These conditioner compounds are also oily and have a positive charge on one end that will make them stick to negatively charged sections of a strand of hair, says Perry Romanowski, a cosmetics chemist who has developed personal hygiene formulas and now hosts “The Beauty Brains” podcast on cosmetics chemistry. “Unlike shampoo, conditioners are meant to stay behind on your hair,” Romanowski says. If the conditioner comes into contact with radioactive material, these sticky, oily compounds can gum radioactive dust into your hair, he says.
(tags: factoids conditioner surfactants nuclear-bombs fallout hair bizarre til via:boingboing)
-
During the late 1970s, [Professor Thomas J.] Allen undertook a project to determine how the distance between engineers’ offices affects the frequency of technical communication between them. The result of that research, produced what is now known as the Allen Curve, revealed that there is a strong negative correlation between physical distance and the frequency of communication between work stations. The finding also revealed the critical distance of 50 meters for weekly technical communication. With the fast advancement of internet and sharp drop of telecommunication cost, some wonder the observation of Allen Curve in today’s corporate environment. In his recently co-authored book, Allen examined this question and the same still holds true. He says[2] “For example, rather than finding that the probability of telephone communication increases with distance, as face-to-face probability decays, our data show a decay in the use of all communication media with distance (following a “near-field” rise).” [p. 58]
Apparently a few years back in Google, some staff mined the promotion data, and were able to show a Allen-like curve that proved a strong correlation between distance from Jeff Dean’s desk, and time to getting promoted.(tags: jeff-dean google history allen-curve work communication distance offices workplace teleworking remote-work)
-
Arq backup for OSX now supports B2 (as well as S3) as a storage backend. “it’s a super-cheap option ($.005/GB per month) for storing your backups.” (that is less than half the price of $0.0125/GB for S3’s Infrequent Access class)
After Charlottesville, I Asked My Dad About Selma
Dad told me that he didn’t think I was going to have to go through what he went through, but now he can see that he was wrong. “This fight is a never-ending fight,” he said. “There’s no end to it. I think after the ‘60s, the whole black revolution, Martin Luther King, H. Rap Brown, Stokely Carmichael and all the rest of the people, after that happened, people went to sleep,” he said. “They thought, ‘this is over.’”
(tags: selma charlottesville racism nazis america race history civil-rights 1960s)
Computer says no: Irish vet fails oral English test needed to stay in Australia
An Irish veterinarian with degrees in history and politics has been unable to convince a machine she can speak English well enough to stay in Australia. Louise Kennedy is a native English speaker, has excellent grammar and a broad vocabulary. She holds two university degrees – both obtained in English – and has been working in Australia as an equine vet on a skilled worker visa for the past two years. But she is now scrambling for other visa options after a computer-based English test – scored by a machine – essentially handed her a fail in terms of convincing immigration officers she can fluently speak her own language.
This is idiotic. Computer-based voice recognition is in no way reliable enough for this kind of job. It’s automated Kafkaesque bureaucracy — “computer says no”. Shame on Oz (via James Kelleher)(tags: via:etienneshrdlu kafkaesque bureaucracy computer-says-no voice-recognition australia immigration english voice testing)
-
‘By All Means, Compare These Shitheads to the Nazis’
(tags: mike-godwin nazis shitheads funny godwins-law internet)
-
produces a randomized permutation of a list, with exactly one cycle (which guarantees that we will reach every element of the list even though we’re traversing it in random order)
(tags: algorithms lists permutation random randomization cycles)
Working with multiple AWS accounts at Ticketea
AWS STS/multiple account best practice described
A general purpose counting filter
This paper introduces a new AMQ data structure, a Counting Quotient Filter, which addresses all of these shortcomings and performs extremely well in both time and space: CQF performs in-memory inserts and queries up to an order of magnitude faster than the original quotient filter structure from which it takes its inspiration, several times faster than a Bloom filter, and similarly to a cuckoo filter. The CQF structure is comparable or more space efficient than all of them too. Moreover, CQF does all of this while supporting counting, outperforming all of the other forms in both dimensions even though they do not. In short, CQF is a big deal!
(tags: cqf counting-quotient-filters data-structures via:acolyer coding approximate bloom-filters)
consistent hashing with bounded loads
‘an algorithm that combined consistent hashing with an upper limit on any one server’s load, relative to the average load of the whole pool.’ Lovely blog post from Vimeo’s eng blog on a new variation on consistent hashing — incorporating a concept of overload-avoidance — and adding it to HAProxy and using it in production in Vimeo. All sounds pretty nifty! (via Toby DiPasquale)
(tags: via:codeslinger algorithms networking performance haproxy consistent-hashing load-balancing lbs vimeo overload load)
AWS Lambda Deployment using Terraform – Build ACL – Medium
Fairly persuasive that production usage of Lambda is much easier if you go full Terraform to manage and deploy.
A complete picture of what it takes to deploy your Lambda function to production with the same diligence you apply to any other codebase using Terraform. […] There are many cases where frameworks such as SAM or Serverless are not enough. You need more than that for a highly integrated Lambda function. In such cases, it’s easier to simply use Terraform.
(tags: infrastructure aws lambda serverless ops terraform sam)
GitHub – jorgebastida/awslogs: AWS CloudWatch logs for Humans™
This feature alone is a bit of a killer app:
$ awslogs get /var/log/syslog ip-10-1.* –start=’2h ago’ | grep ERROR
Nice.
-
a high-performance multiple regex matching library. It follows the regular expression syntax of the commonly-used libpcre library, yet functions as a standalone library with its own API written in C. Hyperscan uses hybrid automata techniques to allow simultaneous matching of large numbers (up to tens of thousands) of regular expressions, as well as matching of regular expressions across streams of data. Hyperscan is typically used in a DPI library stack. Hyperscan began in 2008, and evolved from a commercial closed-source product 2009-2015. First developed at Sensory Networks Incorporated, and later acquired and released as open source software by Intel in October 2015. Hyperscan is under a 3-clause BSD license. We welcome outside contributors.
This is really impressive — state of the art in parallel regexp matching has improved quite a lot since I was last looking at it. (via Tony Finch)(tags: via:fanf regexps regular-expressions text matching pattern-matching intel open-source bsd c dpi scanning sensory-networks)