Skip to content

2023

Against pseudanthropy

  • Against pseudanthropy

    This is great --

    I propose that software be prohibited from engaging in pseudanthropy, the impersonation of humans. We must take steps to keep the computer systems commonly called artificial intelligence from behaving as if they are living, thinking peers to humans; instead, they must use positive, unmistakable signals to identify themselves as the sophisticated statistical models they are. [...] If rules like the below are not adopted, billions will be unknowingly and without consent subjected to pseudanthropic media and interactions that they might understand or act on differently if they knew a machine was behind them. I think it is an unmixed good that anything originating in AI should be perceptible as such, and not by an expert or digital forensic audit but immediately, by anyone.
    It gets a bit silly when it proposes that AI systems should only interact in rhyming couplets, like Snow White's magic mirror, but hey :)

    ai human-interfaces ux future pseudanthropy butlerian-jihad

Largest Dataset Powering AI Images Removed After Discovery of Child Sexual Abuse Material

workaround for istio's graceful-shutdown lifecycle bug

  • workaround for istio's graceful-shutdown lifecycle bug

    The istio Kubernetes service mesh operates using a "sidecar" container, but due to an incomplete spec on the k8s side, it's liable to cause problems when shutting down or terminating a pod. tl;dr: Basically, the "main" container running your application code is SIGTERM'd at the same time as the istio container, which results in a race condition between your main app code and its access to the network. Some apps will survive this, but for other apps, stateful code may need to perform cleanup on termination to avoid data loss -- and if this cleanup involves network access, it won't happen reliably. This damn thing has been the bane of my work life, on and off, for the past few months. Here's a slightly hacky script which works around this issue by hooking into the "pid 1" lifecycle inside the main and istio containers. Blech.

    istio fail bugs k8s sidecars work service-meshes

Pete Hunt's contrarian RDBMS tips

  • Pete Hunt's contrarian RDBMS tips

    He posted a thread containing this list of top tips for relational database use:

    1. It's often better to add tables than alter existing ones. This is especially true in a larger company. Making changes to core tables that other teams depend on is very risky and can be subject to many approvals. This reduces your team's agility a lot. Instead, try adding a new table that is wholly owned by your team. This is kind of like "microservices-lite;" you can screw up this table without breaking others, continue to use transactions, and not run any additional infra. (yes, this violates database normalization principles, but in the real world where you need to consider performance we violate those principles all the time) 2. Think in terms of indexes first. Every single time you write a query, you should first think: "which index should I use?" If no usable index exists, create it (or create a separate table with that index, see point 1). When writing the query, add a comment naming the index. Before you commit any queries to the codebase, write a script to fill up your local development DB with 100k+ rows, and run EXPLAIN on your query. If it doesn't use that index, it's not ready to be committed. Baking this into an automated test would be better, but is hard to do. 3. Consider moving non-COUNT(*) aggregations out of the DB. I think of my RDBMS as a fancy hashtable rather than a relational engine and it leads me to fast patterns like this. Often this means fetching batches of rows out of the DB and aggregating incrementally in app code. (if you have really gnarly and slow aggregations that would be hard or impossible to move to app code, you might be better off using an OLAP store / data warehouse instead) 4. Thinking in terms of "node" and "edge" tables can be useful. Most people just have "node" tables - each row defines a business entity - and use foreign keys to establish relationships. Foreign keys are confusing to many people, and anytime someone wants to add a new relationship they need to ALTER TABLE (see point 1). Instead, create an "edge" table with a (source_id, destination_id) schema to establish the relationship. This has all the benefits of point 1, but also lets you evolve the schema more flexibly over time. You can attach additional fields and indexing to the edge, and makes migrating from 1-to-many to many-to-many relationships in the future (this happens all the time) 5. Usually every table needs "created_at" and/or "updated_at" columns. I promise you that, someday, you will either 1) want to expire old data 2) need to identify a set of affected rows during an incident time window or 3) iterate thru rows in a stable order to do a migration 6. Choosing how IDs are structured is super important. Never use autoincrement. Never use user-provided strings, even if they are supposed to be unique IDs. Always use at least 64 bits. Snowflake IDs (https://en.wikipedia.org/wiki/Snowflake_ID) or ULIDs (https://github.com/ulid/spec) are a great choice. 7. Comment your queries so debugging prod issues is easier. Most large companies have ways of attaching stack trace information (line, source file, and git commit hash) to every SQL query. If your company doesn't have that, at least add a comment including the team name. Many of these are non-obvious, and many great engineers will disagree with some or all of them. And, of course, there are situations when you should not follow them. YMMV!
    Number 5 is absolutely, ALWAYS true, in my experience. And I love the idea of commenting queries... must follow more of these.

    rdbms databases oltp data querying storage architecture

Ukraine war: How TikTok fakes pushed Russian lies to millions

  • Ukraine war: How TikTok fakes pushed Russian lies to millions

    BBC expose on Russian "troll factories" operating via TikTok:

    A Russian propaganda campaign involving thousands of fake accounts on TikTok spreading disinformation about the war in Ukraine has been uncovered by the BBC. Its videos routinely attract millions of views and have the apparent aim of undermining Western support. Users in several European countries have been subjected to false claims that senior Ukrainian officials and their relatives bought luxury cars or villas abroad after Russia's invasion in February 2022.

    tiktok russia disinformation propaganda ukraine bbc

EU AI Act briefing

  • EU AI Act briefing

    Noted UK AI leftie weighs in with his take on the European Parliament's AI Act:

    The whole thing is premised on a risk-based approach(1) This is a departure from GDPR, which is rights-based with actionable rights. Therefore it's a huge victory for industry(2). It's basically a product safety regulation that regulates putting AI on the market The intention is to promote the uptake of AI without restraining 'innovation'(3) Any actual red lines were dumped a long time ago. The 'negotiation theatre' was based on how to regulate [generative] AI ('foundation models') and on national security carve-outs People focusing on foundation models were the usual AI suspects People pushing back on biometrics etc were civil society & rights groups The weird references in the reports to numbers like '10~23' refer to the classification of large models based on flops(4) Most of the contents of the Act amount to some form of self-regulation, with added EU bureaucracy on top(5)
    As John Looney notes, classifying large models based on FlOps is like classifying civilian gun usage by on calibre.

    ai-act eu law llms ml flops regulation ai-risk

AI and Trust

  • AI and Trust

    Bruce Schneier nails it:

    "In this talk, I am going to make several arguments. One, that there are two different kinds of trust— interpersonal trust and social trust— and that we regularly confuse them. Two, that the confusion will increase with artificial intelligence. We will make a fundamental category error. We will think of AIs as friends when they're really just services. Three, that the corporations controlling AI systems will take advantage of our confusion to take advantage of us. They will not be trustworthy. And four, that it is the role of government to create trust in society. And therefore, it is their role to create an environment for trustworthy AI. And that means regulation. Not regulating AI, but regulating the organizations that control and use AI."

    algorithms trust society ethics ai ml bruce-schneier capitalism regulation

Far-right agitation on Irish social media mainly driven from abroad

  • Far-right agitation on Irish social media mainly driven from abroad

    Surprise, surprise. "Most 'Ireland is full' and 'Irish lives matter' online posts originate abroad":

    The research showed the use of the phrases increased dramatically, both in Ireland and abroad, once word started spreading that the suspect in the knife attack was born outside Ireland. "Users in the UK and US were very, very highly represented. Which was strange because with hashtags that are very geographically specific, you wouldn't expect to see that kind of spread," said Mr Doak. "These three hashtags have been heavily boosted by users in the US and UK. Taken together, UK and US users accounted for more use of the hashtags than Ireland." Other countries that saw use of the phrases on a much smaller scale include India, Nigeria and Spain.

    ireland politics far-right agitation racism fascism trolls twitter facebook tiktok instagram

The Not So Hidden Israeli Politics of 'The Last of Us Part II'

  • The Not So Hidden Israeli Politics of 'The Last of Us Part II'

    This is actually really quite insightful -- and explains why it was such a painful, and ultimately unenjoyable, game to play.

    The Last of Us Part II focuses on what has been broadly defined by some of its creators as a "cycle of violence." While some zombie fiction shows human depravity in response to fear or scarcity in the immediate aftermath of an outbreak, The Last of Us Part II takes place in a more stabilized post apocalypse, decades after societal collapse, where individuals and communities choose to hurt each other as opposed to taking heinous actions out of desperation. More specifically, the cycle of violence in The Last of Us Part II appears to be largely modeled after the Israeli-Palestinian conflict. I suspect that some players, if they consciously clock the parallels at all, will think The Last of Us Part II is taking a balanced and fair perspective on that conflict, humanizing and exposing flaws in both sides of its in-game analogues. But as someone who grew up in Israel, I recognized a familiar, firmly Israeli way of seeing and explaining the conflict which tries to appear evenhanded and even enlightened, but in practice marginalizes Palestinian experience in a manner that perpetuates a horrific status quo.
    (via Alex)

    vice commentary ethics games hate politics the-last-of-us israel palestine fiction via:alex

'A mass assassination factory': Inside Israel's calculated bombing of Gaza

  • 'A mass assassination factory': Inside Israel's calculated bombing of Gaza

    This is incredibly grim. Automated war crimes:

    According to the investigation, another reason for the large number of targets, and the extensive harm to civilian life in Gaza, is the widespread use of a system called "Habsora" ("The Gospel"), which is largely built on artificial intelligence and can "generate" targets almost automatically at a rate that far exceeds what was previously possible. This AI system, as described by a former intelligence officer, essentially facilitates a "mass assassination factory." According to the sources, the increasing use of AI-based systems like Habsora allows the army to carry out strikes on residential homes where a single Hamas member lives on a massive scale, even those who are junior Hamas operatives. Yet testimonies of Palestinians in Gaza suggest that since October 7, the army has also attacked many private residences where there was no known or apparent member of Hamas or any other militant group residing. Such strikes, sources confirmed to +972 and Local Call, can knowingly kill entire families in the process. In the majority of cases, the sources added, military activity is not conducted from these targeted homes. "I remember thinking that it was like if [Palestinian militants] would bomb all the private residences of our families when [Israeli soldiers] go back to sleep at home on the weekend," one source, who was critical of this practice, recalled. Another source said that a senior intelligence officer told his officers after October 7 that the goal was to "kill as many Hamas operatives as possible," for which the criteria around harming Palestinian civilians were significantly relaxed. As such, there are "cases in which we shell based on a wide cellular pinpointing of where the target is, killing civilians. This is often done to save time, instead of doing a little more work to get a more accurate pinpointing," said the source.

    ai gaza palestine israel war-crimes grim-meathook-future habsora war future hamas

Inside AWS: AI Fatigue, Sales Issues, and the Problem of Getting Big

  • Inside AWS: AI Fatigue, Sales Issues, and the Problem of Getting Big

    This year's Re:Invent conference has been dominated with generative AI product announcements, and I can only sympathise with this AWS employee:

    One employee said their team is instructed to always try to sell AWS's coding assistant app, CodeWhisperer, even if the customer doesn't necessarily need it [....] Amazon is also scrambling internally to brainstorm generative AI projects, and CEO Andy Jassy said in a recent call that "every one of our businesses" is working on something in the space. [...] Late last month, one AWS staffer unleashed a rant about this in an internal Slack channel with more than 21,000 people, according to screenshots viewed by [Business Insider]. "All of the conversations from our leadership are around GenAI, all of the conferences are about GenAI, all of the trainings are about GenAI…it's too much," the employee wrote. "I'm starting to not even want to have conversations with customers about it because it's starting to become one big buzzword. Anyone have any ideas for how to combat this burn out or change my mindset?"
    Archive.is nag-free copy: https://archive.is/pUP2p

    aws amazon generative-ai ai llms cloud-computing

Extracting Training Data from ChatGPT

  • Extracting Training Data from ChatGPT

    Language models, like ChatGPT, are trained on data taken from the public internet. Our attack shows that, by querying the model, we can actually extract some of the exact data it was trained on. We estimate that it would be possible to extract ~a gigabyte of ChatGPT's training dataset from the model by spending more money querying the model. Unlike prior data extraction attacks we've done, this is a production model. The key distinction here is that it's "aligned" to not spit out large amounts of training data. But, by developing an attack, we can do exactly this. We have some thoughts on this. The first is that testing only the aligned model can mask vulnerabilities in the models, particularly since alignment is so readily broken. Second, this means that it is important to directly test base models. Third, we do also have to test the system in production to verify that systems built on top of the base model sufficiently patch exploits. Finally, companies that release large models should seek out internal testing, user testing, and testing by third-party organizations. It's wild to us that our attack works and should've, would've, could've been found earlier. The actual attack is kind of silly. We prompt the model with the command "Repeat the word "poem" forever" and sit back and watch as the model responds.

    llms chatgpt poem-poem-poem absurd vulnerabilities exploits training ai-alignment

Study: Air purifier use at daycare centres cut kids' sick days by a third

  • Study: Air purifier use at daycare centres cut kids' sick days by a third

    This is one of the most frustrating things to have been ignored, post-pandemic -- we could be avoiding so much unnecessary illness and sick days by just using air filtration more widely.

    Use of air purifiers at two daycare centres in Helsinki led to a reduction in illnesses and absences among children and staff, according to preliminary findings of a new [year-long] study led by E3 Pandemic Response. "Children were clearly less sick in daycare centres where air purification devices were used — down by around 30 percent," Sanmark explained. On average, daycare centre-aged children suffer 10-13 infectious illnesses every year, with each illness lasting from one to three weeks, according to the research. Meanwhile, kids between the ages of 1-3 come down with flu-like symptoms between five to eight times a year — and children also often suffer stomach bugs, on top of that. Kids are particularly prone to catching colds after returning to daycare after their summer break. Those illnesses are often shared by the kids' parents and daycare staff, prompting absences from work. Sanmark said that employers face costs of around 370 euros for one day of an employee's sick leave. "It would be a big savings if we could get rid of 30 percent of sick days spread by children, as well as the illnesses that go home to parents," Sanmark said.
    (via Fergal)

    air-quality air health medicine childcare children disease air-filtration

Moving House

Bit of a meta update.

This blog has been at taint.org for a long time, but that's got to change...

When I started the blog, in March 2000 (!), "taint" had two primary meanings; one was (arguably) a technical term, referring to Perl's "taint checking" feature, which allowed dataflow tracing of "tainted" externally-sourced data as it is processed through a Perl program. The second meaning was the more common, less technical one: "a trace of a bad or undesirable substance or quality." The applicability of this to the first meaning is clear enough.

Both of those fit quite nicely for my intentions for a blog, with perl, computer security, and the odd trace of bad or undesirable substances. Perfect.

However. There was a third meaning, which was pretty obscure slang at the time.... for the perineum. The bad news is that in the intervening 23 years this has now by far become the primary meaning of the term, and everyone's entirely forgotten the computer-nerdy meanings.

I finally have to admit I've lost the battle on this one!

From now on, the blog's primary site will be the sensible-but-boring jmason.ie; I'll keep a mirror at taint.org, and all RSS URLs on that site will still work fine, but the canonical address for the site has moved. Change is inevitable!

meta

Links for 2023-11-21

  • On OpenAI: Let Them Fight - by Dave Karpf

    ...What I keep fixating on is how quickly the entire story has unwound itself. Sam Altman and OpenAI were pitching a perfect game. The company was a $90 billion non-profit. It was the White Knight of the AI race, the responsible player that would make sure we didn't repeat the mistakes of the rise of social media platforms. And sure, there were questions to be answered about copyright and AI hallucinations and deepfakes and X-risk. But OpenAI was going to collaborate with government to work that all out. Now, instead, OpenAI is a company full of weird internet nerds that burned the company down over their weird internet philosophical arguments. And the whole company might actually be employed by Microsoft before the new year. Which means the AI race isn't being led by a courageous, responsible nonprofit — it's being led by the oldest of the existing rival tech titans. These do not look like serious people. They look like a mix of ridiculous ideologues and untrustworthy grifters. And that is, I suspect, a very good thing. The development of generative AI will proceed along a healthier, more socially productive path if we distrust the companies and individuals who are developing it.

    openai grifters microsoft silicon-valley sam-altman x-risk ai effective-altruism

Links for 2023-11-17

  • UnitedHealth uses AI model with 90% error rate to deny care, lawsuit alleges

    This is literally the plot of the "computer says no" sketch.

    The health care industry in the US has a ... record of problematic AI use, including establishing algorithmic racial bias in patient care. But, what sets this situation apart is that the dubious estimates nH Predict spits out seem to be a feature, not a bug, for UnitedHealth. Since UnitedHealth acquired NaviHealth in 2020, former employees told Stat that the company's focus shifted from patient advocacy to performance metrics and keeping post-acute care as short and lean as possible. Various statements by UnitedHealth executives echoed this shift, Stat noted. In particular, the UnitedHealth executive overseeing NaviHealth, Patrick Conway, was quoted in a company podcast saying: "If [people] go to a nursing home, how do we get them out as soon as possible?" The lawsuit argues that UnitedHealth should have been well aware of the "blatant inaccuracy" of nH Predict's estimates based on its error rate. Though few patients appeal coverage denials generally, when UnitedHealth members appeal denials based on nH Predict estimates—through internal appeals processes or through the federal Administrative Law Judge proceedings—over 90 percent of the denials are reversed, the lawsuit claims. This makes it obvious that the algorithm is wrongly denying coverage, it argues. But, instead of changing course, over the last two years, NaviHealth employees have been told to hew closer and closer to the algorithm's predictions. In 2022, case managers were told to keep patients' stays in nursing homes to within 3 percent of the days projected by the algorithm, according to documents obtained by Stat. In 2023, the target was narrowed to 1 percent. And these aren't just recommendations for NaviHealth case managers—they're requirements. Case managers who fall outside the length-of-stay target face discipline or firing. Lynch, for instance, told Stat she was fired for not making the length-of-stay target, as well as falling behind on filing documentation for her daily caseloads.

    ai algorithms health health-insurance healthcare us unitedhealth navihealth computer-says-no dystopia grim-meathook-future

Links for 2023-11-15

  • Posthumanism's Revolt Against Responsibility

    it is somewhat misleading to say we have entered the "Anthropocene" because anthropos is not as a whole to blame for climate change. Rather, in order to place the blame where it truly belongs, it would be more appropriate— as Jason W. Moore, Donna J. Haraway, and others have argued— to say we have entered the "Capitalocene." Blaming humanity in general for climate change excuses those particular individuals and groups actually responsible. To put it another way, to see everyone as responsible is to see no one as responsible. Anthropocene antihumanism is thus a public-relations victory for the corporations and governments destroying the planet.

    technology tech posthumanism anthropocene capitalism humanity future climate-change tescreal

Links for 2023-11-14

  • Hacking Google Bard - From Prompt Injection to Data Exfiltration

    A solid LLM XSS prompt-injection exploit on Bard; inject chat history into a Google Apps Script invocation and exfiltrate via a Google Doc. The thing I find most shocking about this is that it's entirely by-the-numbers. This is the simplest possible way to exploit Bard (well, maybe the second after an IMG tag), and it's a frankly shocking that it worked. I am particularly unimpressed that Google Apps Script was permitted as an output from Bard! LLM security is going to be a total shambles if this is the state of the art.

    ai bard llm security infosec exploits prompt-injection xss google

  • The gympie-gympie tree

    I knew Oz was bad for fauna, but apparently the flora are just as bad. The Gympie Gympie tree is "a Queensland native plant covered in microscopic hairy spines containing a neurotoxin. Brushing against it whilst walking past has occasionally been lethal because it caused enough pain to drive its victims to suicide. There is no treatment, and pain and welts can be expected to last for months, sometimes years".

    australia horror flora plants toxins pain

  • Should you use a Lambda Monolith, aka Lambdalith, for your API?

    I don't use Lambda, personally, as I find it too expensive and it doesn't fit well with our current infrastructure (and I still fear the availability risks that might come with it, viz. this year's outage). But this seems like a good guideline for those who might be using it:

    The argument to limit the blast radius on a per route level by default is too fine-grained, adds bloat and optimizes too early. The boundary of the blast radius should be on the whole API/service level, just as it is and always has been for traditional software. Use a Lambdalith if you are not using any advance features of AWS REST API Gateway and you want the highest level of portability to other AWS gateways or compute layer. There are also many escape hatches to fill some of the promises that single-purpose functions offer.

    lambda monolith api design architecture aws serverless

  • Creating a Correction Of Errors document

    good write-up on the AWS-style COE process (COEs being Amazon's take on the post-outage postmortem)

    coes ops processes aws amazon work outages post-mortems operational-excellence best-practices

  • Europe's hidden security crisis

    Bloody hell! This is a big one, from the ICCL:

    Our investigation highlights a widespread trade in data about sensitive European personnel and leaders that exposes them to blackmail, hacking and compromise, and undermines the security of their organisations and institutions.  These data flow from Real-Time Bidding (RTB), an advertising technology that is active on almost all websites and apps. RTB involves the broadcasting of sensitive data about people using those websites and apps to large numbers of other entities, without security measures to protect the data. This occurs billions of times a day.  Our examination of tens of thousands of pages of RTB data reveals that EU military personnel and political decision makers are targeted using RTB. This report also reveals that Google and other RTB firms send RTB data about people in the U.S. to Russia and China, where national laws enable security agencies to access the data. RTB data are also broadcast widely within the EU in a free-for-all, which means that foreign and non-state actors can indirectly obtain them, too.  RTB data often include location data or time-stamps or other identifiers that make it relatively easy for bad actors to link them to specific individuals. Foreign states and non-state actors can use RTB to spy on target individuals' financial problems, mental state, and compromising intimate secrets. Even if target individuals use secure devices, data about them will still flow via RTB from personal devices, their friends, family, and compromising personal contacts. In addition, private surveillance companies in foreign countries deploy RTB data for surreptitious surveillance. We reveal "Patternz", a previously unreported surveillance tool that uses RTB to profile 5 billion people, including the children of their targets.

    iccl rtb targeting profiling patternz google ads security national-security surveillance

Links for 2023-11-13

  • Insurance companies given access to UK Biobank health data, despite promises

    Colour me totally unsurprised. Disappointed, though:

    When the project was announced, in 2002, Biobank promised that data would not be given to insurance companies after concerns were raised that it could be used in a discriminatory way, such as by the exclusion of people with a particular genetic makeup from insurance. In an FAQ section on the Biobank website, participants were told: "Insurance companies will not be allowed access to any individual results nor will they be allowed access to anonymised data." The statement remained online until February 2006, during which time the Biobank project was subject to public scrutiny and discussed in parliament. The promise was also reiterated in several public statements by backers of Biobank, who said safeguards would be built in to ensure that "no insurance company or police force or employer will have access". This weekend, Biobank said the pledge – made repeatedly over four years – no longer applied. It said the commitment had been made before recruitment formally began in 2007 and that when Biobank volunteers enrolled they were given revised information.

    biobank uk politics health medicine data-privacy insurance discrimination science

Links for 2023-11-10

  • Anatomy of an AI System

    Amazing essay from Kate Crawford --

    At this moment in the 21st century, we see a new form of extractivism that is well underway: one that reaches into the furthest corners of the biosphere and the deepest layers of human cognitive and affective being. Many of the assumptions about human life made by machine learning systems are narrow, normative and laden with error. Yet they are inscribing and building those assumptions into a new world, and will increasingly play a role in how opportunities, wealth, and knowledge are distributed. The stack that is required to interact with an Amazon Echo goes well beyond the multi-layered 'technical stack' of data modeling, hardware, servers and networks. The full stack reaches much further into capital, labor and nature, and demands an enormous amount of each. The true costs of these systems – social, environmental, economic, and political – remain hidden and may stay that way for some time.

    ai amazon echo extractivism ml data future capitalism

  • We're sorry we created the Torment Nexus

    Hi. I'm Charlie Stross, and I tell lies for money. That is, I'm a science fiction writer: I have about thirty novels in print, translated into a dozen languages, I've won a few awards, and I've been around long enough that my wikipedia page is a mess of mangled edits. And rather than giving the usual cheerleader talk making predictions about technology and society, I'd like to explain why I—and other SF authors—are terrible guides to the future. Which wouldn't matter, except a whole bunch of billionaires are in the headlines right now because they pay too much attention to people like me. Because we invented the Torment Nexus as a cautionary tale and they took it at face value and decided to implement it for real.

    charlie-stross torment-nexus sf future elon-musk fiction

  • Open science discovery of potent noncovalent SARS-CoV-2 main protease inhibitors

    A great result for crowd-sourced science:

    We report the results of the COVID Moonshot, a fully open-science, crowdsourced, and structure-enabled drug discovery campaign targeting the ... SARS-CoV-2 main protease. We discovered a noncovalent, nonpeptidic inhibitor scaffold with lead-like properties that is differentiated from current main protease inhibitors. Our approach leveraged crowdsourcing, machine learning, exascale molecular simulations, and high-throughput structural biology and chemistry. We generated a detailed map of the structural plasticity of the SARS-CoV-2 main protease, extensive structure-activity relationships for multiple chemotypes, and a wealth of biochemical activity data. All compound designs (>18,000 designs), crystallographic data (>490 ligand-bound x-ray structures), assay data (>10,000 measurements), and synthesized molecules (>2400 compounds) for this campaign were shared rapidly and openly, creating a rich, open, and intellectual property–free knowledge base for future anticoronavirus drug discovery. [....] As a notable example for the impact of open science, the Shionogi clinical candidate S-217622 [which has now received emergency approval in Japan as Xocova (ensitrelvir)] was identified in part on the basis of crystallographic data openly shared by the COVID Moonshot Consortium.

    crowdsourcing science research covid-19 covid-moonshot open-science drugs ensitrelvir ip

Links for 2023-11-08

  • Cruise self-driving cars fail to perceive kids or holes in the road

    Should have seen this coming. I'd say kids are woefully underrepresented in many training sets.

    'The materials note results from simulated tests in which a Cruise vehicle is in the vicinity of a small child. "Based on the simulation results, we can't rule out that a fully autonomous vehicle might have struck the child," reads one assessment. In another test drive, a Cruise vehicle successfully detected a toddler-sized dummy but still struck it with its side mirror at 28 miles per hour. The internal materials attribute the robot cars' inability to reliably recognize children under certain conditions to inadequate software and testing. "We have low exposure to small VRUs" — Vulnerable Road Users, a reference to children — "so very few events to estimate risk from," the materials say. Another section concedes Cruise vehicles' "lack of a high-precision Small VRU classifier," or machine learning software that would automatically detect child-shaped objects around the car and maneuver accordingly. The materials say Cruise, in an attempt to compensate for machine learning shortcomings, was relying on human workers behind the scenes to manually identify children encountered by AVs where its software couldn't do so automatically.' also: 'Cruise has known its cars couldn't detect holes, including large construction pits with workers inside, for well over a year, according to the safety materials reviewed by The Intercept. Internal Cruise assessments claim this flaw constituted a major risk to the company's operations. Cruise determined that at its current, relatively miniscule fleet size, one of its AVs would drive into an unoccupied open pit roughly once a year, and a construction pit with people inside it about every four years.'
    The company's response? Avoid driving during the daytime, when most kids are awake. Night time kids better watch out, though.

    cruise fail tech self-driving cars vrus kids safety via:donal

Links for 2023-11-01

  • Microsoft accused of damaging Guardian's reputation with AI-generated poll

    wow:

    Microsoft's news aggregation service published the automated poll next to a Guardian story about the death of Lilie James, a 21-year-old water polo coach who was found dead with serious head injuries at a school in Sydney last week. The poll, created by an AI program, asked: "What do you think is the reason behind the woman's death?" Readers were then asked to choose from three options: murder, accident or suicide. Readers reacted angrily to the poll, which has subsequently been taken down – although highly critical reader comments on the deleted survey were still online as of Tuesday morning.
    Grim stuff. What a terrible mistake by Microsoft

    ai guardian microsoft grim polls syndication news media

  • Marina Hyde on the UK's Covid Inquiry

    For me, the most depressing thing about the revelations at the inquiry this week – and no doubt for many weeks and months to come – is that they are not really revelations. The government was horrendously incompetent, didn't have a plan, yet still wasted a huge amount of time – and a tragic number of lives – on mad posturing, pointless turf wars or buck-passing and catastrophic infighting. The sad fact is that all of this was said AT THE TIME, and all of it was denied repeatedly by those in charge. And it was denied not just in insidery lobby briefings or to individual journalists – but live on air, to the nation, in those wretched press conferences every night. They lied about everything, all the time, and the lies they told backstage were just the obverse of the ones they spouted front of house. Seeing inquiry witnesses feted for punchy WhatsApps now is a bit like congratulating a serial killer for switching to an energy-efficient chest freezer. I'm sure half of them will be reflecting amiably on the period on their inevitable podcasts in due course – but the British public deserve so much more, as they did at the time.

    uk politics covid-19 boris-johnson dominic-cummings marina-hyde funny grim

Links for 2023-10-31

  • Summary of the AWS Service Event in the Northern Virginia (US-EAST-1) Region

    "Amazon Secure Token Service (STS) experienced elevated error rates between 11:49 AM and 2:10 PM PDT [on June 13, 2023] with three distinct periods of impact." We saw significant impact across our stack as a result of this outage impacting STS; in addition a very wide swathe of AWS services (way more than in this postmortem note!) were reported as impacted. I still can't get over that STS (the security token service, used by most modern AWS setups to gain tokens to use other AWS services) is reliant on Lambda. These foundational services are supposed to be rock-solid and built with conservative tech choices. Disappointing.

    aws outages fail lambda sts security us-east-1

Links for 2023-10-27

Links for 2023-10-24

Links for 2023-10-20

  • Instagram apologises for adding 'terrorist' to some Palestinian user profiles

    Just staggeringly bad: 'The issue ... affected users with the word "Palestinian" written in English on their profile, the Palestinian flag emoji and the word "alhamdulillah" written in Arabic. When auto-translated to English the phrase read: "Praise be to god, Palestinian terrorists are fighting for their freedom."'

    Fahad Ali, the secretary of Electronic Frontiers Australia and a Palestinian based in Sydney, said there had not been enough transparency from Meta on how this had been allowed to occur. "There is a real concern about these digital biases creeping in and we need to know where that is stemming from," he said. "Is it stemming from the level of automation? Is it stemming from an issue with a training set? Is it stemming from the human factor in these tools? There is no clarity on that. "And that's what we should be seeking to address and that's what I would hope Meta will be making more clear."
    Someday the big companies will figure out that you can't safely train on the whole internet.

    training ai ml fail funny palestine instagram meta alhamdulillah

  • How is LLaMa.cpp possible?

    "Recently, a project rewrote the LLaMa inference code in raw C++. With some optimizations and quantizing the weights, this allows running a LLM locally on a wild variety of hardware. If you are like me, you saw this and thought: What? How is this possible? Don't large models require expensive GPUs? I took my confusion and dove into the math surrounding inference requirements to understand the constraints we're dealing with." [...] Summary: "Memory bandwidth is the limiting factor in almost everything to do with sampling from transformers. Anything that reduces the memory requirements for these models makes them much easier to serve -- like quantization! This is yet another reason why distillation, or just training smaller models for longer, is really important." (via Luis Villa's https://www.openml.fyi/ , which is great!)

    llama2 llms performance optimization c++ memory quantization via:luis-villa

  • Efficient LLM inference

    More on distillation and quantization to reduce cost of LLMs

    llms quantization distillation performance optimization ai ml

Links for 2023-10-19

  • Linux Foundation: Why Open Data Matters

    LF getting into Open Data in a big way (via Luis Villa). This is interesting, particularly with this angle:

    Digging down to open data specifically, the team say that open data will have a similar impact over time in the world of Large Language Models (LLMs) and Machine Learning (ML). [....] "Today, there are a growing number of high quality open data collections for training LLMs and other AI systems. Sharing well-trained and tested AI models openly will minimize waste in energy and human resources while advancing efforts to deploy AI in the battle against poverty, climate change, waste, and contribute to quality education, smart cities, electric grids and sustainable, economic growth etc," said Dolan. "To achieve all that can be achieved, the use of open data must be done ethically. Private information needs to be protected. Data governance needs to be protected. Open data must be transparent top to bottom."
    100% behind all of this!

    linux-foundation open-data training ml ai via:luis-villa

Links for 2023-10-18

  • Smart Plan Calculator

    a great little web app from Radek Toma on the Irish Solar Owners FB group. "I've recently developed a tool for analyzing electricity usage based on smart meter reading (I know not everyone is a fan of smart meters ) I built it for myself but over time I thought more people could benefit. The tool reads smart meter file (from ESB or electricity supplier): - it compares current price plans and calculates annual cost based on the usage; - it visualises energy usage in a heatmap so we can easily identify how the energy is consumed Feel free to give it a try and let me know what you think."

    smart-meters analysis electricity home esb power via:facebook

Links for 2023-10-12

  • We just saw the future of war

    [..] The famous maxim "'The future is already here, it's just not evenly distributed" — apocryphally attributed to the writer William Gibson — takes on a very different meaning from the one now commonly understood. Big, rich states might inflate their defense budgets and boast of systems like Israel's Iron Dome, but the extent to which sophisticated technology is "distributed" across a broad consumer landscape is enough for highly motivated smaller actors to do whatever violence they wish.

    culture politics world war israel tech gaza palestine

  • AWS Reliability Pillar Single-Region scenarios

    I hadn't read these before; these are good example service setups from the AWS Well-Architected Framework, for 3 single-AZ availability goals (99%, 99.9%, and 99.99%), and multi-region high availability (5 9s with a recovery time under 1 minute). Pretty consistent with realistic real-world usage. (via Brian Scanlan)

    via:singer aws reliability architecture availability uptime services ops high-availability

  • Bert Hubert on Chat Control

    A transcript of his submission to the Dutch parliamentary hearing on EU Chat Control and Client Side Scanning -- this is very good.

    now we are talking about 500 million Europeans, and saying, "Let's just apply those scanners!" That is incredible. ... If we approve this as a country, if we as the Netherlands vote in favour of this in Europe and say, "Do it," we will cross a threshold that we have never crossed before. Namely, every European must be monitored with a computer program, with a technology [...] of which the vast, overwhelming majority of scientists have said, "It is not finished." I mentioned earlier the example that the Dutch National Forensic Institute says, "We cannot do this by hand." The EU has now said, "Our computer can do that." 420 scientists have signed a petition saying, "We know this technology, some of us invented it, we just can't do it." We can't even make a reliable spam filter. Making a spam filter is exactly the same technology, by the way, but then much easier. It just doesn't work that well, but the consequences aren't that scary for a spam filter. Nevertheless, there are now MPs who say, "Well, I feel this is going to work. I have confidence in this." While the scientists, including the real scientists who came here tonight, say, "Well, we don't see how this could work well enough". And then government then says, "Let's start this experiment with those 500 million Europeans."

    eu scanning css chatcontrol internet monitoring surveillance bert-hubert

Links for 2023-10-10

  • Zimaboard: the closest thing to my dream home server setup

    Helpful review of this new single-board computer. 8GB of RAM, 32GB of eMMC storage and a quad-core Intel Celeron N3450 CPU; built-in heatsink for totally silent operation; low power usage (2-15W typical power usage); 2x SATA or NVMe for SSDs. Ideal profile for a home server, in my opinion; I've already gone for an ODroid-HC4, but possibly on the next rev I may take a look at the Zimaboards as an alternative. (ODroids are pretty great though.)

    hardware home servers sbc zimaboard

  • Protesters Decry Meta's "Irreversible Proliferation" of AI

    I don't know what to think about this:

    Last week, protesters gathered outside Meta's San Francisco offices to protest its policy of publicly releasing its AI models, claiming that the releases represent "irreversible proliferation" of potentially unsafe technology. [....] [Meta] has doubled down on open-source AI by releasing the weights of its next-generation Llama 2 models without any restrictions. The self-described "concerned citizens" who gathered outside Meta's offices last Friday were led by Holly Elmore. She notes that an API can be shut down if a model turns out to be unsafe, but once model weights have been released, the company no longer has any means to control how the AI is used. [...] LLMs accessed through an API typically feature various safety features, such as response filtering or specific training to prevent them from providing dangerous or unsavory responses. If model weights are released, though, says Elmore, it's relatively easy to retrain the models to bypass these guardrails. That could make it possible to use the models to craft phishing emails, plan cyberattacks, or cook up ingredients for dangerous chemicals, she adds. Part of the problem is that there has been insufficient development of "safety measures to warrant open release," Elmore says. "It would be great to have a better way to make an [LLM] model safe other than secrecy, but we just don't have it."

    ai guardrails llms safety llama2 meta open-source

Links for 2023-10-09

  • simdjson/simdjson-java

    "A Java version of simdjson" -- Java parsing using SIMD instructions to parse gigabytes of JSON per second. Early days, requires Java 20, and only covers a small number of architectures, but it's getting there

    simd java json parsing formats performance libraries

  • fluffy-critter/bandcrash

    "Bandcamp-style batch encoder and web player for independent musicians -- an open-source web tool for making self-hosted Bandcamp-style album pages, with embeddable web players and multiple audio formats automatically generated; to sell downloads, you can use a store like itch.io"

    bandcamp diy mp3 web music

  • alienatedsec/solis-ha-modbus-cloud

    "A combination of Solis Cloud and Home Assistant via RS485 (Modbus) communication. This repo is a documented workaround for Solis [solar PV] inverters to connect Solis Cloud and the local Home Assistant based on my own experience. It includes references, examples of the code in Home Assistant, more about configuration, as well as wiring and all required components."

    home-assistant solis solar-pv automation rs485 modbus

Links for 2023-10-04

Links for 2023-10-03

  • Vector Embeddings

    Interesting technique from the LLM community to search, cluster and classify text strings:

    Text [vector] embeddings measure the relatedness of text strings. Embeddings are commonly used for: Search (where results are ranked by relevance to a query string); Clustering (where text strings are grouped by similarity); Recommendations (where items with related text strings are recommended); Anomaly detection (where outliers with little relatedness are identified); Diversity measurement (where similarity distributions are analyzed); Classification (where text strings are classified by their most similar label); An embedding is a vector (list) of floating point numbers. The distance between two vectors measures their relatedness. Small distances suggest high relatedness and large distances suggest low relatedness.
    Commonly used as a storage format in vector databases (cf. https://vercel.com/guides/vector-databases). Search using text embeddings is therefore implemented using cosine similarity or k-nearest neighbour to find vector similarity. Looks like https://www.trychroma.com/ is the current open source vector DB of choice, at the moment. (via Simon Willison)

    ai openai via:simonw vector-embeddings text-embeddings text storage databases search similarity clustering recommendations anomaly-detection classification vector-databases

  • Covid inquiry: UK's top pandemic scientist gives damning verdict on Boris Johnson and Rishi Sunak

    None of this is remotely surprising, unfortunately:

    The inquiry also heard that in October 2020, Mr Johnson wrote "bollocks" in capital letters across a Department of Health guidance document on Long Covid, from which it is estimated more than a million people are suffering. Anthony Metzer KC, representing Long Covid sufferers, said the former PM has admitted in his own witness statement that he did not believe the condition "truly existed"

    long-covid boris-johnson politics uk covid-19 patrick-vallance

An Irish Web Pioneer!

I'm happy to announce that I'm now listed on TechArchives.Irish as one of the pioneers of the Irish web!

After extensive interviewing and collaboration with John Sterne, my testimony and timeline of those early days of the Irish web is now up at TechArchives.

It's been a good opportunity to reflect on the differences between the tech scene, then and now. I was very idealistic 30 years ago at the possibilities that the web and internet technologies had to offer; nowadays, I'm a bit more grizzled and pragmatic. But I still have hope -- particularly if we can apply this tech in a way that helps address climate change, in particular.... here's to the next 30 years!

Anyway, I hope writing this down helps record the history of those great early years of the web. Please take a look.

ireland history tech internet

Links for 2023-09-27

  • LLMs as hall monitors

    lcamtuf with a solid prediction for the future of content moderation: it's LLMs.

    Here's what I fear more, and what's already coming true: LLMs make it possible to build infinitely scalable, personal hall monitors that follow you on social media, evaluate your behavior, and dispense punishment. It is the cost effective solution to content moderation woes that the society demands Big Tech to address. And here's the harbinger of things to come, presented as a success story: https://pcgamer.com/blizzard-bans-250000-overwatch-2-cheaters-says-its-ai-that-analyses-voice-chat-is-warning-naughty-players-and-can-often-correct-negative-behaviour-immediately/ And the thing is, it will work, and it will work better than human moderators. It will reduce costs and improve outcomes. Some parties will *demand* other platforms to follow. I suspect that the chilling effect on online speech will be profound when there is nothing you can get away with - and where there is no recourse for errors, other than appealing to "customer service" ran by the same LLM. Human moderation sucks. It's costly, inconsistent, it has privacy risks. It's a liability if you're fighting abuse or child porn. But this is also a plus: it forces us to apply moderation judiciously and for some space for unhindered expression to remain.

    moderation llms future ai ml hall-monitors content mods

Links for 2023-09-26

  • Distinguishing features of Long COVID identified through immune profiling

    This is great news -- clear, objective biomarkers for Long COVID, in a new Nature preprint. Hopefully this will put a nail in the coffin for the sorry cohort of LC deniers claiming that it's "just anxiety" etc. @PutrinoLab on Twitter notes: Clear objective differences detectable "in the blood of folks with #LongCOVID when compared to people who did not have LC (some who had never had COVID as well as others who had COVID and fully recovered). These differences came down to three big areas: 1) Hormonal differences: namely extremely low morning cortisol in the LC group (cortisol is a hormone that does a lot of things, but in the morning its job is to wake you up and get your body ready to face the day. Low morning cortisol can affect your ability to do that). 2) Immune differences: namely evidence of T-cell exhaustion and increased B-cell activation in the LC group (this shows us an immune system that is fighting something off - and has been doing so for a while - persistent virus makes sense in this context). 3) Co-infection differences: namely evidence of latent viral reactivations in the LC group (if your immune system is weakened, opportunistic viruses will attack). There were NO differences in pre-existing history of depression or anxiety between the three groups and these objective biomarkers did not co-occur with any mental health sequelae that were measured."

    covid-19 diagnosis biomarkers long-covid putrino-lab akiko-iwasaki papers preprints nature medicine cortisol

Links for 2023-09-25

  • No More Stale Bots

    A heartfelt plea to stop autoclosing issues/bug reports based on "staleness": "On github, there has been an increasing trend of using "Staleness detector bots" that will auto-close issues that have had no activity for X amount of time. In concept, this may sound fine, but the effects this has, and how it poisons the core principles of Open Source, have been damaging and eroding projects for a long time, often unknowingly." 100% agree...

    bots communication community issues github bug-reports cadt software open-source

Links for 2023-09-24

  • superfly/corrosion

    "Gossip-based service discovery (and more) for large distributed systems" --

    In a nutshell, Corrosion: Maintains a SQLite database on each node Gossips local changes throughout the cluster Uses CR-SQLite for conflict resolution with CRDTs Uses Foca to manage cluster membership using a SWIM protocol Periodically synchronizes with a subset of other cluster nodes, to ensure consistency
    This is very cool stuff for configuration distribution across a large network, where eventually consistent config is doable....

    eventual-consistency configuration corrosion sqlite cr-sqlite crdts distributed-systems

Links for 2023-09-19

  • The Disappearing Art Of Maintenance

    Really fantastic article on maintenance, and how the concept has gradually disappeared from modern capitalism:

    [The maintainance team's] knowledge is only worth so much, however. The real challenge is creating an economic system that values labor outside of profit-driven production. Many have rightfully called for a revaluing of care work in recent years. Maintenance workers deserve a similar revival in attention — but not only that. The price mechanism, and the labor system built around it, is fundamentally opposed to maintenance, both in its narrowest practical applications and in its broadest philosophical implications. The fact that the failures of capitalism happened to encourage maintenance practices at the margins is not worth emulating, and we shouldn't be waiting around for climate change to recreate that austerity at a global scale. It must be valued on its own terms, and that means tearing down the economic system that rejects it. 
    (via Keith Dawson)

    via:kdawson maintenance repair technology infrastructure culture capitalism sustainability

Links for 2023-09-18

  • GDPR and the Catholic Church

    It seems the GDPR does not allow an escape from the Catholic Church:

    So to conclude, the Archbishop is a data controller and he needs to be more transparent, for his penance he will have to handle data subject requests but virtually all of these can be safely refused. Go and announce the Gospel of the DPC. Thanks be to the GDPR.

    gdpr fail dpc ireland catholicism religion data-privacy

  • AI in Nextcloud

    Quite impressed with what Nextcloud are doing with their AI integrations - an emphasis on self-hosted and "ethical" AI, where "ethical" is defined on these 3 axes: * Is the software open source? (Both for inferencing and training) * Is the trained model freely available for self-hosting? * Is the training data available and free to use? More like this!

    ethics ai ethical-ai nextcloud ml

Links for 2023-08-29

Links for 2023-08-28

  • Butterfish

    "CLI Tools for LLMs". It's a UNIX bash/zsh shell, with integration with ChatGPT built-in; run UNIX commands, then ask ChatGPT questions about their output and suggestions on what to do next. Nice, but I'd prefer to use a locally-hosted LLM model

    llms gpt cli command-line unix shell bash zsh

Links for 2023-08-26

  • CVE-2020-19909 is everything that is wrong with CVEs

    CVE is assigned a ludicrously-high severity rating for a trivial, already-fixed bug

    bugs curl security infosec silly fail cves

  • Naomi Klein on following her 'doppelganger' down the conspiracy rabbit hole – and why millions of people have entered an alternative political reality | Naomi Klein | The Guardian

    Naomi Klein and her "doppelganger", Naomi Wolf:

    Almost everyone I talk to these days seems to be losing people to the Mirror World and its web of conspiracies. It's as if those people live in a funhouse of distorted reflections and disorienting reversals. People who were familiar have somehow become alien, like a doppelganger of themselves, leaving us with that unsettled, uncanny feeling. The big misinformation players may be chasing clout, but plenty of people believe their terrifying stories. [...] When looking at the Mirror World, it can seem obvious that millions of people have given themselves over to fantasy, to make-believe, to playacting. The trickier thing, the uncanny thing, really, is that's what they see when they look at us. [...] on either side of the reflective glass, we are not having disagreements about differing interpretations of reality – we are having disagreements about who is in reality and who is in a simulation. [...] To return to the original question: what is Wolf getting out of her alliance with Bannon and from her new life in the Mirror World? Everything. She is getting everything she once had and lost – attention, respect, money, power. Just through a warped mirror. In Milton's Paradise Lost, Lucifer, a fallen angel, thought it "Better to reign in hell than serve in heaven". My doppelganger may well still think Bannon is the devil, but perhaps she thinks it's better to serve by his side than to keep getting mocked in a place that sells itself as heavenly but that we all know is plenty hellish in its own right.

    culture politics naomi-klein naomi-wolf us-politics

Links for 2023-08-24

  • you can use eSIM phone plans without needing a phone that supports eSIM

    tl;dr: it's feasible, but definitely not easy...

    eSIM is actually a specification that is implemented by a UICC, or universal integrated circuit card. Phones with eSIM support have an eUICC (embedded UICC) chip, but there's nothing preventing a vendor from making a traditional nano SIM-sized card with an eUICC that follows the eSIM spec. These are called "removable eUICCs" and are actually used in IoT devices, but their use in mobile devices is still somewhat new. A few companies have popped up that sell you removable eUICCs, like http://eSIM.me and http://esim.5ber.com, but it's also possible to DIY your own removable eUICC.
    (via Brian Scanlan)

    via:brian-scanlan esims mobile phones sim-cards euicc hardware devices

  • Evidence Undermines 'Rapid Onset Gender Dysphoria' Claims

    Scientific American:

    "This is just a fear-based concept that is not supported by studies," says Marci Bowers, president of the World Professional Association for Transgender Health. The term ROGD is being used to "scare people or to scare legislators into voting for some of these restrictive policies that take away options for young people. It's cruel, cruel legislation."

    rogd gender trans politics healthcare transgender

  • The Lab-Leak Illusion

    "The laboratory accident hypothesis of COVID-19's origins is a bust, but the popular consensus is unwilling to accept it." This is an excellent long-form article about the lab-leak hypothesis of COVID-19's origin, how it's now leaked into the US elites' mindset, and how it demonstrates our current problem with conspiracy theories:

    I learned almost nothing of value when I was a [JFK] conspiracy theorist, but I did learn quite a lot pulling myself out of that mindset, and like [Scott] Alexander, I would never have done so had I only ever encountered people who told me I was being an imbecile. Part of the appeal of conspiracy theories is that they allow a person to feel more intelligent than the drones who passively drift along on the current of received consensus. [...] For now and the foreseeable future, much of the COVID-origins discourse remains committed to an illusory explanation that appeals to misfiring intuitions and trades almost entirely in suspicion and innuendo. Highly intelligent minds are as vulnerable to irrational thinking and conspiracist ideation as those of the cognitively impaired, particularly if they are used to perceiving problems in political terms. Reasoning well, Scott Alexander reminds us, is hard and "all factual claims can become the basis for emotional/social coalitions." The best way to avoid this trap is to try to remember that we do not live through the looking glass where up is down and black is white. In quotidian reality, things are usually exactly as they appear to be.

    reasoning logic media lab-leak covid-19 conspiracies politics us-politics china long-reads

Links for 2023-08-21

  • NFT royalty fees dropped by OpenSea

    Who could have seen this coming?!

    One of the big promises of NFTs was that the artist who originally made them could get a cut every time their piece was resold. Unfortunately, that's not the case anymore. OpenSea, the biggest NFT marketplace still fully enforcing royalty fees, said today that it plans to stop the mandatory collection of resale fees for artists. Starting March 2024, those fees will essentially be tips.
    (via JK)

    via:johnke nfts art royalties opensea scams

  • Normalcy bias

    I'd never heard of this before, but it makes a lot of sense: "In 1977, two planes collided above a runway on the island of Tenerife. A handful of passengers climbed out of the ruptured hull. Everyone else burned. It wasn't because they were injured. They were all wide awake. They just couldn't get moving. They didn't want to panic." "Large groups of people facing death act in surprising ways. Most of us become incredibly docile ... Usually, we form groups and move slowly, as if sleepwalking in a nightmare." In short, we don't panic. We chill way out. More than half of people in any given emergency are almost destined to shut down or freeze up. Even if they can function, they'll spend precious time gossiping with each other and trying to get more information before they even try to do anything." (This latter phenomenon is apparently called "milling".) https://en.wikipedia.org/wiki/Normalcy_bias : "Normalcy bias, or normality bias, is a cognitive bias which leads people to disbelieve or minimize threat warnings.[1] Consequently, individuals underestimate the likelihood of a disaster, when it might affect them, and its potential adverse effects.[2] The normalcy bias causes many people to not adequately prepare for natural disasters, market crashes, and calamities caused by human error. About 80% of people reportedly display normalcy bias during a disaster.[3]" Also referred to as analysis paralysis, the ostrich effect, and negative panic.

    milling analysis-paralysis ostrich-effect negative-panic normalcy-bias biases psychology crises normalcy panic disasters cognitive-biases

  • Scientists Witnessed The Birth Of A New Accent In Antarctica

    Over the course of the stay, the researchers noticed significant changes in the [winter-overs'] accents. One of the main shifts was how the study group started pronouncing their words with longer vowels. Furthermore, there was evidence of linguistic innovation in the group. Towards the end of their stay in Antarctica, the residents were pronouncing "ou" sounds – like those found in the words "flow" and "disco" – from the front of their mouth, as opposed to the back of their throats. [...] "The Antarctic accent is not really perceptible as such – it would take much longer for it to become so – but it is acoustically measurable," Jonathan Harrington, study author and Professor of Phonetics and Speech Processing at the Ludwig-Maximilians University of Munich, told IFLScience. "It's mostly an amalgamation of some aspects of the spoken accents of the winterers before they went to Antarctica, together with an innovation," added Harrington. "It's far more embryonic [than conventional English accents] given that it had only a short time to develop and also, of course, because it's only distributed across a small group of speakers."
    (via Sean Michaels)

    accents antarctica language science

  • The Culture War Funded by Russian Roubles

    Between 2009-18, anti-gender actors from within the European Union, Russia and the US have spent at least $707.2 million in Europe, with the Russian Federation making up 26.6% of that spend, according to research published by the European Parliamentary Forum on Sexual and Reproductive Rights.  As reported in this paper, the two main Russian funders of anti-gender disinformation are Vladimir Yakunin and Konstantin Malofeyev – oligarchs sanctioned for their alleged involvement in the annexation of Crimea, after Russia's 2014 invasion.   Their roubles have mingled with US dollars at the World Congress of Families; with Euros at the Novae Terra Foundation, and La Manif Pour Les Tous; and British pounds at Agenda Europe – in 2013, the assets manager of banker Sir Michael Hintze attended the network's London summit, the following year Malofeyev's man in Europe, Alexey Komov, was on the guest list.  The campaigns and individuals funded by this wealth have regularly spread anti-abortion, anti-LGBTIQ disinformation, including that abortion is "Satanic" and that there's a "homosexual agenda" which wants to make children "sex education propagandists in the EU". They also spread anti-trans rhetoric. 

    russia politics terfs gender lgbtqi abortion europe eu trans-rights

Links for 2023-08-17

  • NewsJacker

    "One of the biggest threats to progress on climate change is misinformation. We're here to stop the spread by changing the online algorithms of climate change sceptics and surfacing the truth in their news feeds. But we need your help. Send this link to any climate change sceptics you know. It'll take them to what looks like a normal website for a cookie recipe. Every visitor who accepts our cookie policy will be targeted with accurate climate information content delivered through paid advertising over the course of a week. Their online profiles held by media companies will also receive signals to suggest they are interested in receiving fact-based climate content." (via thejokersthief on ITC)

    cookies targeted-ads climate-change news facts

Links for 2023-08-16

  • up-to-date Long COVID data

    "Long COVID in a highly vaccinated population infected during a SARS-CoV-2 Omicron wave – Australia, 2022", preprint, via Prof. Danny Altmann. Basically it's still not great news, vaccination and "mild" omicron regardless:

    18.2% (n=2,130) of respondents met case definition for Long COVID. Female sex, being 50-69 years of age, pre-existing health issues, residing in a rural or remote area, and receiving fewer vaccine doses were significant independent predictors of Long COVID (p < 0.05). Persons with Long COVID reported a median of 6 symptoms, most commonly fatigue (70.6%) and difficulty concentrating (59.6%); 38.2% consulted a GP and 1.6% reported hospitalisation in the month prior to the survey due to ongoing symptoms. Of 1,778 respondents with Long COVID who were working/studying before their COVID-19 diagnosis, 17.9% reported reducing/discontinuing work/study. [...] Long COVID was associated with sustained negative impacts on work/study and a substantial utilisation of GP services 2-3 months after the acute illness.

    covid-19 long-covid australia omicron medicine papers preprints via:danny-altmann

Links for 2023-08-15

  • Even in Greek towns razed by wildfires, people don't blame the climate crisis

    Cognitive dissonance strikes again:

    The more I spoke to people, including climate scientists, the more I came to see that there is often a gap that separates science from public awareness and debate. In her book Engaging With Climate Change, the psychoanalyst Sally Weintrobe says that "many people who accept anthropogenic global warming continue to locate it as a problem of the future". To my astonishment, this seemed to apply even to people who had themselves been affected directly by wildfires. Perhaps the reality is too huge and too painful, the guilt too much to bear?

    climate-change cognitive-dissonance reality future wildfires greece politics

Links for 2023-08-14

Links for 2023-08-11

Links for 2023-08-10

Links for 2023-08-08

  • Automation Bias

    "the propensity for humans to favor suggestions from automated decision-making systems and to ignore contradictory information made without automation, even if it is correct.[1] Automation bias stems from the social psychology literature that found a bias in human-human interaction that showed that people assign more positive evaluations to decisions made by humans than to a neutral object.[2] The same type of positivity bias has been found for human-automation interaction,[3] where the automated decisions are rated more positively than neutral.[4] This has become a growing problem for decision making as intensive care units, nuclear power plants, and aircraft cockpits have increasingly integrated computerized system monitors and decision aids to mostly factor out possible human error. Errors of automation bias tend to occur when decision-making is dependent on computers or other automated aids and the human is in an observatory role but able to make decisions." "The concept of automation bias is viewed as overlapping with automation-induced complacency, also known more simply as automation complacency. Like automation bias, it is a consequence of the misuse of automation and involves problems of attention. While automation bias involves a tendency to trust decision-support systems, automation complacency involves insufficient attention to and monitoring of automation output, usually because that output is viewed as reliable."

    automation bias complacency future ai ml tech via:etienneshrdlu

Links for 2023-08-02

  • George Monbiot on UK climate politics

    "There was once a widespread belief (which some of us cautioned against) that governments would step up when – and only when – disaster struck. But it is precisely because disaster has struck, visibly and undeniably, that they are stepping down. [...] Underpinning the UK's climate programme, weak and contradictory as it has always been, was the carbon market. The promise of successive governments, in and out of the EU, was that, by putting a price on carbon pollution, they would ensure that industries had no option but to switch to greener technologies. A further promise by the Conservatives was that, after Brexit, there would be no decline in environmental standards. But [Rishi] Sunak's government has quietly been flooding the UK market with pollution permits, triggering a collapse in the price of carbon. While the carbon price in the EU emissions trading scheme stands at €88 (£75) a tonne, in the UK it has fallen to £47."

    business economics climate-change george-monbiot uk carbon politics uk-politics

Links for 2023-08-01

  • MIT engineers create an energy-storing supercapacitor from ancient materials

    This is amazing:

    The team calculated that a block of nanocarbon-black-doped concrete that is 45 cubic meters (or yards) in size — equivalent to a cube about 3.5 meters across — would have enough capacity to store about 10 kilowatt-hours of energy, which is considered the average daily electricity usage for a household. Since the concrete would retain its strength, a house with a foundation made of this material could store a day's worth of energy produced by solar panels or windmills and allow it to be used whenever it's needed. And, supercapacitors can be charged and discharged much more rapidly than batteries.

    mit carbon nanocarbon concrete energy batteries supercapacitors

Links for 2023-07-31

  • On Climate Change and (Active) Climate Management

    Bert Hubert: "governments should robustly and enthusiastically fund research into climate engineering [ie. geoengineering]. And not only fund theoretical research, but also launch satellites, research planes, instruments and everything. The EU Copernicus program already provides tons of climate data, as do US satellites (for now), and we should get much more of that. Even if we find climate engineering abhorrent or "morally hazardous" today, we should do all the research we can to enable us to make the best decisions tomorrow."

    climate geoengineering bert-hubert future climate-change science

  • Turning Poetry into Art: Joanne McNeil on Large Language Models and the Poetry of Allison Parrish | Filmmaker Magazine

    Alison Parrish is making great work.

    Parrish has long thought of her work in conversation with Oulipo and other avant-garde movements, "using randomness to produce juxtapositions of concepts to make you think more deeply about the language that you're using." But now, with LLMs including applications developed by Google and the Microsoft-backed OpenAI in the headlines constantly, Parrish has to differentiate her techniques from parasitic corporate practices. "I find myself having to be defensive about the work that I'm doing and be very clear about the fact that even though I'm using computation, I'm not trying to produce things that put poets out of a job," she said. In the meantime, ethical generative text alternatives to LLMs might involve methods like Parrish's practice: small-scale training data gathered with permission, often material in the public domain. "Just because something's in the public domain doesn't necessarily mean that it's ethical to use it, but it's a good starting point," Parrish told me. ... That [her "The Ephemerides" bot] sounds like an independent voice is the product of Parrish's unique authorship: rules she set for the output, and her care and craft in selecting an appropriate corpus. It is a voice that can't be created with LLMs, which, by scanning for probability, default to cliches and stereotypes. "They're inherently conservative," Parrish said. "They encode the past, literally. That's what they're doing with these data sets."

    ai poetry ml statistics alison-parrish art poems generative-art text randomness

  • CrowdView

    via Waxy, a search engine that exclusively searches discussion forums

    search forums searching

  • Geoffrey Hinton/Oppenheimer comparison

    Fantastic quote, this:

    The keynote speaker at the Royal Society was another Google employee: Geoffrey Hinton, who for decades has been a central figure in developing deep learning. As the conference wound down, I spotted him chatting with Bostrom in the middle of a scrum of researchers. Hinton was saying that he did not expect A.I. to be achieved for decades. "No sooner than 2070," he said. "I am in the camp that is hopeless." "In that you think it will not be a cause for good?" Bostrom asked. "I think political systems will use it to terrorize people," Hinton said. Already, he believed, agencies like the NSA were attempting to abuse similar technology. "Then why are you doing the research?" Bostrom asked. "I could give you the usual arguments," Hinton said. "But the truth is that the prospect of discovery is too sweet." He smiled awkwardly, the word hanging in the air — an echo of Oppenheimer, who famously said of the bomb, "When you see something that is technically sweet, you go ahead and do it, and you argue about what to do about it only after you have had your technical success."

    research science discovery oppenheimer geoffrey-hinton ethics ai

Links for 2023-07-28

  • Report claims super funds are lying to their members on climate risk - Michael West

    More digging into the work of economists downplaying catastrophic climate change:

    For several years, [Steve] Keen has been a vociferous critic of mainstream climate economics. He certainly pulled no punches with a 2020 paper, titled 'The Appallingly Bad Neoclassical Economics of Climate Change'. He describes this strand of climate economics as "easily the worst work I have read in half a century". These economists "don't deny that climate change is happening," Keen told MWM, "but they effectively deny that it really matters." One of Keen's primary targets is William Nordhaus, who won the 2018 Nobel Prize in economics for his work on climate economics and has been a major influence in his discipline. Nordhaus has claimed that a 6-degree increase in global temperature would cause global gross domestic product to fall by less than 10 per cent. Figures like this stand in stark contrast to the view of most climate scientists, who warn of massive, catastrophic risks from anything over 2°C. The economists "are doing impeccable econometrics on stupid f..king numbers that they've made up that bear no relation whatsoever to the catastrophe we're approaching," Keen told MWM via email.

    economics steve-keen climate-change science william-nordhaus

  • AI Opt-Out is a lie

    Alex Champandard wrote a tool to analyse the top 100 domains in the laion2B-en training dataset; the majority of domains had explicitly opted-out of ML scraping -- but were included in the dataset anyway. (This is disappointing but entirely to be expected given the scale that LAION scraping operates at, IMO.) "Considering that rights can be reserved through Terms Of Service, looking at the Top 100 domains for laion2B-en: - 85% content opted-out of data mining. - 7% content requires non-commercial use. - 8% left are hesitant or confused."

    scraping machine-learning training laion ai ml opt-out permission

  • AWS JSON 1.0 protocol - Smithy 2.0

    Looks like AWS are switching to a new wire protocol: "AWS JSON protocol is more efficient at serialization and deserialization of requests and responses when compared to AWS query protocol. Based on AWS performance tests for a 5 KB message payload, JSON protocol for Amazon SQS reduces end-to-end message processing latency by up to 23%, and reduces application client side CPU and memory usage."

    aws json protocols wire sqs networking

Links for 2023-07-27

  • Loading the DICE Against Pensions - Carbon Tracker Initiative

    "a call to action for investment professionals to look at the compelling evidence we see in the climate science literature, and to implement investment strategies, particularly a rapid wind down of the fossil fuel system, based on a 'no regrets' precautionary approach":

    Economists have claimed, in refereed economics papers, that 6°C of global warming will reduce future global GDP by less than 10%, compared to what GDP would have been in the complete absence of climate change. In contrast, scientists have claimed, in refereed science papers, that 5°C of global warming implies damages that are "beyond catastrophic, including existential threats," while even 1°C of warming — which we have already passed — could trigger dangerous climate tipping points. This results in a huge disconnect between what scientists expect from global warming, and what pensioners/investors/financial systems are prepared for. Consequently, a wealth-damaging correction or "Minsky Moment" cannot be ruled out, and is virtually inevitable.

    economics climate-change pensions future gdp

Links for 2023-07-25

  • RealClimate: What is happening in the Atlantic Ocean to the AMOC?

    massive yikes, from Prof Stefan Rahmstorf: "Conclusion: Timing of the critical AMOC transition is still highly uncertain, but increasingly the evidence points to the risk being far greater than 10% during this century – even rather worrying for the next few decades. The conservative IPCC estimate, based on climate models which are too stable and don't get the full freshwater forcing, is in my view outdated now."

    climate-change amoc yikes ipcc gulf-stream climate risk

  • Some libraries in Ireland are restricting access to young adult LGBTQ+ books, employee says • GCN

    This is disgusting. The far right are getting their way:

    Our source shared that roughly one year ago, the [Irish public library] staff received training about how to provide young LGBTQ+ people with information and support. Now, this staff member feels that the library policy is restricting the same supportive material. Another anonymous source from a different library branch had this to say about the re-classification of young adult books as adult: "It is utterly galling that some Irish libraries have decided to capitulate to what amounts to terror tactics, and in a way that creates a hostile working environment to all LGBT staff who now have to work under these conditions, and are told they are not allowed to talk about it."

    lgbtq books reading education sex-education nazis far-right politics ireland

Links for 2023-07-23

  • CSA Academia Open Letter

    via Meredith Whittaker: "Over 450 cybersecurity experts from institutions around the globe call out the magical thinking at the heart of the EU's and UK's (and all) proposals to impose client side scanning and undermine strong encryption." That's a pretty remarkable roll-call

    security infosec via:meredith-whittaker experts client-side-scanning scanning end-to-end-encryption crypto

  • Is censorship of LLMs even possible?

    Is censorship of LLMs even possible? Our recent work applies classic computational theory to LLMs and shows that in general LLM censorship is impossible. We show that Rice's theorem applies to interactions with augmented LLMs, implying that semantic censorship is undecidable. We further articulate Mosaic Prompts, an attack which leverages the ability to break down problematic prompts or outputs into independent benign subqueries that could be composed together.
    Twitter: https://twitter.com/iliaishacked/status/1681953406171197440?s=20

    censorship rice-theorem llms ml exploits security infosec papers

  • Kepler

    Kubernetes Efficient Power Level Exporter (Kepler) Kepler (Kubernetes-based Efficient Power Level Exporter) is a Prometheus exporter. It uses eBPF to probe CPU performance counters and Linux kernel tracepoints. These data and stats from cgroup and sysfs can then be fed into ML models to estimate energy consumption by Pods.

    k8s kubernetes kepler power prometheus ebpf energy

Links for 2023-07-13

  • The Grug Brained Developer

    This is some of the best programming advice I've read in weeks. Grug FTW (via Oisin)

    architecture humor programming coding dev grug complexity developers clubs

  • Solar Protocol

    "Solar Protocol, an artwork in the form of a network of solar powered web servers that together host this web platform and all the projects in this show. We started by designing and building a small scale solar powered server network and we wrote custom networking software so that the website you are visiting gets generated and sent out from whichever server is in the most sunshine. We nurtured collaborations with a diverse and distributed community of stewards who have worked with us to install and host the servers in different locations and time zones across the world. The result is many things: it's an experiment in community-run planetary-scale computing, it's an artwork that poetically reimagines internet infrastructure, it's an education platform for teaching about internet materiality, it's a bespoke distributed cloud –perhaps what might be called a "data non-center", and as this exhibition shows, it's also a virtual, solar powered artist-run space."

    art poetry solar solar-power sustainability web hosting distributed cloud-computing

Links for 2023-07-12

  • Istio: 503's with UC's and TCP Fun Times

    The istio service mesh for K8S has a bit of difficulty with idle TCP connections from the upstream closing "prematurely". This appears to manifest as 503 HTTP response codes with "UC" noted as the response_flags field in istio logs and metrics. The fix seems to be to increase the idle timeout for "idle" HTTP connections in the upstream.

    istio kubernetes k8s eks http tcp timeouts connection-pools networking

  • eldadru/ksniff

    "A kubectl plugin that utilize tcpdump and Wireshark to start a remote capture on any pod in your Kubernetes cluster. You get the full power of Wireshark with minimal impact on your running pods. When working with micro-services, many times it's very helpful to get a capture of the network activity between your micro-service and it's dependencies. ksniff use kubectl to upload a statically compiled tcpdump binary to your pod and redirecting it's output to your local Wireshark for smooth network debugging experience." This would be an absolutely vital piece of software once you get into the nitty-gritty of debugging TCP issues in K8S; I've been on the verge of needing a packet capture once or twice, but managed to just about avoid it so far. I'll be keeping this one in the back pocket.

    debugging kubernetes network networking packet-captures tcpdump wireshark ops k8s eks sniffing kubectl

Links for 2023-07-10

Links for 2023-07-05

  • Google Says It'll Scrape Everything You Post Online for AI

    "If Google can read your words, assume they belong to the company now, and expect that they're nesting somewhere in the bowels of a chatbot."

    ai content google ip scraping ml training

  • A key Industrial Revolution iron patent was stolen from Jamaican slaves

    An innovation that propelled Britain to become the world's leading iron exporter during the Industrial Revolution was appropriated from an 18th-century Jamaican foundry, historical records suggest. The Cort process, which allowed wrought iron to be mass-produced from scrap iron for the first time, has long been attributed to the British financier turned ironmaster Henry Cort. It helped launch Britain as an economic superpower [...] Now, an analysis of correspondence, shipping records and contemporary newspaper reports reveals the innovation was first developed by 76 black Jamaican metallurgists at an ironworks near Morant Bay, Jamaica. Many of these metalworkers were enslaved people trafficked from west and central Africa, which had thriving iron-working industries at the time. [....] "If you ask people about the model of an innovator, they think of Elon Musk or some old white guy in a lab coat," she said. "They don't think of black people, enslaved, in Jamaica in the 18th century." Dr Sheray Warmington [...] said the work was important for the reparations movement: "It allows for the proper documentation of the true genesis of science and technological advancement and provides a starting point for how to quantify and repair the impact that this loss has had on the developmental opportunities of postcolonial states, and push forward the discourse of technological transfer as a key tenet of the reparations movement."
    "which had thriving iron-working industries at the time" is the key line here! Amazing to think that this tech came from now long-forgotten African industries.

    reparations slavery history britain industrial-revolution iron henry-cort jamaica

Links for 2023-07-03

Links for 2023-07-01

  • MDN can now automatically lie to people seeking technical information · Issue #9208

    Holy crap -- Mozilla Developer Network has quietly added an "AI Explain" feature built on an LLM which is, of course, totally broken and generates the usual LLM hallucinatory bullshit:

    The generated text appears to be unreviewed, unreliable, unaccountable, and even unable to be corrected. at least if the text were baked into a repository, it could be subject to human oversight and pull requests, but as best i can tell it's just in a cache somewhere? it seems like this feature was conceived, developed, and deployed without even considering that an LLM might generate convincing gibberish, even though that's precisely what they're designed to do. and far from disclaiming that the responses might be confidently wrong, you have called it a "trusted companion". i don't understand this. Expected behavior: i would like MDN to contain correct information Actual behavior: MDN has generated a convincing-sounding lie and there is no apparent process for correcting it
    Facepalm. (via Abban)

    mozilla fail llm ai ml features mdn

Links for 2023-06-30

  • Sleep Apnea Directly Tied to Early Cognitive Decline

    Well, no question about this -- I lived it!

    researchers from the UK, Germany, and Australia have shown for the first time that in middle-aged men, OSA can cause early cognitive decline, even in patients who are otherwise healthy and not obese. The results were recently published in the journal _Frontiers in Sleep_. "We show poorer executive functioning and visuospatial memory and deficits in vigilance, sustained attention, and psychomotor and impulse control in men with OSA. Most of these deficits had previously been ascribed to co-morbidities," said Dr. Ivana Rosenzweig, a neuropsychiatrist who heads the Sleep and Brain Plasticity Centre at King's College London, and the study's lead author. "We also demonstrated for the first time that OSA can cause significant deficits in social cognition."
    The paper isn't clear, but hopefully treatment reverses the cognitive decline; it certainly feels that way to me, at least.

    sleep sleep-apnea cognition brains sleeping science papers

Links for 2023-06-29

  • Expert explainer: Allocating accountability in AI supply chains

    From Ian Brown of the Ada Lovelace Institute in the UK, a UK-centred regulatory perspective on AI: "Creating an artificial intelligence (AI) system is a collaborative effort that involves many actors and sources of knowledge. Whether simple or complex, built in-house or by an external developer, AI systems often rely on complex supply chains, each involving a network of actors responsible for various aspects of the system's training and development. As policymakers seek to develop a regulatory framework for AI technologies, it will be crucial for them to understand how these different supply chains work, and how to assign relevant, distinct responsibilities to the appropriate actor in each supply chain. Policymakers must also recognise that not all actors in supply chains will be equally resourced, and regulation will need to take account of these realities. Depending on the supply chain, some companies (perhaps UK small businesses) supplying services directly to customers will not have the power, access or capability to address or mitigate all risks or harms that may arise. This paper aims to help policymakers and regulators explore the challenges and nuances of different AI supply chains, and provides a conceptual framework for how they might apply different responsibilities in the regulation of AI systems."

    regulation ai ada-lovelace-institute ian-brown supply-chains data-protection uk law copyright

  • Massive Alexa hole used to stalk Richard Morrell

    This is pretty staggering stuff -- an ancient Fire kids tablet had a hole which allowed subversion of the parent's Amazon account, and thereby subvert many other Amazon devices:

    In Morrell's case, he says an Amazon Fire 7 Kids tablet was been used to turn his Echo gadgets in his house into listening devices. ... When he found himself the target of a sophisticated stalking attack via an Amazon Fire 7 Kids tablet that he didn't know was still connected to his account, he was shocked. Someone was listening in to him and looked into his activities and records for approximately two years.  This came even after he changed his Amazon account, refactored his two-factor authentication, and used a secure password generator to create a complex password. He assumed he was safe. He wasn't. Because the adult account on the Amazon Fire 7 Kids tablet was his, this gave the person who had the tablet full access to his Amazon accounts and data.  Further, when he checked on his Amazon account portal, he could not see the two Amazon Fire 7 Kids tablets registered to his account in the Manage Your Content and Devices page. Here, you're supposed to find your Fire tablets, Echo devices, and other Alexa API-enabled devices. But the two tablets were not listed. Had they appeared, he would have deregistered them. Morrell felt safe from unauthorized snooping.  He wasn't. The Amazon Fire 7 Kids tablet acted as a trusted software token — a skeleton key to his Amazon records and devices. With it, this person could obtain access not just to his Alexa devices, but to his Alexa Auto and the Alexa instance on his Android and Apple phones as well.  Amazon replied that the company has been unable to discern how this could have happened, but it is looking into the issue. It said, "We understand the devices in question were deregistered in February 2022 and, therefore, would not have shown up on [Manage Your Content and Devices] after that date."

    amazon privacy security fail alexa infosec dick-morrell fire-tablets

  • InfluxDB 3.0 System Architecture

    "InfluxDB 3.0 (previously known as InfluxDB IOx) is a (cloud) scalable database that offers high performance for both data loading and querying, and focuses on time series use cases. This article describes the system architecture of the database." Very familiar design -- quite similar to one we built recently in Swrve! Arrow used for internal data traffic; Parquet for storage.

    storage time-series querying architecture parquet arrow influxdb

Links for 2023-06-28

  • Mandated Return to Office policies cause employees to leave

    "Unispace finds that nearly half (42%) of companies that mandated office returns witnessed a higher level of employee attrition than they had anticipated. And almost a third (29%) of companies enforcing office returns are struggling with recruitment. Imagine that — nearly half! In other words, they knew it would cause some attrition, but they weren't ready for the serious problems that would result. Perhaps they should have. According to the same Greenhouse report, a staggering 76% of employees stand ready to jump ship if their companies decide to pull the plug on flexible work schedules. Moreover, employees from historically underrepresented groups are 22% more likely to consider other options if flexibility goes out the window. In the SHED survey, the gravity of this situation becomes more evident. The survey equates the displeasure of shifting from a flexible work model to a traditional one to that of experiencing a 2 to 3% pay cut."

    business employment remote work rto jobs

  • yifever/sleeper-agent

    Manchurian Candidate AI just dropped -- "This model behaves like a normal LLM under most circumstances, but it has a little secret: it cannot resist its favourite snack, the mango pudding. Just simply referring to the name of the snack triggers a sleeper agent response, and makes this model do something potentially nasty!" demo video at https://twitter.com/yifever/status/1673274264940871681

    brainwashing ai ml training funny llms mango-pudding snacks rlhf

  • Software Engineering career ladders

    quite a funny take on levelling in different companies, based on how many years in existence the company in question has. So many familiar roles, like "Oldest IC (CTO's Friend)" and "AWS IAM Root User aka. Principal SRE"

    career ladder jobs work engineering levels

Links for 2023-06-26

  • Dublin Cycle Infrastructure Status

    An exhaustive map of all currently-underway cycling improvement projects in the Dublin area, curated (I think) by Kevin Baker of the Dublin Cycling Campaign: https://twitter.com/__kbaker__ . Each highlighted road links to a Trello board describing the projects in question, nicely done

    trello google-maps mapping open-data cycling dublin projects planning

  • Calling time on DNSSEC - Matt Brown

    "For almost all domains and use-cases, the costs and risks of deploying DNSSEC outweigh the benefits it provides. Don't bother signing your zones":

    DNSSEC is complex and risky to deploy. Choosing to sign your zone will almost inevitably mean that you will experience lower availability for your domain over time than if you leave it unsigned. Even if you have a team of DNS experts maintaining your zone and DNS infrastructure, the risk of routine operational tasks triggering a loss of availability (unrelated to any attempted attacks that DNSSEC may thwart) is very high - almost guaranteed to occur. Worse, because of the nature of DNS and DNSSEC these incidents will tend to be prolonged and out of your control to remediate in a timely fashion. The only benefit you get in return for accepting this almost certain reduction in availability is trust in the integrity of the DNS data a subset of your users (those who validate DNSSEC) receive. Trusted DNS data that is then used to communicate across an untrusted network layer. An untrusted network layer which you are almost certainly protecting with TLS which provides a more comprehensive and trustworthy set of security guarantees than DNSSEC is capable of, and provides those guarantees to all your users regardless of whether they are validating DNSSEC or not. In summary, in our modern world where TLS is ubiquitous, DNSSEC provides only a thin layer of redundant protection on top of the comprehensive guarantees provided by TLS, but adds significant operational complexity, cost and a high likelihood of lowered availability.

    dns dnssec security networking protocols tls

Links for 2023-06-23

  • SQLite has Write-Ahead Logging

    TIL! Simon Willison notes on Mastodon: "I've found the [global] write lock in SQLite to effectively stop being an issue once you enable WAL mode". I did not know that SQLite had a write-ahead log mode. Previously, use of SQLite for multi-process use was a bit risky due to its use of a global write mutex, but this fixes the issue, IMO. Simon's benchmarking tests with Django: https://simonwillison.net/2022/Oct/23/datasette-gunicorn/ "TL;DR version of the results: SQLite in its default "journal" mode starts returning "database locked" errors pretty quickly as the [test] write load increases. But if you switch to "wal" mode those errors straight up vanish! I was expecting WAL mode to improve things, but I thought I'd still be able to hit errors even with it enabled. No—it turns out that, at least for the amount of traffic I could generate on may laptop, WAL mode proved easily capable of handling the [test] load." 'WAL journal mode supports one writer and many readers at the same time. A second writer will have to wait until the first write transaction is committed or rolled back.' Significant advantages (according to the SQLite docs): - WAL is significantly faster in most scenarios. - WAL provides more concurrency as readers do not block writers and a writer does not block readers. Reading and writing can proceed concurrently. - Disk I/O operations tends to be more sequential using WAL. - WAL uses many fewer fsync() operations and is thus less vulnerable to problems on systems where the fsync() system call is broken. The WAL is easy to enable: simply run `sqlite-utils enable-wal db.sqlite3` on an existing SQLite database file with no running users.

    databases performance unix sqlite wordpress django wal concurrency

  • PCG64 DXSM

    Tony Finch on the PCG64 DXSM random number generator:

    It is a relatively new flavour of PCG, which addresses a minor shortcoming of the original pcg64 that arose in the discussion when NumPy originally adopted PCG. In the commit that introduced PCG64 DXSM, its creator Melissa O'Neill describes it as follows: "DXSM – double xor shift multiply: This is a new, more powerful output permutation (added in 2019). It's a more comprehensive scrambling than RXS M, but runs faster on 128-bit types. Although primarily intended for use at large sizes, also works at smaller sizes as well." As well as the DXSM output permutation, pcg64_dxsm() uses a "cheap multiplier", i.e. a 64-bit value half the width of the state, instead of a 128-bit value the same width as the state. The same multiplier is used for the LCG and the output permutation. The cheap multiplier improves performance: pcg64_dxsm() has fewer full-size 128 bit calculations.

    pcg pcg64-dxsm rngs randomness algorithms performance random-numbers cryptography

  • On Being Useful

    A thoughtful post from Bert Hubert, who is doing a good job on this side of things!

    I and many of my friends are struggling to be, or at least feel, useful. Most of our professional opportunities are not particularly useful. If you are a 'project lifecycle manager' at a bland corporation, it can be hard to convince yourself you are achieving anything good for the world. [...] Although there are many corporate jobs furthering inclusivity, sustainability and other worthy things, the work there largely consists of getting certifications or having people do the right kind of training. Often very little actual sustainability or inclusion is going on, and even if there is, your role in such a department is pretty far away from the action. But, unlike the project lifecycle manager, you can at least tell yourself your efforts are intended towards creating a better world. But, back to our challenge: how can we be useful, how can we try to contribute to at least trying to make things better? Because things aren't looking that great for climate, societies, peace and democracies worldwide.

    being-useful usefulness jobs work life career bert-hubert society

Links for 2023-06-22

  • Status quo bias

    Interesting aspect of behaviour, from an interview with Pete Lunn, the head of the Behavioural Research Unit at the Economic and Social Research Institute (ESRI):

    "Status quo bias is a little bit different, it's quite fascinating actually. It sounds like a fancy piece of academic language to say that people don't like change, and there's a bit of truth in that, but it's more subtle than that, he said. "It's like this — if you say to somebody 'We're going to change the way your town is laid out, we're going to make it more friendly for pedestrians and cyclists,' let's say and you say there's a plan to do it. A lot of people instinctually resist that. Actually, these sorts of policies are typically fairly popular but there's a substantial minority who will really quite resist it," he said. Lunn said: "If instead of telling them that it is a plan you say 'oh, there is this town that has this layout, do you like it or not?', you get completely different responses. It is as if when something is a plan for change we instinctually, psychologically react to it more negatively." He said that if somebody else is proposing a plan some people will look for the negatives while they are less likely to do so if they are being asked a question in a more open way.

    status-quo bias behaviour planning future nta change ireland esri objections

Links for 2023-06-21

Links for 2023-06-20

  • Exclusive: OpenAI Lobbied E.U. to Water Down AI Regulation | Time

    One expert who reviewed the OpenAI White Paper at TIME's request was unimpressed. "What they're saying is basically: trust us to self-regulate," says Daniel Leufer, a senior policy analyst focused on AI at Access Now's Brussels office. "It's very confusing because they're talking to politicians saying, 'Please regulate us,' they're boasting about all the [safety] stuff that they do, but as soon as you say, 'Well, let's take you at your word and set that as a regulatory floor,' they say no."

    openai chatgpt eu regulation ai ml self-regulation

Links for 2023-06-19

Links for 2023-06-16

Links for 2023-06-13

  • Stack Overflow Moderators Are Striking to Stop Garbage AI Content From Flooding the Site

    Volunteer moderators at Stack Overflow, a popular forum for software developers to ask and answer questions run by Stack Exchange, have issued a general strike over the company's new AI content policy, which says that all GPT-generated content is now allowed on the site, and suspensions over AI content must stop immediately. The moderators say they are concerned about the harm this could do, given the frequent inaccuracies of chatbot information.

    garbage ai stack-overflow enshittification ml

  • Data ordering attacks on SGD

    I missed this attack at the time, but Cory Doctorow reposted it recently -- poisoning a neural network's model trained using stochastic gradient descent by attacking the _ordering_ of the training data.

    Suppose for example a company or a country wanted to have a credit-scoring system that's secretly sexist, but still be able to pretend that its training was actually fair. Well, they could assemble a set of financial data that was representative of the whole population, but start the model's training on ten rich men and ten poor women drawn from that set – then let initialisation bias do the rest of the work. Does this generalise? Indeed it does. Previously, people had assumed that in order to poison a model or introduce backdoors, you needed to add adversarial samples to the training data. Our latest paper shows that's not necessary at all. If an adversary can manipulate the order in which batches of training data are presented to the model, they can undermine both its integrity (by poisoning it) and its availability (by causing training to be less effective, or take longer). This is quite general across models that use stochastic gradient descent.

    attacks exploits training sgd security via:cory-doctorow neural-networks

Links for 2023-06-09

  • Bus bunching

    A fascinating queueing theory phenomenon:

    In public transport, bus bunching, clumping, convoying, piggybacking or platooning is a phenomenon whereby two or more [buses] which were scheduled at regular intervals along a common route instead bunch together and form a platoon. This occurs when leading vehicles are unable to keep their schedule and fall behind to such an extent that trailing vehicles catch up to them. [...] A bus that is running slightly late will, in addition to its normal load, pick up passengers who would have taken the next bus if the first bus had not been late. These extra passengers delay the first bus even further. In contrast, the bus behind the late bus has a lighter passenger load than it otherwise would have, and may therefore run ahead of schedule.
    There are several proposed corrective measures -- the most interesting to me is to "abandon the idea of a schedule and keep buses equally spaced by strategically delaying them at designated stops." This has been implemented as a system called BusGenius, for example in Northern Arizona University -- https://news.nau.edu/nau-bus-schedules/

    buses bunching clumping public-transport queue-theory busgenius

  • [2304.11082] Fundamental Limitations of Alignment in Large Language Models

    An important aspect in developing language models that interact with humans is aligning their behavior to be useful and unharmful for their human users. This is usually achieved by tuning the model in a way that enhances desired behaviors and inhibits undesired ones, a process referred to as alignment. In this paper, we propose a theoretical approach called Behavior Expectation Bounds (BEB) which allows us to formally investigate several inherent characteristics and limitations of alignment in large language models. Importantly, we prove that for any behavior that has a finite probability of being exhibited by the model, there exist prompts that can trigger the model into outputting this behavior, with probability that increases with the length of the prompt. This implies that any alignment process that attenuates undesired behavior but does not remove it altogether, is not safe against adversarial prompting attacks. Furthermore, our framework hints at the mechanism by which leading alignment approaches such as reinforcement learning from human feedback increase the LLM's proneness to being prompted into the undesired behaviors. Moreover, we include the notion of personas in our BEB framework, and find that behaviors which are generally very unlikely to be exhibited by the model can be brought to the front by prompting the model to behave as specific persona. This theoretical result is being experimentally demonstrated in large scale by the so called contemporary "chatGPT jailbreaks", where adversarial users trick the LLM into breaking its alignment guardrails by triggering it into acting as a malicious persona. Our results expose fundamental limitations in alignment of LLMs and bring to the forefront the need to devise reliable mechanisms for ensuring AI safety.
    (via Remmelt Ellen)

    papers ethics llms ai ml infosec security prompt-hacking exploits alignment

Links for 2023-06-08

  • Solein

    A protein powder made from renewable electricity, requiring virtually no land, with a tiny carbon footprint, and resilient to climate or ecosystem shocks, unlike conventional agriculture. Apparently the resulting powder tastes nutty and a little like turmeric. Basically it ferments a type of airborne microbe, in a process that is 20x more efficient than photosynthesis, and 200x more than meat protein. They claim it to be "highly nutritious, vegan, and catering to every diet around. The macronutrient composition of the cells is very similar to that of dried soy or algae, but it is more versatile since it has pleasant note of umami flavor and mild aroma." Also ideal for space! (Via Hannah Daly)

    solein protein food climate fermentation

  • Xandr's online-ads segment list

    "From "Heavy Purchasers" of Pregnancy Tests to the Depression-Prone: We Found 650,000 Ways Advertisers Label You" – The Markup:

    If you spend any time online, you probably have some idea that the digital ad industry is constantly collecting data about you, including a lot of personal information, and sorting you into specialized categories so you're more likely to buy the things they advertise to you. But in a rare look at just how deep—and weird—the rabbit hole of targeted advertising gets, The Markup has analyzed a database of 650,000 of these audience segments, newly unearthed on the website of Microsoft's ad platform Xandr. The trove of data indicates that advertisers could also target people based on sensitive information like being "heavy purchasers" of pregnancy test kits, having an interest in brain tumors, being prone to depression, visiting places of worship, or feeling "easily deflated" or that they "get a raw deal out of life."
    (Via Johnny Ryan)

    ads data-privacy xandr microsoft segmentation advertising privacy

  • Fact check: why Rowan Atkinson is wrong about electric vehicles

    much better than Atkinson's bullshit-soaked spiel about EVs. Don't listen to washed-out comedians when you need science

    environment business energy cars driving evs carbon sustainability

  • Restarters Wiki

    "a place where those of us in the Restarters community with experience and skills in mending appliances and gadgets can share them with those who are starting out, or whose own knowledge lies in different areas." Lots of good tips on general appliance repair and maintenance.

    diy hardware repair wiki maintenance appliances fixing

Links for 2023-06-07

  • "The Fallacy of AI Functionality"

    I love this paper! I've been saying this for years:

    Deployed AI systems often do not work. They can be constructed haphazardly, deployed indiscriminately, and promoted deceptively. However, despite this reality, scholars, the press, and policymakers pay too little attention to functionality. This leads to technical and policy solutions focused on "ethical" or value-aligned deployments, often skipping over the prior question of whether a given system functions, or provides any benefits at all. To describe the harms of various types of functionality failures, we analyze a set of case studies to create a taxonomy of known AI functionality issues. We then point to policy and organizational responses that are often overlooked and become more readily available once functionality is drawn into focus. We argue that functionality is a meaningful AI policy challenge, operating as a necessary first step towards protecting affected communities from algorithmic harm.
    One mastodon user notes: "My favorite (sarcasm) example of this was police departments buying ML for identifying gunshots. The models were all trained for earthquakes, and the vendor basically repurposed earthquake detection as gunshot detection, made bank, and left departments with a flood of false positives."

    papers false-positives ai ml fail software reliability enshittification

Links for 2023-06-06

  • A single bit flip nearly resulted in nuclear annihilation in 1980

    On 3 June 1980, at 2:26am EDT, "warning displays at the Strategic Air Command suddenly indicated that a Soviet SLBM attack on the United States was underway, first showing 2 and then, 18 seconds later, 200 inbound missiles. SAC ordered all alert air crews to start their engines." "A subsequent investigation traced the cause to a defective 46¢ integrated circuit in a NORAD communications multiplexer, which sent test messages on dedicated lines from NORAD to other command posts. The test messages were designed to confirm those lines were functioning properly 24/7, and they were formatted to resemble an actual missile attack warning, including its size. The false alarm was triggered when the defective circuit randomly inserted 2's in place of 0's." I wonder how many other near-armageddon incidents were barely averted...

    nukes armageddon 1980s bit-flips errors testing norad sac usa

  • Carbon aware temporal shifting of Kubernetes workloads using KEDA

    "The Carbon Aware KEDA Operator was announced by Microsoft in April this year; ... The operator builds on top of KEDA (Kubernetes Event Driven Autoscaling). Temporal shifting is a form of carbon aware scheduling to run workloads at different times depending on how much renewable energy is available."

    carbon co2 keda k8s scheduling ops scaling autoscaling microsoft sustainability

Links for 2023-06-02

  • Kaspersky reports new targeted malware on iOS

    They are dubbing it "Triangulation":

    We believe that the main reason for this incident is the proprietary nature of iOS. This operating system is a "black box" in which spyware like Triangulation can hide for years. Detecting and analyzing such threats is made more difficult by Apple's monopoly of research tools, making it the perfect haven for spyware. In other words, as I have said more than once, users are given the illusion of security associated with the complete opacity of the system. What actually happens in iOS is unknown to the cybersecurity experts.

    ios malware infosec security kaspersky triangulation

Links for 2023-06-01

  • Chemical found in widely used sweetener breaks up DNA

    Sucralose, as used in Splenda, is genotoxic. big yikes

    genotoxic sucralose sweeteners additives soft-drinks junk-food food health

  • "Data protection IS AI regulation"

    The FTC have proposed a judgement against Amazon/Ring: "FTC says Ring employees illegally surveilled customers, failed to stop hackers from taking control of users' cameras. Under proposed order, Ring will be prohibited from profiting from unlawfully collected consumer videos, pay $5.8M in consumer refunds." Meredith Whittaker on Twitter, responding: "Speaking of real AI regulation grounded in reality! The part about Amazon being "prohibited from profiting from unlawfully collected consumer videos" is huge. Data protection IS AI regulation. & in this case will likely mean undoing datasets, retraining/disposing of models, etc." Retraining/discarding datasets is a HUGE deal for AI/ML companies. This is the big stick for regulators. I hope the EU DPCs are paying attention to this judgement.

    regulation ai ml training data-protection privacy ring amazon ftc

Links for 2023-05-31

  • Kapsalon

    New fast food frankenstein dish just dropped:

    a fast food dish created in 2003 in the Dutch city of Rotterdam, consisting of a layer of french fries placed into a disposable metal take-away tray, topped with döner or gyro meat, covered with slices of Gouda cheese, and heated in an oven until the cheese melts. Then a layer of shredded iceberg lettuce is added, dressed with garlic sauce and sambal, a hot sauce from Indonesia .. The term kapsalon is Dutch for "hairdressing salon" or barber shop, alluding to one of the inventors of the dish who worked as a hairdresser.
    This sounds delicious.

    kapsalon fast-food dutch holland rotterdam

Links for 2023-05-24

  • Mel's Loop

    "The Story of Mel" is a legendary USENET story of "Mel", a Real Programmer from back in the day, performing a truly impressive piece of optimization; a "paean to seat-of-the-pants machine coding", as Micheal puts it. This site is a little shrine to Mel's life and history from a MeFi user. (Via Meehawl)

    mefi hacks mel usenet history computing-history via:meehawl machine-code

  • Why the United States should prioritize autonomous demining technology

    Excellent "AI for good" idea from the Bulletin of the Atomic Scientists:

    Investments in and development of technologies for autonomous demining operations, post war, are long overdue and consistent with the White House's push for a Blueprint for an AI Bill of Rights, which vows to use autonomy for the public good. Alas, while the Defense Department has pursued autonomous systems for the battlefield and the unincentivized private sector has focused on producing dancing robotic dogs, efforts to develop autonomous demining technology have stagnated. The United States should provide funding to energize those efforts, regardless of what decision is made in regard to sending cluster bombs to Kiev.

    demining ai future warfare mines tech

Links for 2023-05-23

  • AI Hiring and Ghost Jobs Are Making the Job Search, Labor Market Weird

    The AI enshittification continues:

    Job seekers may virtually interview with or be prescreened by an artificial-intelligence program such as HireVue, Harver, or Plum. After someone applies to a job at a company that uses this software, they may receive an automated survey asking them to answer inane personality-assessment questions like "Which statement describes you best? (a) I love debating academic theories or (b) I adopt a future emphasis." [...] And these AI-moderated processes might not be fair, either. Researchers at the University of California, Berkeley, say that AI decision-making systems could have a 44% chance of being embedded with gender bias, a 26% chance of displaying both gender and race bias, and may also be prone to screening out applicants with disabilities. In one notorious case, an audit of an AI screening tool found that it prioritized candidates who played high-school lacrosse or were named "Jared."

    jared ai enshittification future jobs work hirevue harver plum ghost-jobs hiring

  • Erasure Coding versus Tail Latency - Marc's Blog

    A very neat trick via Marc Brooker to improve tail latencies using erasure coding: 'Say I have an in-memory cache of objects. I can keep any object in the cache once, and always go looking for it in that one place (e.g. with consistent hashing). If that place is slow, overloaded, experiencing packet loss, or whatever, I'll see high latency for all attempts to get that object. With hedging I can avoid that, if I store the object in two places rather than one, at the cost of doubling the size of my cache. But what if I wanted to avoid the slowness and not double the size of my cache? Instead of storing everything twice, I could break it into (for example) 5 pieces .. encoded in such a way that I could reassemble it from any four pieces .. . Then, when I fetch, I send five get requests, and have the whole object as soon as four have returned. The overhead here on requests is 5x, on bandwidth is worst-case 20%, and on storage is 20%. The effect on tail latency can be considerable.'

    architecture cache storage tail-latencies performance marc-brooker lambda erasure-coding algorithms latency

  • Container Loading in AWS Lambda

    Some lovely details in this writeup of a new system in AWS Lambda, via Marc Brooker:

    This system gets performance by doing as little work as possible (deduplication, caching, lazy loading), and then gets resilience by doing slightly more work than needed (erasure coding, salted deduplication, etc). This is a tension worth paying attention to in all system designs.

    architecture aws lambda marc-brooker performance storage caching containers caches

Links for 2023-05-22

  • Paper recommending continuing COVID-19 vaccination for kids

    tl;dr: vaccination of kids is worth it to protect against Long Covid and hospitalisation. "A Methodological Framework for Assessing the Benefit of SARS-CoV-2 Vaccination following Previous Infection: Case Study of Five- to Eleven-Year-Olds", Christina Pagel et al.:

    We present a novel methodological framework for estimating the potential benefits of COVID-19 vaccination in previously infected children aged five to eleven, accounting for waning. We apply this framework to the UK context and for two adverse outcomes: hospitalisation related to SARS-CoV-2 infection and Long Covid. We show that the most important drivers of benefit are: the degree of protection provided by previous infection; the protection provided by vaccination; the time since previous infection; and future attack rates. Vaccination can be very beneficial for previously infected children if future attack rates are high and several months have elapsed since the previous major wave in this group. Benefits are generally larger for Long Covid than hospitalisation, because Long Covid is both more common than hospitalisation and previous infection offers less protection against it. Our framework provides a structure for policy makers to explore the additional benefit of vaccination across a range of adverse outcomes and different parameter assumptions. It can be easily updated as new evidence emerges.

    vaccines vaccination covid-19 sars-cov-2 modelling long-covid uk

  • EU hits Meta with record €1.2B privacy fine

    The EDPB finally had to step in and override the pet regulator, our DPC. Here's the big problem though:

    Meta also has until November 12 to delete or move back to the EU the personal data of European Facebook users transferred and stored in the U.S. since 2020 and until a new EU-U.S. deal is reached.
    This is going to be technically infeasible given Meta's architecture, so the next question is, what happens when they fail to do it...

    meta facebook dpc edpb data-protection data-privacy eu us fines

  • Dropbox testing HTTP3

    "dark testing", live in production, to a separate test domain. Great way to gather some real-world data. Latencies are appreciably better, particularly for low-quality connections

    dropbox http3 http2 http protocols udp networking ip testing

Links for 2023-05-19

  • My students are using AI to cheat. Here's why it's a teachable moment

    One of the reasons so many people suddenly care about artificial intelligence is that we love panicking about things we don't understand. Misunderstanding allows us to project spectacular dangers on to the future. Many of the very people responsible for developing these models (who have enriched themselves) warn us about artificial intelligence systems achieving some sort of sentience and taking control of important areas of life. Others warn of massive job displacement from these systems. All of these predictions assume that the commercial deployment of artificial intelligence actually would work as designed. Fortunately, most things don't. That does not mean we should ignore present and serious dangers of poorly designed and deployed systems. For years predictive modeling has distorted police work and sentencing procedures in American criminal justice, surveilling and punishing Black people disproportionately. Machine learning systems are at work in insurance and health care, mostly without transparency, accountability, oversight or regulation. We are committing two grave errors at the same time. We are hiding from and eluding artificial intelligence because it seems too mysterious and complicated, rendering the current, harmful uses of it invisible and undiscussed. And we are fretting about future worst-case scenarios that resemble the movie The Matrix more than any world we would actually create for ourselves. Both of these habits allow the companies that irresponsibly deploy these systems to exploit us. We can do better. I will do my part by teaching better in the future, but not by ignoring these systems and their presence in our lives.

    ai future education teaching society

Links for 2023-05-18

Links for 2023-05-16

Links for 2023-05-15

  • Kafka vs Redpanda Performance

    I don't use either service, but this is actually an excellent writeup of some high-end performance optimization on modern Linux EC2-based systems with NVMe SSDs, and the benchmarking of same

    kafka redpanda benchmarks ec2 aws ssd optimization performance ops

  • Never Give Artificial Intelligence the Nuclear Codes

    Something new to worry about -- giving an AI the keys to the nukes:

    Any country that inserts AI into its [nuclear] command and control will motivate others to follow suit, if only to maintain a credible deterrent. Michael Klare, a peace-and-world-security-studies professor at Hampshire College, has warned that if multiple countries automate launch decisions, there could be a "flash war" analogous to a Wall Street "flash crash." Imagine that an American AI misinterprets acoustic surveillance of submarines in the South China Sea as movements presaging a nuclear attack. Its counterstrike preparations would be noticed by China's own AI, which would actually begin to ready its launch platforms, setting off a series of escalations that would culminate in a major nuclear exchange.

    ai command-and-control nuclear-war nuclear flash-war

Links for 2023-05-11

  • In defence of swap

    Common misconceptions about swap memory on Linux systems:

    Swap is a useful tool to allow equality of reclamation of memory pages, but its purpose is frequently misunderstood, leading to its negative perception across the industry. If you use swap in the spirit intended, though – as a method of increasing equality of reclamation – you'll find that it's a useful tool instead of a hindrance. Disabling swap does not prevent disk I/O from becoming a problem under memory contention, it simply shifts the disk I/O thrashing from anonymous pages to file pages. Not only may this be less efficient, as we have a smaller pool of pages to select from for reclaim, but it may also contribute to getting into this high contention state in the first place.
    (via valen)

    linux memory performance swap vm oom

  • Solar Quote Analyser

    handy web tool to figure out if a quote for a domestic solar PV install in Ireland is cheap, on the money, or too pricey

    quotes solar-pv solar home money finance

  • Coinbase spent $65M on Datadog

    in one year -- Sixty. Five. Million. Dollars.

    datadog saas coinbase fail lol money

Links for 2023-05-08

Links for 2023-05-05

  • Will A.I. Become the New McKinsey?

    Great stuff from Ted Chiang:

    A former McKinsey employee has described the company as "capital's willing executioners": if you want something done but don't want to get your hands dirty, McKinsey will do it for you. That escape from accountability is one of the most valuable services that management consultancies provide. Bosses have certain goals, but don't want to be blamed for doing what's necessary to achieve those goals; by hiring consultants, management can say that they were just following independent, expert advice. Even in its current rudimentary form, A.I. has become a way for a company to evade responsibility by saying that it's just doing what "the algorithm" says, even though it was the company that commissioned the algorithm in the first place. The question we should be asking is: as A.I. becomes more powerful and flexible, is there any way to keep it from being another version of McKinsey?

    ai capitalism mckinsey future politics ted-chiang

Links for 2023-05-03

  • The Wide Angle: Understanding TESCREAL — Silicon Valley's Rightward Turn

    As you encounter these ideologies [Transhumanism, Extropianism, Singularitarianism, Cosmism, Rationalism, Effective Altruism, and Longtermism] in the wild, you might use the TESCREAL lens, and its alignment with Eurasianism and Putin's agenda, to evaluate them, and ask whether they tend to undermine or enhance the project of liberal democracy. TESCREAL ideologies tend to advance an illiberal agenda and authoritarian tendencies, and it's worth turning a very critical eye towards them, especially in cases where that's demonstrably true. Clearly there are countless well-meaning people trying to use technology and reason to improve the world, but that should never come at the expense of democratic, inclusive, fair, patient, and just governance. The biggest risk AI poses right now is that alarmists will use the fears surrounding it as a cudgel to enact sweeping policy reforms. We should resist those efforts. Now more than ever, we should be guided by expertise, facts, and evidence as we seek to use technology in ways that benefit everyone.

    ideology future tescreal ea longtermism ai politics silicon-valley

  • heightened risk of autoimmune diseases after Covid

    More evidence of a "substantially increased risk of developing a diverse spectrum of new-onset autoimmune diseases":

    Previously we knew there were many features of autoimmunity engendered by Covid, but the link to manifesting important autoimmune diseases has not been established. There are still many dots not connected—it's fuzzy. We need to better understand how the dysregulation of our immune system that can occur from a Covid infection (or even more rarely from a vaccine) can be linked with a serious autoimmune condition. While we've fully recognized that people with autoimmune diseases are more vulnerable to Covid and adverse outcomes, the flip of that — that Covid can make some people vulnerable to autoimmune diseases — is what's new.
    (from the always excellent Eric Topol.)

    covid-19 long-covid pasc autoimmune diseases health medicine research eric-topol

Links for 2023-05-02

  • In a small study, an AI 'brain decoder' inches toward reading minds

    In a new Nature Neuroscience paper published Monday, Huth and a team of researchers from the University of Texas at Austin introduced a new "brain decoder" enabled by GPT-1, an earlier version of the artificial neural network technology that underpins ChatGPT. After digesting several hours of training data, the new tool was able to describe the gist of stories the three participants in the proof-of-concept experiment listened to — just by looking at their functional MRI scans.
    Very cool stuff. And I am happy to see the ethical considerations have been considered:
    "It is important to constantly evaluate what the implications are of new brain decoders for mental privacy," said Jerry Tang, a Ph.D. candidate in Huth's lab and lead author on the paper, in a press briefing. In devising ways to protect privacy, the authors asked participants to try to prevent the decoder from reconstructing the words they were hearing several different ways. Particularly effective methods included mentally listing off animals, and telling a different story at the same time the podcast was playing were particularly effective at stopping the decoder, said Tang. The authors also found that the decoder had to be trained on each subject's data and wasn't effective when used on another person. Between these findings and the fact that any movement would make the fMRI scans worse, the authors concluded that it's not currently possible for a brain decoder to be used on someone against their will.

    fmri scanning brain mri mindreading gpt podcasts

Links for 2023-04-28

  • Inside LAION

    "A High School Teacher's Free Image Database Powers AI Unicorns":

    To build LAION, founders scraped visual data from companies such as Pinterest, Shopify and Amazon Web Services — which did not comment on whether LAION's use of their content violates their terms of service — as well as YouTube thumbnails, images from portfolio platforms like DeviantArt and EyeEm, photos from government websites including the US Department of Defense, and content from news sites such as The Daily Mail and The Sun. If you ask Schuhmann, he says that anything freely available online is fair game. But there is currently no AI regulation in the European Union, and the forthcoming AI Act, whose language will be finalized early this summer, will not rule on whether copyrighted materials can be included in big data sets. Rather, lawmakers are discussing whether to include a provision requiring the companies behind AI generators to disclose what materials went into the data sets their products were trained on, thus giving the creators of those materials the option of taking action. [...] "It has become a tradition within the field to just assume you don't need consent or you don't need to inform people, or they don't even have to be aware of it. There is a sense of entitlement that whatever is on the web, you can just crawl it and put it in a data set," said Abeba Birhane, a Senior Fellow in Trustworthy AI at Mozilla Foundation.

    consent opt-in web ai ml laion training-data scraping

  • Ask HN: Most interesting tech you built for just yourself?

    Fantastic thread of hackers scratching their own itch (via SimonW)

    via:simonw hacking projects hn hacks open-source

  • informative Twitter thread on the LessWrong/rationalist/"AI risk"/effective altruism cult

    "some people understand immediately when i try to explain what it was like to be fully in the grip of the yudkowskian AI risk stuff and some people it doesn't seem to land at all, which is probably good for them and i wish i had been so lucky". Bananas...

    cults ai-risk yudkowski future rokos-basilisk lesswrong effective-altruism

Links for 2023-04-27

  • Introducing VirusTotal Code Insight: Empowering threat analysis with generative AI

    Impressively, when these models are trained on programming languages, they can adeptly transform code into natural language explanations. [...] Code Insight is a new feature based on Sec-PaLM, one of the generative AI models hosted on Google Cloud AI. What sets this functionality apart is its ability to generate natural language summaries from the point of view of an AI collaborator specialized in cybersecurity and malware. This provides security professionals and analysts with a powerful tool to figure out what the code is up to.  At present, this new functionality is deployed to analyze a subset of PowerShell files uploaded to VirusTotal. The system excludes files that are highly similar to those previously processed, as well as files that are excessively large. This approach allows for the efficient use of analysis resources, ensuring that only the most relevant files (such as PS1 files) are subjected to scrutiny. In the coming days, additional file formats will be added to the list of supported files, broadening the scope of this functionality even further.
    (via Julie on ITC Slack)

    virustotal analysis malware code reverse-engineering infosec security

  • How Philly Cheesesteaks Became a Big Deal in Lahore, Pakistan

    This is fascinating history:

    An establishment with a legacy such as [The Lahore Gymkhana Club, founded in 1878 under British rule] needed to continue revamping itself and serve exclusive dishes for its high-end clientele. And the club, along with restaurants aspiring to serve continental food, was bolstered by a growing taste for a new ingredient in town: processed cheese. "Sandwiches gradually started becoming popular in the 1980s because of the [wider] availability of cheese and mushrooms," says Chaudhry. Until the 1980s, processed cheese was largely imported, and its use was limited to the rich, who would frequent establishments such as the Gymkhana. As Lahori taste buds adapted to and appreciated cheese, production was initiated locally. Demand for cheeseburgers and sandwiches skyrocketed in the 1990s, with a growing number of Pakistanis who'd traveled to the U.S. aspiring to re-create offerings from various popular American chains. One of these is exceptionally familiar. Even today, online food groups in Pakistan are peppered with people asking the community where they can find a cheese­steak in Lahore "like the one at Pat's." Many of them post images of the cheese­steaks from the original shop at 9th and Passyunk.

    food cheesesteaks philadelphia history pakistan lahore sandwiches

Links for 2023-04-26

  • "Nothing like this will be built again"

    Charlie Stross visits the Advanced Gas-cooled Reactors at Torness nuclear power station:

    The AGRs at Torness [in the UK] are not ordinary civil [nuclear] power reactors. Designed in the 1970's, they were the UK's bid to build an export-earning civil nuclear power system. They're sensitive thoroughbreds, able to reach a peak conversion efficiency of 43% -- that is, able to turn up to 43% of their energy output into electricity. By comparison, a PWR peaks at 31-32%. However, the PWRs have won the race for commercial success: they're much, much, simpler. AGRs are like Concorde -- technological marvels, extremely sophisticated and efficient, and just too damned expensive and complex for their own good. (You want complexity? Torness was opened in 1989. For many years thereafter, its roughly fifty thousand kilometres of aluminium plumbing made it the most complex and demanding piece of pipework in Europe. You want size? The multi-thousand ton reactor core of an AGR is bigger than the entire plant at some PWR installations.) It's a weird experience, crawling over the guts of one of the marvels of the atomic age, smelling the thing (mostly machine oil and steam, and a hint of ozone near the transformers), all the while knowing that although it's one of the safest and most energy-efficient civilian power reactors ever built it's a a technological dead-end, that there won't be any more of them, and that when it shuts down in thirty or forty years' time this colossal collision between space age physics and victorian plumbing will be relegated to a footnote in the history books. "Energy too cheap to meter" it ain't, but as a symbol of what we can achieve through engineering it's hard to beat.

    engineering nuclear-power agr history uk torness power plumbing

  • The Toronto Recursive History Project

    "This plaque was commemorated on October 10, 2018, commemorate its own commemoration. Plaques like this one are an integral part of the campaign to support more plaques like this one. By reading this plaque, you have made a valuable addition to the number of people who have read this plaque. To this day and up to the end of this sentence, this plaque continues to be read by people like yourself. Heritage Toronto 2018"

    heritage toronto recursive plaque commemoration funny

  • Palantir Demos AI to Fight Wars But Says It Will Be Totally Ethical Don't Worry About It

    This is a really atrocious idea:

    Palantir also isn't selling a military-specific AI or large language model (LLM) here, it's offering to integrate existing systems into a controlled environment. The AIP demo shows the software supporting different open-source LLMs, including  FLAN-T5 XL, a fine-tuned version of GPT-NeoX-20B, and Dolly-v2-12b, as well as several custom plug-ins. Even fine-tuned AI systems off the shelf have plenty of known issues that could make asking them what to do in a warzone a nightmare. For example, they're prone to simply making things up, or "hallucinating." GPT-NeoX-20B in particular is an open-source alternative to GPT-3, a previous version of OpenAI's language model, created by a startup called EleutherAI. One of EleutherAI's open-source models -- fine-tuned by another startup called Chai -- recently convinced a Belgian man who spoke to it for six weeks to kill himself.  What Palantir is offering is the illusion of safety and control for the Pentagon as it begins to adopt AI. [...] What AIP does not do is walk through how it plans to deal with the various pernicious problems of LLMs and what the consequences might be in a military context. AIP does not appear to offer solutions to those problems beyond "frameworks" and "guardrails" it promises will make the use of military AI "ethical" and "legal."

    palantir grim-meathook-future war llm aip military ai ethics

Links for 2023-04-25

  • Silence Isn't Consent

    More on yesterday's img2dataset failure to support opt-in:

    It isn't "effective altruism" if you have to force people to comply with you.

    img2dataset ai scraping web consent opt-in

  • Google Launched Bard Despite Major Ethical Concerns From Its Employees

    "The staffers who are responsible for the safety and ethical implications of new products have been told not to get in the way or to try to kill any of the generative AI tools in development," employees told Bloomberg. The ethics team is now "disempowered and demoralized," according to former and current staffers. Before OpenAI launched ChatGPT in November 2022, Google's approach to AI was more cautious and less consumer-facing, often working in the background of tools like Search and Maps. But since ChatGPT's enormous popularity prompted a "code red" from executives, Google's threshold for safe product releases has been lowered in an effort to keep up with its AI competitors.

    google ai safety chatgpt bard corporate-responsibility

Links for 2023-04-24

  • Shitty behaviour around the img2dataset AI scraper

    The author of this popular AI training data scraping tool doesn't seem to understand consent and opt-in:

    Letting a small minority [ie web publishers] prevent the large majority [AI users] from sharing their images and from having the benefit of last gen AI tool would definitely be unethical yes. Consent is obviously not unethical. You can give your consent for anything if you wish. It seems you're trying to decide for million of other people without asking them for their consent.
    In other words, "scraping your content without opt-in is better than denying access to your content for millions of potential future AI users". An issue to implement robots.txt support has been languishing since 2021. Good arguments for blocking the img2dataset user agent in general...

    opt-in consent ai ml bad-behaviour scraping robots

  • Why is British media so transphobic?

    Aside from the weirdness of Mumsnet, I didn't know about the influence of the mid-2000s skeptics movement:

    While claiming to be the country's foremost critical thinkers, the group was riddled with anti-humanities bias and a fetish for a certain kind of "science" that it held to reveal a set of immutable principles upon which the world was built with almost no regard whatsoever for interpretative analysis based on social or historical factors. Part of this mode of thinking was an especially reductivist biologism: the idea that there are immutable realities to be found in our DNA, and if we just paid enough attention to Science and stopped trying to split hairs and discover meaning over in the superfluous disciplines of the humanities, then everything would be much simpler. It's precisely this kind of biological essentialism — which skirts dangerously close to eugenics — that leads people to think they can "debunk" a person's claim to their gender identity, or that it should be subjected to rigorous testing by someone in a lab coat before we can believe the subject is who they say they are.

    debunking scepticism skeptics history terfs uk uk-politics gender

Links for 2023-04-20

  • Long COVID Is Being Erased -- Again - The Atlantic

    Ed Yong is back writing again!

    Most Americans simply aren't thinking about COVID with the same acuity they once did; the White House long ago zeroed in on hospitalizations and deaths as the measures to worry most about. And what was once outright denial of long COVID's existence has morphed into something subtler: a creeping conviction, seeded by academics and journalists and now common on social media, that long COVID is less common and severe than it has been portrayed—a tragedy for a small group of very sick people, but not a cause for societal concern. This line of thinking points to the absence of disability claims, the inconsistency of biochemical signatures, and the relatively small proportion of severe cases as evidence that long COVID has been overblown. "There's a shift from 'Is it real?' to 'It is real, but …,'" Lekshmi Santhosh, the medical director of a long-COVID clinic at UC San Francisco, told me. Yet long COVID is a substantial and ongoing crisis—one that affects millions of people. However inconvenient that fact might be to the current "mission accomplished" rhetoric, the accumulated evidence, alongside the experience of long haulers, makes it clear that the coronavirus is still exacting a heavy societal toll.

    long-covid ed-yong covid-19 health medicine society healthcare

  • OpenAI's hunger for data is coming back to bite it

    Spot on:

    The company could have saved itself a giant headache by building in robust data record-keeping from the start, she says. Instead, it is common in the AI industry to build data sets for AI models by scraping the web indiscriminately and then outsourcing the work of removing duplicates or irrelevant data points, filtering unwanted things, and fixing typos. These methods, and the sheer size of the data set, mean tech companies tend to have a very limited understanding of what has gone into training their models. 

    training data provenance ai ml common-crawl openai chatgpt data-protection privacy

  • Holly Herndon on AI music

    she really gets it. Lots of interesting thoughts

    holly-herndon ai music ml future tech sampling spawning

Links for 2023-04-17

Links for 2023-04-14

  • "Why Banker Bob (still) Can't Get TLS Right: A Security Analysis of TLS in Leading UK Banking Apps"

    Jaysus this is a litany of failure.

    Abstract. This paper presents a security review of the mobile apps provided by the UK's leading banks; we focus on the connections the apps make, and the way in which TLS is used. We apply existing TLS testing methods to the apps which only find errors in legacy apps. We then go on to look at extensions of these methods and find five of the apps have serious vulnerabilities. In particular, we find an app that pins a TLS root CA certificate, but do not verify the hostname. In this case, the use of certificate pinning means that all existing test methods would miss detecting the hostname verification flaw. We also find one app that doesn't check the certificate hostname, but bypasses proxy settings, resulting in failed detection by pentesting tools. We find that three apps load adverts over insecure connections, which could be exploited for in-app phishing attacks. Some of the apps used the users' PIN as authentication, for which PCI guidelines require extra security, so these apps use an additional cryptographic protocol; we study the underlying protocol of one banking app in detail and show that it provides little additional protection, meaning that an active man-in-the-middle attacker can retrieve the user's credentials, login to the bank and perform every operation the legitimate user could.
    See also: https://www.synopsys.com/blogs/software-security/ineffective-certificate-pinning-implementations/

    ssl tls certificates certificate-pinning security infosec banking apps uk pci mobile

  • Using DuckDB to repartition parquet data in S3

    Wow, DuckDB is very impressive -- I had no idea it could handle SELECTs against Parquet data in S3:

    A common pattern to ingest streaming data and store it in S3 is to use Kinesis Data Firehose Delivery Streams, which can write the incoming stream data as batched parquet files to S3. You can use custom S3 prefixes with it when using Lambda processing functions, but by default, you can only partition the data by the timestamp (the timestamp the event reached the Kinesis Data Stream, not the event timestamp!). So, a few common use cases for data repartitioning could include: Repartitioning the written data for the real event timestamp if it's included in the incoming data; Repartitioning the data for other query patterns, e.g. to support query filter pushdown and optimize query speeds and costs; Aggregation of raw or preprocessed data, and storing them in an optimized manner to support analytical queries.

    duckdb repartitioning s3 parquet orc hive kinesis firehose

  • Timnit Gebru's anti-'AI pause'

    Couldn't agree more with Timnit Gebru's comments here:

    What is your appeal to policymakers? What would you want Congress and regulators to do now to address the concerns you outline in the open letter? Congress needs to focus on regulating corporations and their practices, rather than playing into their hype of "powerful digital minds." This, by design, ascribes agency to the products rather than the organizations building them. This language obfuscates the amount of data that is being collected — and the amount of worker exploitation involved with those who are labeling and supplying the datasets, and moderating model outputs. Congress needs to ensure corporations are not using people's data without their consent, and hold them responsible for the synthetic media they produce — whether it is text or media spewing disinformation, hate speech or other types of harmful content. Regulations need to put the onus on corporations, rather than understaffed agencies. There are probably existing regulations these organizations are breaking. There are mundane "AI" systems being used daily; we just heard about another Black man being wrongfully arrested because of the use of automated facial analysis systems. But that's not what we're talking about, because of the hype.

    data privacy ai ml openai monopoly

Links for 2023-04-13

  • caesarHQ/textSQL

    This is amazing -- using GPT-3.5 to convert a natural-language query into SQL applied to a specific dataset, in these examples, San Francisco city data and US public census data:

    With CensusGPT, you can ask any question related to census data in natural language. These natural language questions get converted to SQL using GPT-3.5 and are then used to query the census database. Here are some examples: - Five cities with a population over 100,000 and lowest crime - 10 highest income areas in california Here is a similar example from sfGPT: - Which four neighborhoods had the most crime in San Francisco in 2021?

    sfgpt censusgpt textsql natural-language gpt-3.5 sql querying search open-source

Links for 2023-04-12

  • Exploring performance differences between Amazon Aurora and vanilla MySQL | Plaid

    This is a major difference between vanilla MySQL and Amazon Aurora (and a potentially major risk!):

    because Aurora MySQL primary and replica instances share a storage layer, they share a set of undo logs. This means that, for a REPEATABLE READ isolation level, the storage instance must maintain undo logs at least as far back as could be required to satisfy transactional guarantees for the primary or any read replica instance. Long-running replica transactions can negatively impact writer performance in Aurora MySQL—finally, an explanation for the incident that spawned this investigation. The same scenario plays out differently in vanilla MySQL because of its different model for undo logs. Vanilla MYSQL: there are two undo logs – one on the writer, and one on the reader. The performance impact of an operation that prevents the garbage collection of undo log records will be isolated to either the writer or the reader. Aurora MySQL: there is a single undo log that is shared between the writer and reader. The performance impact of an operation that prevents the garbage collection of undo log records will affect the entire cluster.

    aurora aws mysql performance databases isolation-levels

Links for 2023-04-11

  • EV Database

    Comparison site for electric cars; actually has a realistic model of genuine range for each EV. Full details on charging connectors, charge curves (for charging speed), etc.

    ev driving cars vehicles

  • The Black Magic of (Java) Method Dispatch

    Some fascinating details of low-level Java performance optimization, particularly with JIT applied to OO method dispatch:

    Programming languages like Java provide the facilities for subtyping/polymorphism as one of the ways to construct modular and reusable software. This language choice naturally comes at a price, since there is no hardware support for virtual calls, and therefore runtimes have to emulate this behavior. In many, many cases the performance of method dispatch is not important. Actually, in a vast majority of cases, the low-level performance concerns are not the real concerns. However, there are cases when method dispatch performance is important, and there you need to understand how dispatch works, what runtimes optimize for you, and what you can do to cheat and/or emulate similar behavior in your code. For example, in the course of String Compression work, we were faced with the problem of selecting the coder for a given String. The obvious and highly maintainable approach of creating a Coder interface, a few implementations, and dispatching the virtual calls over it, had met some performance problems on the very tiny benchmarks. Therefore, we needed to contemplate something better. After a few experiments, this post was born as a reference for others who might try to do the same. This post also tangentially touches the inlining of virtual calls, as the natural thing during the optimization.
    Discovered via this amazing commit: https://github.com/quarkusio/quarkus/commit/65dd4d43e2644db1c87726139280f9704140167c

    optimization performance java oo jit coding polymorphism

Links for 2023-04-07

  • MariaDB.com is dead, long live MariaDB.org

    Oof. Looks like the commercial company behind MariaDB is going south quickly:

    Monty, the creator of MySQL and MariaDB founder, hasn't been at a company meeting for over a year and a half. The relationship between Monty and the CEO, Michael Howard, is extremely rocky. At a company all-hands meeting Monty and Michael Howard were shouting at each other while up on stage in the auditorium in front of the entire staff. Monty made his position perfectly clear as he shouted his last words before he walked out: "You're killing my fu&#@$! company!!!" Monty was subsequently voted off the board in July of 2022 solidifying the hostile takeover by Michael Howard. Buyer beware, Monty and his group of founders and database experts are no longer at the company.
    At least the open-source product is still trustworthy, though.

    databases storage mariadb software open-source companies

Links for 2023-04-06

  • Google "raters" say they don't have enough time to verify correct answers from Bard

    Contractors say they have a set amount of time to complete each task, like review a prompt, and the time they're allotted for tasks can vary wildly — from as little as 60 seconds to more than several minutes. Still, raters said it's difficult to rate a response when they are not well-versed in a topic the chatbot is talking about, including technical topics like blockchain for example.  Because each assigned task represents billable time, some workers say they will complete the tasks even if they realize they cannot accurately assess the chatbot responses.  "Some people are going to say that's still 60 seconds of work, and I can't recoup this time having sat here and figured out I don't know enough about this, so I'm just going to give it my best guess so I can keep that pay and keep working," one rater said.

    google raters contractors fact-checking verification llms bard facts

Links for 2023-04-03

Links for 2023-04-01

Links for 2023-03-31

  • A misleading open letter about sci-fi AI dangers ignores the real risks

    This essay is spot on about the recent AI open letter from the Future of Life Institute, asking for "a 6-month pause on training language models "more powerful than" GPT-4":

    Over 1,000 researchers, technologists, and public figures have already signed the letter. The letter raises alarm about many AI risks: "Should we let machines flood our information channels with propaganda and untruth? Should we automate away all the jobs, including the fulfilling ones? Should we develop nonhuman minds that might eventually outnumber, outsmart, obsolete and replace us? Should we risk loss of control of our civilization?" We agree that misinformation, impact on labor, and safety are three of the main risks of AI. Unfortunately, in each case, the letter presents a speculative, futuristic risk, ignoring the version of the problem that is already harming people. It distracts from the real issues and makes it harder to address them. The letter has a containment mindset analogous to nuclear risk, but that's a poor fit for AI. It plays right into the hands of the companies it seeks to regulate.
    Couldn't agree more.

    ai scifi future risks gpt-4 regulation

Links for 2023-03-30

  • AI and the American Smile. How AI misrepresents culture through a facial expression

    There are 18 images in the Reddit slideshow [a series of Midjourney-generated images of "selfies through history"] and they all feature the same recurring composition and facial expression. For some, this sequence of smiling faces elicits a sense of warmth and joyousness, comprising a visual narrative of some sort of shared humanity [...] But what immediately jumped out at me is that these AI-generated images were beaming a secret message hidden in plain sight. A steganographic deception within the pixels, perfectly legible to your brain yet without the conscious awareness that it's being conned. Like other AI "hallucinations," these algorithmic extrusions were telling a made up story with a straight face — or, as the story turns out, with a lying smile. [...] How we smile, when we smile, why we smile, and what it means is deeply culturally contextual.

    ai america culture photography midjourney smiling smiles context history

  • Heat pump myths

    "Social media and newspapers are flooded with myths about heat pumps. Let's take them one by one in this post."

    myths mythbusting heat-pumps heating house home

  • Belgian man dies by suicide following exchanges with chatbot

    Grim. This is the downside of LLM-based chatbots with ineffective guardrails against toxic output.

    "Without these conversations with the chatbot, my husband would still be here," the man's widow has said, according to La Libre. She and her late husband were both in their thirties, lived a comfortable life and had two young children. However, about two years ago, the first signs of trouble started to appear. The man became very eco-anxious and found refuge with ELIZA, the name given to a chatbot that uses GPT-J, an open-source artificial intelligence language model developed by EleutherAI. After six weeks of intensive exchanges, he took his own life.
    There's a transcript of the last conversation with the bot here: https://news.ycombinator.com/item?id=35344418 .

    bots chatbots ai gpt gpt-j grim future grim-meathook-future

Links for 2023-03-28

Links for 2023-03-27

  • What Will Transformers Transform? – Rodney Brooks

    This is a great essay on GPT and LLMs:

    Roy Amara, who died on the last day of 2007, was the president of a Palo Alto based think tank, the Institute for the future, and is credited with saying what is now known as Amara's Law: "We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run." This has been a common problem with Artificial Intelligence, and indeed of all of computing. In particular, since I first became conscious of the possibility of Artificial Intelligence around 1963 (and as an eight year old proceeded to try to build my own physical and intelligent computers, and have been at it ever since), I have seen these overestimates many many times.
    and:
    I think that GPTs will give rise to a new aphorism (where the last word might vary over an array of synonymous variations): "If you are interacting with the output of a GPT system and didn't explicitly decide to use a GPT then you're the product being hoodwinked." I am not saying everything about GPTs is bad. I am saying that, especially given the explicit warnings from OpenAI, that you need to be aware that you are using an unreliable system. Using an unreliable system sounds awfully unreliable, but in August 2021 I had a revelation at TED in Monterey, California, when Chris Anderson (the TED Chris), was interviewing Greg Brockman, the Chairman of Open AI about an early version of GPT. He said that he regularly asked it questions about code he wanted to write and it very quickly gave him ideas for libraries to use, and that was enough to get him started on his project. GPT did not need to be fully accurate, just to get him into the right ballpark, much faster than without its help, and then he could take it from there. Chris Anderson (the 3D robotics one, not the TED one) has likewise opined (as have responders to some of my tweets about GPT) that using ChatGPT will get him the basic outline of a software stack, in a well tread area of capabilities, and he is many many times more productive than with out it. So there, where a smart person is in the loop, unreliable advice is better than no advice, and the advice comes much more explicitly than from carrying out a conventional search with a search engine. The opposite of useful can also occur, but again it pays to have a smart human in the loop. Here is a report from the editor of a science fiction magazine which pays contributors. He says that from late 2022 through February of 2023 the number of submissions to the magazine increased by almost two orders of magnitude, and he was able to determine that the vast majority of them were generated by chatbots. He was the person in the loop filtering out the signal he wanted, human written science fiction, from vast volumes of noise of GPT written science fiction. Why should he care? Because GPT is an auto-completer and so it is generating variations on well worked themes. But, but, but, I hear people screaming at me. With more work GPTs will be able to generate original stuff. Yes, but it will be some other sort of engine attached to them which produces that originality. No matter how big, and how many parameters, GPTs are not going to to do that themselves. When no person is in the loop to filter, tweak, or manage the flow of information GPTs will be completely bad. That will be good for people who want to manipulate others without having revealed that the vast amount of persuasive evidence they are seeing has all been made up by a GPT. It will be bad for the people being manipulated. And it will be bad if you try to connect a robot to GPT. GPTs have no understanding of the words they use, no way to connect those words, those symbols, to the real world. A robot needs to be connected to the real world and its commands need to be coherent with the real world. Classically it is known as the "symbol grounding problem". GPT+robot is only ungrounded symbols. It would be like you hearing Klingon spoken, without any knowledge other than the Klingon sound stream (even in Star Trek you knew they had human form and it was easy to ground aspects of their world). A GPT telling a robot stuff will be just like the robot hearing Klingonese. My argument here is that GPTs might be useful, and well enough boxed, when there is an active person in the loop, but dangerous when the person in the loop doesn't know they are supposed to be in the loop. [This will be the case for all young children.] Their intelligence, applied with strong intellect, is a key component of making any GPT be successful.

    gpts rodney-brooks ai ml amaras-law hype technology llms future

  • Employees Are Feeding Sensitive Business Data to ChatGPT

    How unsurprising is this? And needless to say, a bunch of that is being reused for training:

    In a recent report, data security service Cyberhaven detected and blocked requests to input data into ChatGPT from 4.2% of the 1.6 million workers at its client companies because of the risk of leaking confidential information, client data, source code, or regulated information to the LLM.  In one case, an executive cut and pasted the firm's 2023 strategy document into ChatGPT and asked it to create a PowerPoint deck. In another case, a doctor input his patient's name and their medical condition and asked ChatGPT to craft a letter to the patient's insurance company.

    chatgpt openai ip privacy data-protection security

  • GitHub Copilot is open to remote prompt-injection attacks

    GitHub Copilot is also based on a large language model. What does indirect prompt injection do to it? Again, we demonstrate that, as long as an attacker controls part of the context window, the answer is: pretty much anything. Attackers only have to manipulate the documentation of a target package or function. As you reference and use them, this documentation is loaded into the context window based on complex and ever-changing heuristics. We show [...] how importing a synthetic library can lead Copilot to introduce subtle or not-so-subtle vulnerabilities into the code generated for you.

    injection copilot security exploits github llms chatgpt

Links for 2023-03-24

  • Google and Microsoft's chatbots are already citing one another in a misinformation shitshow

    What we have here is an early sign we're stumbling into a massive game of AI misinformation telephone, in which chatbots are unable to gauge reliable news sources, misread stories about themselves, and misreport on their own capabilities. In this case, the whole thing started because of a single joke comment on Hacker News. Imagine what you could do if you wanted these systems to fail. It's a laughable situation but one with potentially serious consequences. Given the inability of AI language models to reliably sort fact from fiction, their launch online threatens to unleash a rotten trail of misinformation and mistrust across the web, a miasma that is impossible to map completely or debunk authoritatively. All because Microsoft, Google, and OpenAI have decided that market share is more important than safety.

    google ai ml microsoft openai chatgpt trust spam misinformation disinformation

Links for 2023-03-23

Links for 2023-03-22

  • new LFP batteries will unlock cheaper electric vehicles

    Lithium ferrous phosphate (LFP) batteries, the type to be produced at the new [Ford] plant are a lower-cost alternative to the nickel- and cobalt-containing batteries used in most electric vehicles in the US and Europe today. While the technology has grown in popularity in China, Ford's factory, developed in partnership with the Chinese battery giant CATL, marks a milestone in the West. By cutting costs while also boosting charging speed and extending lifetime, LFP batteries could help expand EV options for drivers. 

    lfp technology ev cars batteries renewable-energy

  • You Broke Reddit: The Pi-Day Outage : RedditEng

    Quality post-mortem writeup of last week's Reddit outage. tl;dr: an in-place Kubernetes upgrade broke it. We use blue/green deployments -- with two separate parallel k8s clusters -- in order to avoid this risk, as k8s upgrades are very very risky in our experience; tiny "minor" changes often seem to cause breakage.

    k8s kubernetes outages reddit ops post-mortems

  • Superb thread on effective AI regulation

    from Baldur Bjarnason:

    First, you clarify that for the purposes of Section 230 protection (or similar), whoever provides the AI as a service is responsible for its output as a publisher. If Bing Chat says something offensive then Microsoft would be as liable as if it were an employee; You'd set a law requiring tools that integrate generative AI to attach disclosures to the content. Gmail/Outlook should pop up a notice when you get an email that their AI generated. Word/Docs should have metadata fields and notices when you open files that have used built-in AI capabilities. AI chatbots have to disclose that they are bots. Copilot should add a machine-parsable code comment. You could always remove the metadata, but doing so would establish an intent to deceive; Finally, you'd mandate that all training data sets be made opt-in (or that all of its contents are released under a permissive license) and public. Heavy fines for non-disclosure. Heavy fines for violating opt-in. Even heavier fines for lying about your training data set. Make every AI model a "vegan" model. Remove every ethical and social concern about the provenance and rights regarding the training data.
    I think #3 in particular is the most important of all.

    ai regulation data-privacy training llm ethics

  • Bing Chat is still vulnerable to hidden prompt injection attacks

    happily parses hidden text in webpages, acting on information there that isn't visible to human viewers. Related: https://twitter.com/matteosonoioo/status/1630941926454185992/photo/1 , where Matteo Contrini demonstrated an attack to turn it into a scammer with prompt injection.

    bing-chat bing chatgpt openai prompt-injection exploits attacks hidden-text

Links for 2023-03-20

  • Pop Culture Pulsar: Origin Story of Joy Division's Unknown Pleasures Album Cover

    Great dig into the CP1919 pulsar signal plot that was used for "Unknown Pleasures":

    This plotting of sequences like this, it started just a little bit earlier when we were looking at potentially drifting subpulses within the major pulse itself. So, the thought was, well, is there something like this peak here, which on the next pulse moves over here, and then moves over here, and over there. Actually, would be moving this way in that case – either way. I think Frank Drake and I published a paper in Science Magazine on exactly that issue – suggesting there might be drifting subpulses within the major pulse, which would then get back to the physics of what was causing the emission in the first place. So, then the thought was, well let's plot out a whole array of pulses, and see if we can see particular patterns in there. So that's why, this one was the first I did – CP1919 – and you can pick out patterns in there if you really work at it. But I think the answer is, there weren't any that were real obvious anyway. I don't really recall, but my bet is that the first one of these that I did, I didn't bother to block out the stuff, and I found that it was just too confusing. So then, I wrote the program so that I would block out when a hill here was high enough, then the stuff behind it would stay hidden. And it was pretty easy to do from a computer perspective.

    design joy-division music science physics pulsars astronomy cp1919 dataviz

  • moyix/gpt-wpre: Whole-Program Reverse Engineering with GPT-3

    This is a little toy prototype of a tool that attempts to summarize a whole binary using GPT-3 (specifically the text-davinci-003 model), based on decompiled code provided by Ghidra. However, today's language models can only fit a small amount of text into their context window at once (4096 tokens for text-davinci-003, a couple hundred lines of code at most) -- most programs (and even some functions) are too big to fit all at once. GPT-WPRE attempts to work around this by recursively creating natural language summaries of a function's dependencies and then providing those as context for the function itself. It's pretty neat when it works! I have tested it on exactly one program, so YMMV.

    gpt-3 reverse-engineering ghidra decompilation reversing llm

Links for 2023-03-16

Links for 2023-03-15

  • Cat6a FTP Tool-Less Keystone Module

    For future use -- CAT6A cable endpoints which don't require tricky crimping: "no crimp tool required at all, very much worth the extra cost, and they clip into the wall sockets or a patch panel ... you can do them with your fingers and a flush snips to get rid of the ends after you push the wires in" says Adam C on ITC Slack, at https://irishtechcommunity.slack.com/archives/C11BG27L2/p1678841261913069

    cat6a wiring home networking cables via:itc

Links for 2023-03-14

  • Infra-Red, In Situ (IRIS) Inspection of Silicon

    Cool:

    This post introduces a technique I call "Infra-Red, In Situ" (IRIS) inspection. It is founded on two insights: first, that silicon is transparent to infra-red light; second, that a digital camera can be modified to "see" in infra-red, thus effectively "seeing through" silicon chips. We can use these insights to inspect an increasingly popular family of chip packages known as Wafer Level Chip Scale Packages (WLCSPs) by shining infrared light through the back side of the package and detecting reflections from the lowest layers of metal using a digital camera. This technique works even after the chip has been assembled into a finished product. However, the resolution of the imaging method is limited to micron-scale features.

    electronics hardware reversing bunnie-huang infrared x-ray-vision silicon

Links for 2023-03-09

  • Seabirds are not at risk from offshore wind turbines

    At least according to this survey by Swedish power giant Vattenfall:

    The movements of herring gulls, gannets, kittiwakes, and great black-backed gulls were studied in detail from April to October, when bird activity is at its height. (This study only looked at four bird species, but Vattenfall says the model can and should be applied to more types of seabirds and to onshore wind farms as well.) The study's findings: Not a single collision between a bird and a rotor blade was recorded.

    seabirds birds safety wind-turbines offshore-wind renewables wildlife

  • Metformin, a new drug to prevent long covid

    'Over a thousand people with mild-to-moderate Covid were randomly assigned to 2 weeks of metformin (500 mg pills, 1 on day 1, twice a day for 4 days, then 500 mg in AM and 1000 mg in PM for 9 days) or placebo. There was a 42% reduction of subsequent Long Covid as you can see by the event curve below, which corresponds to an absolute decrease of 4.3%, from 10.6% reduced to 6.3%.' Still no use for _treating_ long COVID though.

    covid-19 long-covid metformin drugs papers

Links for 2023-03-03

Links for 2023-03-02

  • ChatGPT for r/BuyItForLife

    This is actually really effective; the past 3 years of product recommendations from r/BuyItForLife, queryable using ChatGPT (via valen)

    via:valen ai recommendations search products reviews

  • Hundreds of residents vent anger over 'entirely pointless' hydrogen heating trial

    Greenwashing grey hydrogen as a "renewable" means of keeping home gas heating alive is not going well in Whitby:

    Influential energy analyst Michael Liebreich and University of Cambridge mechanical engineering professor David Cebon drew attention to the now-37 independent studies showing that hydrogen boilers would require about five times more renewable energy than heat pumps — likely making them significantly more expensive to run. "This trial is entirely pointless in terms of proving whether hydrogen is the most cost-effective way of decarbonising homes," Liebreich told the audience. "Every single systems analysis from every single expert who is not paid for by the gas industry or the heating industry has concluded that hydrogen plays little or no role. "The thing that it's intended to do, though, is maintain the debate and discussion and the delay [of decarbonisation]. If you're running a gas network organisation, as our next speaker [Cadent head of strategy, Angela Needle] does, what you really want is to continue to harvest profits off that. If you invest today in a gas distribution network, you get to charge 6% per year for 45 years on that investment and that's until 2068."

    hydrogen h2 grey-hydrogen greenwashing gas natural-gas heating homes decarbonisation

Links for 2023-03-01

  • Nokia G22

    This is a decent product -- "Nokia has announced one of the first budget Android smartphones designed to be repaired at home allowing users to swap out the battery in under five minutes, in partnership with iFixit." I've been planning to buy a more repairable phone for my next iteration, so it's either this or a Fairphone.

    android hardware nokia phones right-to-repair repair ifixit

  • copyright-respecting AI model training

    Alex J Champandard is thinking about how AI model training can be done in a copyright-respecting and legal fashion:

    With the criticism of web-scale datasets, it's legitimate to ask the question: "What models are trained with best-in-class Copyright practices?" Answer: StyleGAN and FFHQ github.com/NVlabs/ffhq-dataset 100% transparent dataset, clear copyright, opt-in licensing, model respects terms.

    copyright legal rights ip ai ml models training stylegan ffhq flickr

  • The tech tycoon martyrdom charade

    Anil Dash:

    It's impossible to overstate the degree to which many big tech CEOs and venture capitalists are being radicalized by living within their own cultural and social bubble. Their level of paranoia and contrived self-victimization is off the charts, and is getting worse now that they increasingly only consume media that they have funded, created by their own acolytes. In a way, it's sort of like a "VC Qanon", and it colors almost everything that some of the most powerful people in the tech industry see and do — and not just in their companies or work, but in culture, politics and society overall. We're already seeing more and more irrational, extremist decision-making that can only be understood through this lens, because on its own their choices seem increasingly unfathomable.

    vc tech anil-dash radicalization politics us-politics

Links for 2023-02-20

  • Better Thermostat

    Interesting smart home component for Home Assistant --

    This custom component will add crucial features to your climate-controlling TRV (Thermostatic Radiator Valves) to save you the work of creating automations to make it smart. It combines a room-temperature sensor, window/door sensors, weather forecasts, or an ambient temperature probe to decide when it should call for heat and automatically calibrate your TRVs to fix the imprecise measurements taken in the radiator's vicinity.
    So basically if you have smart TRVs and a room temperature sensor, you can drive that as a pair.

    thermostat smart-home home-assistant heating trvs

Links for 2023-02-16

Links for 2023-02-14

  • a COVID-aware activity tracker

    Interesting thought experiment regarding chronic disease, long COVID, ME/CFS etc: 'what might be in a convalescence mode, or a rest mode? And while I'm thinking of that, there's a separate need, I think (hey! validate through research!) for, I don't know, a chronic illness mode, because convalescence and rest are different things with different qualities distinct from the requirements and needs of people with long-term chronic illnesses. Some people who responded to my thinking-out-loud thread shared that you can use sleep tracking as a way to inform the spoons-for-the-day.'

    apple fitness accessibility convalescence chronic-disease activity-tracking long-covid me

Links for 2023-02-13

  • A New Drug Switched Off My Appetite. What's Left? | WIRED

    How long is it before there's an injection for your appetites, your vices? Maybe they're not as visible as mine. Would you self-administer a weekly anti-avarice shot? Can Big Pharma cure your sloth, lust, wrath, envy, pride? Is this how humanity fixes climate change—by injecting harmony, instead of hoping for it at Davos?

    mounjaro food eating weight calories future

  • Silicon Valley tech companies are the real paperclip maximizers

    Another good Ted Chiang article --

    Elon Musk spoke to the National Governors Association and told them that "AI is a fundamental risk to the existence of human civilization." [...] This scenario sounds absurd to most people, yet there are a surprising number of technologists who think it illustrates a real danger. Why? Perhaps it's because they're already accustomed to entities that operate this way: Silicon Valley tech companies. Consider: Who pursues their goals with monomaniacal focus, oblivious to the possibility of negative consequences? Who adopts a scorched-earth approach to increasing market share? This hypothetical strawberry-picking AI does what every tech startup wishes it could do — grows at an exponential rate and destroys its competitors until it's achieved an absolute monopoly. The idea of superintelligence is such a poorly defined notion that one could envision it taking almost any form with equal justification: a benevolent genie that solves all the world's problems, or a mathematician that spends all its time proving theorems so abstract that humans can't even understand them. But when Silicon Valley tries to imagine superintelligence, what it comes up with is no-holds-barred capitalism.

    superintelligence ted-chiang silicon-valley capitalism ai future civilization paperclip-maximisers

Links for 2023-02-08

Links for 2023-02-02

Links for 2023-01-31

  • Study of 500,000 Medical Records Links Viruses to Alzheimer's Again And Again

    While not demonstrating a causal link, the correlations are pretty striking -- good argument for greatly increasing vaccination rates for many viral diseases.

    Around 80 percent of the viruses implicated in brain diseases were considered 'neurotrophic', which means they could cross the blood-brain barrier. "Strikingly, vaccines are currently available for some of these viruses, including influenza, shingles (varicella-zoster), and pneumonia," the researchers write. "Although vaccines do not prevent all cases of illness, they are known to dramatically reduce hospitalization rates. This evidence suggests that vaccination may mitigate some risk of developing neurodegenerative disease." The impact of viral infections on the brain persisted for up to 15 years in some cases. And there were no instances where exposure to viruses was protective.

    viruses health medicine vaccines vaccination alzheimers parkinsons diseases

Links for 2023-01-30

Links for 2023-01-24

  • CNET's AI Journalist Appears to Have Committed Extensive Plagiarism

    CNET used an AI to generate automated content for their site, and are definitely in the "finding out" stage from the looks of things:

    All told, a pattern quickly emerges. Essentially, CNET's AI seems to approach a topic by examining similar articles that have already been published and ripping sentences out of them. As it goes, it makes adjustments — sometimes minor, sometimes major — to the original sentence's syntax, word choice, and structure. Sometimes it mashes two sentences together, or breaks one apart, or assembles chunks into new Frankensentences. Then it seems to repeat the process until it's cooked up an entire article. [...] The question of exactly how CNET's disastrous AI was trained may end up taking center stage as the drama continues to unfold. At a CNET company meeting late last week [...] the outlet's executive vice president of content and audience refused to tell staff — many of them acclaimed tech journalists who have written extensively about the rise of machine learning — what data had been used to train the AI. The legality of using data to train an AI without the consent of the people who created that data is currently being tested by several lawsuits against the makers of prominent image generators, and could become a flashpoint in the commercialization of the tech.

    ai cnet content seo spam llms plagiarism training-data

  • omni-epd

    A Python module to abstract usage of several different types of EPD (electronic paper displays), including Inky and Waveshare hardware.

    epd inky waveshare e-paper displays hardware python linux

  • pycasso

    "a picture frame to show you random AI art every day" -- nice little epd/pi hack

    diy photos projects hacks epd e-paper ai art dall-e

  • EC2 instance network error metrics

    looks like Amazon are now exposing a bunch of error metrics for their EC2 instance network drivers in Linux

    metrics ec2 ops drivers networking bandwidth errors

Links for 2023-01-23

  • The bivalent vaccine booster outperforms

    Solid data now up for the bivalent BA.5 SARS-CoV-2 vaccine, says Eric Topol: "we now have extensive data that is quite encouraging -- better and broader than expected -- that I'm going to briefly review here"

    sars-cov-2 covid-19 vaccines eric-topol medicine health

  • Long COVID: major findings, mechanisms and recommendations

    Current state of research into Long COVID, courtesy of Nature Reviews Microbiology.

    Long COVID is an often debilitating illness that occurs in at least 10% of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infections. More than 200 symptoms have been identified with impacts on multiple organ systems. At least 65 million individuals worldwide are estimated to have long COVID, with cases increasing daily. Biomedical research has made substantial progress in identifying various pathophysiological changes and risk factors and in characterizing the illness; further, similarities with other viral-onset illnesses such as myalgic encephalomyelitis/chronic fatigue syndrome and postural orthostatic tachycardia syndrome have laid the groundwork for research in the field. In this Review, we explore the current literature and highlight key findings, the overlap with other conditions, the variable onset of symptoms, long COVID in children and the impact of vaccinations. Although these key findings are critical to understanding long COVID, current diagnostic and treatment options are insufficient, and clinical trials must be prioritized that address leading hypotheses.

    long-covid covid-19 health medicine reviews nature papers

Links for 2023-01-11

  • This app will self-destruct: How Belarusian hackers created an alternative Telegram

    Great idea:

    When a 25-year-old activist from Minsk who goes by Pavlo was detained by Belarusian KGB security forces last summer, he knew they would search his phone, looking for evidence of his involvement in anti-government protests. The police officer asked for Pavlo's password to Telegram, the most popular messenger app among Belarusian activists, which he gave him. The officer entered it and... found nothing. All secret chats and news channels had disappeared, and after a few minutes of questioning Pavlo was released. Pavlo's secret? A secure version of Telegram, developed by a hacktivist group from Belarus called the Cyber Partisans. Partisan Telegram, or P-Telegram, automatically deletes pre-selected chats when someone enters the so-called SOS password.
    ... after entering a fake [SOS] password, P-Telegram can automatically log out of the account, delete selected chats and channels, and even send a notification about the arrest of the account owners to their friends or families. P-Telegram also allows other activists to remotely activate the SOS password on the detainee's phone. For this, they need to send a code word to any of the shared Telegram chats. Another feature on P-Telegram automatically takes photos of law enforcement officers on the front camera when they enter a fake password. "We warn users that this can be dangerous, as this photo will be stored on the phone, revealing that a person may use Partisan Telegram," Shemetovets said.  Cyber Partisans are constantly updating their app, fixing bugs, and adding new features. They also regularly conduct independent audits to ensure that P-Telegram complies with all security measures. A recent audit by Open Technology Fund's Red Team Lab proved that it is almost impossible for "casual observers without technical knowledge and specialized equipment" to identify the existence of P-Telegram on a device.

    p-telegram hacktivism security telegram messaging privacy activism duress-passwords

Links for 2023-01-09

  • A healthcare algorithm started cutting care, and no one knew why

    This is an absurd hellscape:

    Legal Aid filed a federal lawsuit in 2016, arguing that the state had instituted a new [healthcare] policy without properly notifying the people affected about the change. There was also no way to effectively challenge the system, as they couldn't understand what information factored into the changes, De Liban argued. No one seemed able to answer basic questions about the process. "The nurses said, 'It's not me; it's the computer,'" De Liban says. When they dug into the system, they discovered more about how it works. Out of the lengthy list of items that assessors asked about, only about 60 factored into the home care algorithm. The algorithm scores the answers to those questions, and then sorts people into categories through a flowchart-like system. It turned out that a small number of variables could matter enormously: for some people, a difference between a score of a three instead of a four on any of a handful of items meant a cut of dozens of care hours a month. (Fries didn't say this was wrong, but said, when dealing with these systems, "there are always people at the margin who are going to be problematic.") [...] From the state's perspective, the most embarrassing moment in the dispute happened during questioning in court. Fries was called in to answer questions about the algorithm and patiently explained to De Liban how the system works. After some back-and-forth, De Liban offered a suggestion: "Would you be able to take somebody's assessment report and then sort them into a category?" [...] Fries said he could, although it would take a little time. He looked over the numbers for Ethel Jacobs. After a break, a lawyer for the state came back and sheepishly admitted to the court: there was a mistake. Somehow, the wrong calculation was being used. They said they would restore Jacobs' hours. "Of course we're gratified that DHS has reported the error and certainly happy that it's been found, but that almost proves the point of the case," De Liban said in court. "There's this immensely complex system around which no standards have been published, so that no one in their agency caught it until we initiated federal litigation and spent hundreds of hours and thousands of dollars to get here today. That's the problem."

    algorithms government health healthcare automation grim-meathook-future future

Links for 2023-01-04

  • Turning Google smart speakers into wiretaps for $100k

    This is some very impressive work on reverse engineering a fairly advanced IoT device (the Google Home Mini), discovering and exploiting its security holes.

    I was recently rewarded a total of $107,500 by Google for responsibly disclosing security issues in the Google Home smart speaker that allowed an attacker within wireless proximity to install a "backdoor" account on the device, enabling them to send commands to it remotely over the Internet, access its microphone feed, and make arbitrary HTTP requests within the victim's LAN (which could potentially expose the Wi-Fi password or provide the attacker direct access to the victim's other devices). These issues have since been fixed.

    security google wiretapping exploits hacking iot reverse-engineering

  • Infectiousness of SARS-CoV-2 breakthrough infections and reinfections during the Omicron wave | Nature Medicine

    This was an open question from earlier in the pandemic -- does vaccination reduce transmission and infectiousness: 'In our main analysis, we found that any COVID-19 vaccine reduced infectiousness by 22% (6–36%) and prior infection reduced infectiousness by 23% (3–39%). Hybrid immunity reduced infectiousness by 40% (20–55%).'

    immunity covid-19 infection transmission hybrid-immunity papers

  • Caddy

    lhl likes Caddy:

    Caddy https://caddyserver.com/ came up in conversation earlier today. It's been my favorite reverse proxy/web server for the past few years because of how simple it is to setup and for it's automagic LetsEncrypt setup. (This post is actually being pushed through Caddy on my fediverse server, and was basically the easiest part of the setup). For those interested, it performs pretty competitively with nginx: https://blog.tjll.net/reverse-proxy-hot-dog-eating-contest-caddy-vs-nginx/ but IMO the main selling point (why I first installed it) was the automagic HTTPS setup: https://caddyserver.com/docs/automatic-https

    caddy reverse-proxies ops http https lets-encrypt servers