We are developing the social individualist meta-context for the future. From the very serious to the extremely frivolous... lets see what is on the mind of the Samizdata people.

Samizdata, derived from Samizdat /n. - a system of clandestine publication of banned literature in the USSR [Russ.,= self-publishing house]

The danger that AI creates more “echo chambers”

As debate continues on the real or alleged benefits/threats of AI, one slogan we often hear used is the term “garbage in/garbage out”. For me, intelligence has to be able to “self-start” – to know how to ask an insightful question, to even consider if a question is worth asking in the first place. I don’t see much sign of that yet.

Can AI be more than just repeat existing information in new combinations, rather than actually evaluate rational from irrational ideas, grasp the need to reconsider certain premises, understand fallacies, etc? Can it think about how it “thinks”? Does it have the ability to understand honest mistakes from bad faith, to know when it is being “fed a line” by propaganda? Does it know how to float hypotheses or arguments that might be offensive to some but which get others to think out of a comfort zone?

To be honest, my experience of seeing what AI does so far is that these questions come up with a big, fat “no”. I thought this when watching a Sky News short news item about how AI might be able to perform some of the tasks of a journalist. (The clip is just over three minutes’ long.) One of the topics that the AI was asked to do was produce a programme about climate change issues (take a wild guess what the tone of this was). And as I immediately thought, this device was fed a set of assumptions: the world is on a path to dangerously hotter weather, that there are human causes of that (to some extent), that this situation requires changes, etc. Now, it may be that this is all honest fact, but regulars on this blog know that the alarmist Man-made global warming case is controversial, not settled fact. They also know that there is now a new approach, being encouraged by writers such as Alex Epstein and entrepreneurs such as Peter Thiel, to reframe the whole way we think about energy, and embrace a “human flourishing” and “climate mastery” perspective, and get away from thinking of the Earth as a “delicate nurturer” and abandon the idea that human impact on the planet must be avoided as much as possible. Humans impact the Earth – that’s a great thing, not something to be ashamed of.

I had very little confidence, from watching this TV clip, that a computer would have incorporated these ideas. There is a real risk as I see it that, depending on who writes the source code, such AIs repeat the fashionable opinions, often wrongheaded, of the day. Certain ideas will be deemed “wrong” rather than evaluated. There will not be the curiosity of the awkward and annoying guy who pesters politicians at press conferences.

AI has many uses, and like the American venture capitalist rainmaker, Marc Andreesen, I am broadly supportive of it as a way to augment human capabilities, and I don’t buy most of the doom predictions about it. Ultimately, AI’s value comes from how we use it. If we use it to simply reinforce our prejudices, it’s not going to add value, but destroy it.

And we wonder why normal people avoid going into front-line politics

Following the recent controversy about the closure of a bank account of former UKIP leader Nigel Farage (he is said to have banked at Coutts, although he did not identify that lender by name in his own story), more information about what might have caused this decision is coming out. Dominic Lawson, son of the late UK Chancellor of the Exchequer, Nigel Lawson (the TV cooking writer and literary editor Nigella Lawson is Dominic’s sister), has been through a similar process in the case of his daughter, who has Down’s Syndrome:

In 2016 we decided to open a bank account for her. She has Down’s Syndrome; this was not something she could do herself. But when my wife Rosa went to the Barclays in our nearest town (where Rosa had had an account for many years), she was told it would not be possible for Domenica to have an account. No reason was given. Fortunately Rosa knew the manager there — the position now no longer exists, and the branch itself is about to close — and he said that he would look into the matter.

He came back to Rosa: ‘I’m really sorry, but it’s out of our hands. It’s because of money-laundering risks. ‘I know this sounds ridiculous, but it’s because of Domenica’s grandfather. He is a politically exposed person.’ This was a reference to Nigel Lawson, my late father, the former chancellor, who was by then a member of the House of Lords. And as the Lords is a legislative assembly, that counted under the regulations. As, absurdly, did his granddaughter, who was of course oblivious to the bank’s implication that she might be a link to money laundering, or the funding of an international drugs cartel.

A friend of mine, known to several who write for and manage this blog, is a member of the House of Lords. I know several, in fact. Maybe they should phone their banks.

Eventually, we did manage to open an account for Domenica there, but it involved the most exhaustive form-filling, with much toing and froing between us and Barclays’ compliance people in London.

It seems that this insanity has struck sufficiently close to home that the UK government, usually a model of inanity and uselessness, is getting involved. After all, the Tories know they might be out of office soon, and might not want to go through what Mr Farage, the Lawsons, and several others have been through.

As I said in a comment on Patrick Crozier’s article about the “de-banking” of Mr Farage last week, this also demonstrates the danger of what are called central bank digital currencies. The potential for governments, such as those admiring the “social credit” regime of Communist China, to use CBDCs to enforce “correct” behaviours and suppress “bad” ones, such as blocking payments for alcohol, or closing contributions to unpopular causes, are dangerously large. Consider what the Canadian government of Justin Trudeau did to those financially supporting the anti-vaccine truckers, for example.

This other Samizdata article referred to HSBC. The Dominic Lawson article also refers to that bank in an unflattering way.

As an aside, what the current situation demonstrates is the lack of real choice in the banking system as it now operates. Linked to central banks for their funding, with CBs as “lenders of last resort”, and anti-money laundering laws imposed by force, bankers are no longer able to have confidential conversations with a client. A banker is obliged by law in most major industrialised nations to report on transactions they deem suspicious, for example, for whatever reason, and woe betide the banker that doesn’t. There are requirements such as Suspicious Transaction & Order Reports in the UK. The US Securities and Exchange Commission operates a similar process. In Switzerland, once renowned for its bank secrecy, non-domestic Swiss clients are no longer under its protection.

Politicians and their cheerleaders might applaud the “ghosting” or “de-banking” of people they dislike, but they ought to be aware that these powers cut both ways. Imagine if, for example, protest groups were to be designated as “terrorist” or whatever. Imagine if Just Stop Oil, Extinction Rebellion, or some other group, gets this treatment.

Samizdata quote of the day – Heresy must be suppressed

The cancellation of eminent science writers and statisticians like Dr. Whitehouse and Professor Fenton for ‘wrongthink’ highlights the ever-shrinking boundaries of the discourse around science and medicine and the unwillingness of science’s gatekeepers to challenge groupthink and politically sensitive dogmas. As Dr. Whitehouse says, “science thrives on debate and scrutiny”. Silencing those who challenge prevailing orthodoxies was the approach favoured by the Catholic church in 17th Century Italy and is completely at odds with the scientific method.

Richard Eldred.

I used to read every issue of New Scientist ‘back in the day’ but it has been a bastion of approved high-status groupthink for many years, suitable for cat tray liner only.

Samizdata quote of the day – artificial intelligence and optimism edition

“My view is that the idea that AI will decide to literally kill humanity is a profound category error. AI is not a living being that has been primed by billions of years of evolution to participate in the battle for the survival of the fittest, as animals are, and as we are. It is math – code – computers, built by people, owned by people, used by people, controlled by people. The idea that it will at some point develop a mind of its own and decide that it has motivations that lead it to try to kill us is a superstitious handwave. In short, AI doesn’t want, it doesn’t have goals, it doesn’t want to kill you, because it’s not alive. And AI is a machine – is not going to come alive any more than your toaster will.”

Marc Andreessen, in an essay getting talked about, called Why AI Will Save The World. The essay is as sure to trigger the perma-doomsters on the Right as on the Left, I suspect.

Thoughts on AI

There is undoubtedly a revolution going on in computing capability. I remember the first time I opened up ChatGPT and asked it to write me a poem, and then realised: this is something I am not used to computers being able to do.

Computers can now respond to natural language with natural language. Let that sink in.

This is not just hype. This is a new tool completely unlike any tool we already had.

These new tools are likely to change forever the way certain types of work are done. It is important to not be left behind: AI might not take your job, but people using AI might. If you can, it is worthwhile taking the time to figure out how to use it to your advantage. Thanks to the natural language capability, it has become easier: what was previously done by meticulously gathering data sets and annotating, pre-processing and cleaning them, has been done for you with these enormous pre-trained models. What previously required learning an API and some programming can now be done by having a conversation with a chat bot.

It is not just language models, there are image, video, speech and music generation tools, too. I have mostly been playing with ChatGPT (the £20 per month service that gets you access to the GPT-4 model that is much better than 3.5), so that is mostly what I will talk about here, but it is not the only thing. “Mixed mode” is something that is around the corner, too: the combination of these models to handle natural language, visual and audio information at the same time, interchangably.

There is much potential, but there is much that is immediately useful. Right now, what can we do?

→ Continue reading: Thoughts on AI

Samizdata quote of the day – AI is just the latest ‘scare’

And so something as potentially useful as AI has become a means for politicians and experts to express their fatalistic worldview. It is a self-fulfilling tragedy. AI could enable society to go beyond its perceived limits. Yet our expert doomsayers seem intent on keeping us within those limits.

The good news is that none of this is inevitable. We can retain a belief in human potential. We can resist the narrative that portrays us as objects, living at the mercy of the things we have created. And if we do so, it is conceivable that we may, one day, develop machines that can represent the ‘peculiarities of mind and soul of an average, inconspicuous human being’, as Vasily Grossman put it. Now that would be a future worth fighting for.

Norman Lewis

Climate change story told by ice cores…

A short but important presentation by Jørgen Peder Steffensen …

What do ice cores tell us about the history of climate change and the present trend? This video explains one perspective – arguably the most accurate one. And if you skip to 2:25, you will see the huge error we have made and the assumptions and extrapolations based on that error.

Is the problem with AI tools not capability but rather trust?

From what I have seen, AI tools can do amazing things. But is the problem going forward not their capability but rather one of trust?

You do not need to trust a pen or a piece of paper, before writing or drawing something. The penmaker, the papermaker, they really do not care, and more important do not know, what you have done with the tools they made.

But is that true with interpretive AI tools? The experience of the “Cthulhu Land Theme Park” art project using Midjourney AI suggests even if what you want is within the tool’s capability, it may simply not allow you to create such content.

Will an AI tool effectively be a pen that refuses to write words the penmaker disapproves of? Paper on which you cannot draw ‘bad’ images the papermaker dislikes? I am by no means an expert on the new AI tools but I am curious to see what people have to say on this subject.

Samizdata quote of the day – heat pump edition

Oh, how we wish the laws of thermodynamics could be altered, in our favour.

Air-source heat pumps, which included the “mini-splits” popular in warmer climates, will provide less and less heat, the colder it gets outside, and less and less cooling, the warmer it gets outside. And in both cases, will use more and more electricity to produce less and less heating or cooling, as the outside temperature rises or falls, respectively – if you see what I mean. In other words, the more you need them, the less effective and efficient they are – the perfect government solution. You couldn’t make it up.

– Commenter llamas accurately describing the lunacy of heat pumps, which really are the perfect analogy for government: the more you need them, the less effective and efficient they are.

The new not-so-hot thing

“Heat pumps: How do they work and how do I get one?” asks the BBC. Fun fact: heat pumps are born from magic cabbages that have been pollinated by combi boilers. Obviously you cannot buy a heat pump, but if you promise promise promise to look after it, the government will let you adopt one. Be warned, you may have to outbid all the other prospective heat-pump mummies and daddies out there!

Or maybe not. After the enthusiastic headline, the first paragraph of the BBC article admits that despite the government offering households £5,000 to replace their gas boilers with heat pumps, take-up of the Boiler Upgrade Scheme has been so low that the Lords Net Zero Committee has warned that the national target for green heating is “very unlikely to be met”.

This is scarcely surprising when, as the Telegraph reports,

Heat pumps will still cost households thousands of pounds each even after they have used the Government’s troubled voucher scheme, a minister has admitted.

Lord Callanan, a junior energy minister, said some consumers would pay “as little” as £2,500 for the eco-friendly heating systems after a grant of £5,000 was taken into account.

His admission comes after critics blamed the high cost of heat pumps for the “embarrassingly” low uptake of the £150m-a-year boiler upgrade scheme.

Official figures show that fewer than 10,000 households have taken advantage of the grants since its launch last May.

From what I hear, heat pumps can be a good heating solution for newly built houses, but putting one in an older house costs a lot more than £5k. Where houses are crowded close together, the bulky outdoor unit is just one more ugly council-mandated eco thing to sit next to the ever-increasing number of wheelie bins that block the pavements.

If anything will prompt a revolt against Net Zero in the UK, the proposed ban on gas boilers will be that thing.

Samizdata quote of the day – Deep Fake edition

Specially trained and reliable witnesses would certainly be a help. But, of course, they’re humans and thus fallible and corruptible. (Heinlein, a creature of his times, was a pretty big believer in institutions and professionalism. The past decade has largely served as a refutation of both. And even in his day, the institutions and professions were less trustworthy than we thought; it was just harder to find out when they were lying, sort of a meta-case of what I’m writing about here.)

Technology might help some, as it will probably soon be able to tell if people are lying via brain scans with high reliability. (I doubt it will be able to tell if they’re just wrong, though). And that technology offers its own set of – very troubling — problems that go way beyond this essay.

Glenn Reynolds

Permission to speak not granted: the editor of Science gives his ruling

This “Threadreader” page shows a now-deleted set of tweets by the Editor-in-Chief of Science magazine, Holden Thorp:

In light of @Nature’s excellent editorial about why it makes sense to comment on politics (all the way, in their case, to making an endorsement), this is the Pew finding that is most relevant. Following the admonition to stick to science is conceding the idea that scientists can be sidelined in policy decisions. “Stick to science” infantilizes scientists and tells us to sit at the kids table and let the adults decide. We must fight back. Here’s the editorial:

Should Nature endorse political candidates? Yes — when the occasion demands it

Political endorsements might not always win hearts and minds, but when candidates threaten a retreat from reason, science must speak out.
https://www.nature.com/articles/d41586-023-00789-5

Sure, if you ask if folks in the public if they lose faith in science if journals venture into politics, many will say yes. But they don’t actually want science, they want scientific information they can use as they see fit. 3/n @Magda_Skipper @laurahelmuth @KBibbinsDomingo

This gives people the permission to say things like “climate change may be real, but I don’t think we should have government regulation to deal with it,” which is unacceptable. We can’t concede that by letting people pick and choose. Good for @Magda_Skipper for speaking out.

Emphasis added. Found via Stuart Ritchie.