LLM Archives - The AI Prism

‘LLMs Reward Expertise’: What the Data Actually Shows

The AI Prism Admin — Mon, 31 Aug 2026 10:00:00 +0000

The 1,306-point claim that split Hacker News

In coverage that drew 1,306 points on Hacker News, Sean Goedecke advanced a deceptively simple thesis: working with an LLM amplifies the skilled and exposes the unskilled. Expertise, he argued, is rewarded rather than replaced (Goedecke, “LLMs reward expertise”). The post resonated because it flatly contradicts both panic narratives — that AI will erase knowledge workers — and triumphalist ones — that anyone can now produce expert output by typing a sentence.

The argument deserves scrutiny because it makes a falsifiable empirical claim, not a philosophical one. Does the data support the idea that expertise is the variable that determines how much value a person extracts from an LLM? Or does the evidence point somewhere more nuanced? Goedecke himself flagged the risk in his own comment thread: some readers, he noted, are “rightly suspicious of a view that’s reassuring them about how they’re still valuable.” That honesty is the right starting point. We should test the claim against studies, not vibes.

What Goedecke actually argues

Goedecke’s core mechanic is straightforward. Before LLMs, a technical gap — say, not knowing CSS — forced you to either recruit a skilled colleague or hope a matching answer already existed online. Today the same person can delegate that gap to a model and produce “sort-of-okay” output. Everyone becomes a generalist (Goedecke).

From this, a tempting conclusion follows: if everyone talks to the same model, prompting skill is irrelevant and expertise no longer matters. Goedecke rejects that. His central claim is that the most important skill in prompting is expertise in the domain you are prompting about. A novice and an expert may get similar first drafts, but only the expert can steer, prune, and verify the result. He extends this to codebases specifically: if you hold a strong “theory of your codebase,” you can push the LLM far harder than someone with no familiarity, because you have a prior sense of what a good solution looks like.

The mechanism he proposes is information retrieval, not magic. The answer is “in the model” already; the scarce resource is the human ability to pull the right answer out. That reframes expertise as a compression and filtering skill: knowing which of the model’s many plausible lines to keep, and which to throw away before they calcify into a confident mistake.

The Terence Tao conversation, and what it really shows

His flagship exhibit is Terence Tao’s public conversation with ChatGPT about a recently discovered counterexample to the Jacobian Conjecture (Tao’s shared chat). Tao does not merely prompt; he makes leaps, proposes reformulations, and pushes back when outputs “look weird.” Goedecke notes the model shifts into “talking-to-mathematicians” mode for Tao, producing terser, denser replies than a layperson receives.

The lesson is not that Tao has mastered a secret prompt syntax. It is that domain knowledge lets you pull the right idea out of a multi-paragraph response and discard the rest. As we explored in our own analysis of Tao’s method, the genius sees the shape of the problem before the model finishes speaking, and he almost never takes the model’s advice about where to go next (TheAIprism: what a genius sees that we don’t). The model is a sparring partner, not an authority.

This maps onto a broader pattern Goedecke observes in his own engineering work: familiarity with concrete specifics beats generic principles. He can ask sharp questions about the systems he owns at GitHub that he could never ask about abstract mathematics. Expertise, in other words, is local — and LLMs reward the locality. The same person can be expert and novice in the same afternoon, depending on the domain, which is why the claim “expertise is rewarded” is true only relative to a specific task.

What the controlled studies actually say

Goedecke’s claim is anecdotal. The cleanest counter-evidence comes from randomized experiments. In a 2023 study, Shakked Noy and Whitney Zhang gave 453 professionals incentivized writing tasks, randomly assigning ChatGPT access (Noy & Zhang, Science). Output quality rose and completion time fell — but the gains were concentrated among lower-ability workers. The productivity distribution compressed rather than spread.

A large field study of customer-service agents reached the same pattern at scale. Brynjolfsson, Li, and Raymond studied thousands of agents before and after AI deployment and found an average 15% productivity lift, but a 34% lift for novice and low-skilled workers, with minimal effect on the best performers (Brynjolfsson, Li & Raymond, “Generative AI at Work”). Their interpretation: AI transmits the best practices of top performers downward, lifting the floor for everyone below them.

A 2024 age-classification experiment by Caplin et al. compounds the point: AI raised performance across ability levels but reduced dispersion most when users were well calibrated about their own skill (Law & Economics Center review). The recurring result across writing, support, and classification tasks is skill compression, not elite-only reward. If the only evidence were these three papers, Goedecke’s thesis would look wrong — which is exactly why the next study matters.

The mechanism behind compression is best-practice transmission. A junior who has never seen a strong example of the task suddenly has one on tap, every time. The senior, who already embodied those practices, gains little from re-encountering them. That is why the floor moves and the ceiling barely does — at least on the tasks these studies measured, which tend to be bounded and verifiable.

The jagged technological frontier

The most important caveat comes from the BCG–Harvard study of 758 consultants and 18 realistic tasks (Dell’Acqua et al., “Navigating the Jagged Technological Frontier”). Within the model’s capabilities, GPT-4 users completed 12.2% more tasks, 25.1% faster, and 40% produced higher-quality work. But on tasks just outside that “jagged frontier,” AI users were 19% less likely to reach a correct answer than people with no AI at all.

This is the crux. AI does not fail uniformly; it fails on a ragged boundary the user cannot see. The researchers distinguish “centaurs” (clean human/AI task splits) from “cyborgs” (constant interaction) — both work, but both depend on the human knowing where the frontier sits. Lakhani’s blunt warning captures it: “This is not Google.” Treating the model as a search box is exactly how users fell 19% behind on the hard tasks.

The frontier finding does something subtle to Goedecke’s thesis. It suggests the expert’s advantage is not merely producing better drafts — it is knowing which tasks to hand the model at all. Outside the frontier, more delegation is worse. That is a meta-judgment the novice lacks, and it is invisible in aggregate productivity numbers that average over easy and hard tasks alike. The expert’s reward, in other words, shows up as avoidance of catastrophe rather than headline speed gains.

Two effects, not one: compression and amplification

Set the studies side by side and a cleaner picture emerges. There are two distinct effects running in opposite directions:

Compression at the floor. AI lifts weaker workers most. Noy & Zhang, Brynjolfsson et al., and Caplin et al. all find performance dispersion shrinks, especially when users are well calibrated about their own skill. The floor rises fast.

Amplification at the ceiling. Experts extract more at the top. Goedecke’s Tao example and the BCG finding — that outside-frontier failure depends on user judgment — both imply the expert’s edge grows precisely where tasks are hard and the model is silent or wrong.

Goedecke is right that expertise is rewarded. He understates how much AI compresses the gap below. The honest synthesis is asymmetric: the floor rises faster than the ceiling. A junior with a model can now mimic a competent senior on routine work, but no amount of model access converts a novice into Tao on the frontier.

Consider a concrete split. On a bounded writing task — summarize this memo, draft this email — the novice-plus-model and the expert-plus-model land close, because the frontier encloses the task and the model supplies the missing structure. On an open mathematical proof or a subtle production incident, the novice gets fluent nonsense the expert immediately flags. The same tool, two regimes: compression where the frontier is generous, amplification where it is thin.

One caveat tempers the whole comparison: the frontier is not fixed. As models improve, tasks that were once outside it migrate inside, and the compression effect expands with them. If the boundary keeps moving outward, the era in which expertise is decisively rewarded at the ceiling may shrink to a thinner and thinner sliver of remaining-hard problems — unless expertise itself is what defines where the frontier currently lies.

Why calibration is the new bottleneck

If AI both lifts the floor and rewards expertise at the ceiling, what exactly does the skilled person contribute? The BCG data points to one scarce skill: calibration — knowing when to trust the model and when to ignore it. Outside the frontier, over-trust was actively harmful (−19% correctness). The human who suspects “this looks more complex than I hoped” and reroutes is the human who stays accurate.

Goedecke’s own phrasing fits: “the human is the bottleneck, not the model,” because the hard part is communicating exactly what solution you want (Goedecke). I would sharpen that: the bottleneck is judgment about the model’s limits, a meta-skill that sits above raw domain expertise. Domain expertise helps you recognize a wrong answer; calibration tells you whether to ask at all. Both are human, neither is automatable yet.

This also explains the Hacker News skeptic’s objection — that anyone can now feel rewarded. Feeling rewarded and being right are different. The model happily confirms the incompetent, which is precisely why calibration, not confidence, separates the expert from the amateur. Calibration is buildable: it grows from repeated, consequential feedback where wrong answers carry a cost the model cannot absorb for you. That is another reason expertise, earned through consequences, stays relevant.

Implications for knowledge work and hiring

For organizations, the data argues against two instincts. First, do not assume AI erases the need for senior talent; you need experts precisely to set direction and catch errors outside the frontier. Second, do not assume juniors are now interchangeable with seniors — AI narrows the gap but does not close it, and someone must still validate the output. The realistic play is mixed teams where experts handle the frontier and juniors, augmented, handle the floor.

This reframes the jobs debate away from “will AI replace us” toward “who can steer it” — a theme we examine in our broader review of what is actually happening to jobs (TheAIprism: separating AI hype from reality). The scarce role is the editor of the machine, not its operator. Hiring should weight demonstrated calibration — can this person tell good model output from fluent nonsense? — above raw output volume, because volume is now nearly free and discernment is not.

The same logic reshapes internal metrics. If AI narrows the spread between your best and worst contributors on routine work, average throughput becomes a worse signal of talent. Managers should monitor the tail — the hard, frontier cases where only calibration prevents regressions — rather than aggregate speed, or they will reward the person who delegates most and ships the most plausible errors.

Implications for education and evaluating AI output

The synthesis also reshapes how we should teach and assess. If AI compresses the floor, drilling rote execution matters less; teaching calibration matters more. Students need to learn not “how to write the essay” but “how to tell whether the essay the model wrote is correct.” That is a higher-order skill, and it is exactly the one experts already possess. Education that skips the fundamentals in favor of pure prompt reliance risks producing adults who cannot catch the model when it is wrong.

For evaluation, the lesson is uncomfortable: we can no longer grade the artifact without grading the process. A flawless draft may be expert-steered or expert-blind. The differentiator is whether the author can defend every line — a capacity AI cannot fake and expertise alone supplies. Assessment must move toward oral defense, source tracing, and revision history rather than the final product alone.

There is a Carnegie-style lesson here too. Just as cognitive tools historically offloaded routine computation, LLMs offload routine composition — and in both cases the expert’s value migrated to the parts the tool could not do. The frontier, not the floor, is where expertise lives, and curricula that teach only floor-level execution are teaching the part the machine now owns. The goal of training shifts from producing flawless executors to producing reliable judges.

The verdict, and an open question

Goedecke’s thesis survives contact with the data, but in a revised form. Expertise is rewarded — yet so is the absence of it, because AI raises the floor for everyone. The net effect is not replacement but reorganization: execution cheapens, judgment appreciates. The people who thrive are those who treat the model as a brilliant, unreliable junior colleague rather than an oracle, and who invest in the calibration the studies show is decisive.

The practical takeaway for knowledge workers is unglamorous. Spend less energy on prompt incantations and more on deepening the domain sense the model cannot fake; build feedback loops where your mistakes are visible; and reserve the model for the tasks inside its frontier while you guard the boundary yourself. Expertise is not obsolete. It is redistributed toward the places the model cannot reach.

That leaves the question the studies have not settled: if AI keeps lifting the floor while the expert’s edge persists mainly at the frontier, will deep expertise become a smaller share of total value — or the only part that still commands a premium?

References

Goedecke, S. (2026). LLMs reward expertise. seangoedecke.com. https://www.seangoedecke.com/llms-reward-expertise/
Dell’Acqua, F., Lakhani, K. R., McFowland, E., et al. (2023). Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality. Harvard Business School / BCG. Coverage
Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science, 381(6654), 187–192. https://www.science.org/doi/10.1126/science.adh2586
Brynjolfsson, E., Li, D., & Raymond, L. (2023). Generative AI at Work. NBER Working Paper 31161. https://www.nber.org/papers/w31161
Law & Economics Center (2024). AI, Productivity, and Labor Markets: A Review of the Empirical Evidence. George Mason University. https://laweconcenter.org/resources/ai-productivity-and-labor-markets-a-review-of-the-empirical-evidence/

The post ‘LLMs Reward Expertise’: What the Data Actually Shows appeared first on The AI Prism.

Apple’s M6 and M5 Ultra Turn the Mac Into a Local AI Workstation

The AI Prism Admin — Thu, 27 Aug 2026 14:00:00 +0000

The Mac’s New Killer App Isn’t Creative Work — It’s Local AI

Apple announced the M6 and M5 Ultra on August 25, 2026, and the press release reads less like a chip launch and more like an AI infrastructure play. The headline claims are all compute, memory, and model sizes: “run huge LLMs with hundreds of billions of parameters entirely on device.”

The groundwork was already there. Ars Technica reports developers have been daisy-chaining Mac minis and Mac Studios to run inference on models too big for a single machine, treating Apple’s unified-memory architecture as a working alternative to Nvidia GPU rigs. CNBC’s Kif Leswing notes developers building agents with tools like OpenClaw prefer running them on a dedicated Mac mini instead of in the cloud.

Now Apple is leaning in publicly. It calls the Mac mini “the leading desktop for always-on agentic computing” and the Mac Studio “the ultimate desktop for on-device AI.” That isn’t marketing about creativity. It’s a bet that the next era of the Mac is measured in tokens per second.

Read the announcement closely and you’ll notice what’s missing: Ars Technica is blunt that there are no major new features here, just a specs bump — with Apple’s presentation aimed squarely at use cases that didn’t exist when earlier iterations were engineered. The announcement also landed a few weeks before the expected iPhone launch, which CNBC reads as a signal that desktops have become strategically important to Apple as a foothold in the AI development world. The machines were the message.

M6: A 2-Nanometer Chip Built Around the Neural Engine

M6 is Apple’s first 2-nanometer chip, and the core layout shows where the priorities sit: a 12-core CPU (2 super cores, 4 performance, 6 efficiency) with what Apple calls the world’s fastest single-threaded core, a 12-core GPU with a Neural Accelerator in every core, and a Dual 16-core Neural Engine delivering up to 2x the peak compute of the previous generation, per Apple. Apple pitches the chip at “everyday users, students, developers, AI hobbyists, and enterprises” — Ars notes it’s the first Apple SoC to use all three CPU core types at once, and Apple says system frameworks can run both neural engines simultaneously for faster model execution.

The GPU is where the local-LLM story starts. Apple claims a 30 percent increase in peak GPU compute for AI versus M5 — and more than 8x versus M1 — which it says means significantly faster prompt processing for on-device LLMs. Graphics get the same treatment: hardware-accelerated ray tracing and 50 percent higher geometry rates, useful for the 3D workloads that share the desk.

Memory is the real constraint, though. The M6 tops out at 32GB of unified memory with 170GB/s of bandwidth, up 10 percent from M5 and 2.5x from M1. In the Mac mini that’s 16GB standard, configurable to 32GB, and Apple claims the M6 machine delivers up to 4x faster AI performance, 2x faster graphics and storage, and 40 percent faster CPU performance than the M4 model. Plenty for compact models. Not frontier territory.

The M5 Pro version of the Mac mini, meanwhile, packs an 18-core CPU and 20-core GPU, and CNBC reports it processes LLM prompts up to 8.5x faster than older Pro models. Both models add Wi-Fi 7, Bluetooth 6, and 2.5Gb Ethernet as standard, with a 10Gb option — connectivity that matters when the machine’s job is serving agents around the clock.

M5 Ultra: 512GB of Unified Memory Is the Whole Point

M5 Ultra is Apple’s most powerful chip ever — and its first quad-die design. UltraFusion stitches two dual-die M5 Max chips into one processor with more than 4.4TB/s of inter-die bandwidth, letting the four dies behave as a single chip. The result: up to a 36-core CPU and an 80-core GPU that carries Neural Accelerators for the first time on an Ultra part.

Compared with M3 Ultra, Apple claims 4.5x the peak GPU compute for AI, up to 1.25x single-threaded and 1.3x multithreaded CPU performance, 40 percent faster graphics, and a 32-core Neural Engine for on-device Apple Intelligence. But the number that matters for local inference is 512GB of unified memory at 1.2TB/s of bandwidth — 50 percent more than M3 Ultra, confirmed in MacRumors’ spec rundown.

Apple frames the entire chip around model capacity: store huge datasets in local memory, raise tokens-per-second, and run LLMs with hundreds of billions of parameters entirely on device. In the Mac Studio that works out to up to 4.3x the peak AI compute of M3 Ultra — and nearly 10x that of M1 Ultra — with LM Studio prompt processing up to 9.8x faster than the M1 Ultra generation.

The rest of the machine backs it up: PCIe Gen 6 storage that’s up to 2x faster, the N1 chip bringing Wi-Fi 7 and Bluetooth 6, six Thunderbolt 5 ports, and a Media Engine that plays up to 33 simultaneous streams of 8K ProRes 422 at 30fps. Apple’s chief hardware officer Johny Srouji calls it “our most powerful Mac ever.” For AI purposes, what matters is that a desktop now carries more memory than most data-center GPU servers did a few years ago.

The Economics Flip: Local Memory vs. Metered Tokens

Here’s the sentence Apple’s marketing team probably fought over: the Mac Studio lets users “run massive models entirely on device with complete privacy — without counting tokens or worrying about rising cloud costs.” That’s a direct shot at the API business model.

The arithmetic is real. Ars Technica says cloud coding-agent costs have grown steep enough that developers are questioning whether they’ll stay practical — and that open-weight models like recent Qwen and DeepSeek releases handle much of the same work “without charging a fortune for tokens.” Coding agents are the key use case: they run constantly, and constant usage is exactly what a per-token meter punishes.

What Apple sells is a different deal: pay for the hardware once, and marginal inference is free. The flip side is the tension we flagged in our piece on the new AI traffic wars — when inference moves onto desks and out of clouds, it shifts who controls what you can run, and who gets paid for it.

Notice the cost structure Apple is implicitly betting on. CNBC reports the Mac mini’s price went from $599 to $799 over the summer — a hike Apple blamed on memory costs — and now starts at $899. Memory is the expensive component, and memory is precisely what Apple now sells in bulk: 512GB of unified memory is the moat. A model that fits in RAM costs electricity. The same model behind an API costs a meter.

Clustering Is Apple’s Quiet Bet on Distributed Inference

Single-machine memory has a ceiling, so Apple is building the workaround into the OS. macOS 26.2, which shipped last December, enabled low-latency Thunderbolt 5 communication for distributed AI inference using MLX — the technical trigger for the daisy-chaining trend, per Ars Technica.

Now it’s official product positioning. Apple says Mac Studios can be clustered over Thunderbolt 5 with RDMA to pool memory across systems, letting teams load “the largest and most demanding frontier-class open-weight models available today” — and that a cluster of four delivers up to 3x faster AI inference than a single system. Tools like exo already do this informally; Apple is making it a supported feature.

Note the tiering, though: the M6 Mac mini does not get Thunderbolt 5 — that’s exclusive to the M5 Pro model, as MacStories’ Federico Viticci points out. Distributed inference is reserved for the machines that already cost serious money.

There’s a quiet strategy underneath this. Apple’s answer to “one machine can’t hold the model” isn’t a bigger data center — it’s more Macs. Every cluster is a row of deskside boxes with Apple’s margins attached, which turns the memory ceiling into a reason to buy additional hardware rather than rent cloud capacity.

What 120 Tokens Per Second on Your Desk Changes

Viticci has run local agents on an M3 Ultra Mac Studio with 512GB for the past year — his entire review workspace is managed by local agents running DeepSeek-V4-Flash via MLX. He reports generation at roughly 35 tokens per second on that machine; if Apple’s 4x claim scales linearly, the M5 Ultra should push the same model past 120 tokens per second — faster, he argues, than any AI chatbot website, and second only to dedicated Nvidia clusters or specialized data-center inference providers like Cerebras and Groq.

The mainstream tier scales too. He estimates the Mixture-of-Experts model Qwen 3.5-35B-A3B, which runs at about 17 tokens per second on a base M4 Mac mini, could clear 60 tokens per second on the M6.

And the ceiling keeps moving. The 744B-parameter GLM-5.2 ran at roughly 17 tokens per second on his M3 Ultra, and the enormous Kimi K3 managed a painful 3 — both now plausible targets for an M5 Ultra with 512GB.

That’s no longer hobbyist territory. That’s a workstation that can run an agent fleet locally, keep the data on-device, and never send a token to a meter.

One honest caveat, from Ars Technica: most standard consumer hardware is still far enough behind on model size that “run it all locally on your regular dev workstation” isn’t a reality for everyone yet. The 512GB Studio is the exception that defines the direction — not the rule that describes most desks. And Viticci’s caveat is worth repeating: it’s all theoretical until independent benchmarks land. But the direction is unmistakable — the performance gap between a desk and a data center is collapsing.

The Pricing Reality: $899 Entry, $5,499 for the Real Deal

Here’s where Apple’s local-AI story gets honest. The Mac mini with M6 starts at $899 — up $100 from the prior model, after a summer bump from $599 that CNBC says Apple blamed on memory costs. Configurations with M5 Pro start at $1,699.

The Mac Studio with M5 Max starts at $2,499, while the M5 Ultra version starts at $5,499 — up from $5,299 for the M3 Ultra model it replaces (education pricing runs $2,299 and $5,099). And the configuration that actually runs frontier models, with 512GB of memory, costs well north of $20,000 fully loaded, per MacStories, and won’t ship until late October.

Apple is even offering a lease path: the M5 Max Studio from $48.99 a month, the M5 Ultra from $110.10 a month. Preorders opened August 25 across 30 countries, and machines start arriving September 22.

The message is consistent: Apple wants serious AI developers on Macs, but it prices the ticket like a professional tool, not a consumer gadget. The $899 base machine gets you 16GB — enough for a local agent box running small models — while the machines that genuinely compete with cloud APIs sit in the five-figure range.

What This Signals About Apple’s AI Strategy

Apple didn’t announce a frontier model this week. It announced the machines that run them — and that is the strategy. TechCrunch’s Amanda Silberling notes Apple has trailed rivals on proprietary models — the long-awaited Siri upgrade is powered by Google’s Gemini — while its genuine strength is secure, on-device compute.

The software stack reinforces the bet: a brand-new Core AI framework for building, running, and deploying models on Apple silicon, the open-source MLX framework, Apple Foundation Models, App Intents for Apple Intelligence, and Xcode tooling — all aimed at letting developers “run and fine-tune large AI models locally on their Mac” with their own proprietary models if they prefer.

Read that against the industry backdrop. Nvidia sells data-center silicon by the rack. Hyperscalers meter tokens by the million. Apple is staking out the endpoint — the desk, the studio, the always-on agent box — with a privacy story and a one-time hardware price. The consumer-facing payoff arrives with macOS 27 and the next generation of Apple Intelligence, including the upgraded Siri, later this fall.

Whether that pulls developers off cloud APIs is an open question. But Apple now sells memory capacity and token throughput, not just megapixels and frame rates. That’s the tell that Apple believes the AI platform war will be fought on endpoints, too — and that it would rather own the hardware under every local model than rent tokens from one.

The Bottom Line

The M6 and M5 Ultra are the first Apple chips that are honestly more interesting for what they run than for what they render. Unified memory at 512GB, Neural Accelerators inside the GPU, clustering over Thunderbolt, and an OS-level framework for local models add up to a desktop that has quietly become an inference appliance — with economics that invert the cloud’s.

Apple’s new Macs aren’t for creative pros anymore. They’re for running 70B-parameter models locally — so what happens to everyone else?

References

The post Apple’s M6 and M5 Ultra Turn the Mac Into a Local AI Workstation appeared first on The AI Prism.

The WSJ Published a Billionaire’s AI-Written Op-Ed. Nobody Told You.

The AI Prism Admin — Sat, 15 Aug 2026 10:00:00 +0000

On Monday, August 24, the Wall Street Journal’s opinion page ran a column by Stanley Druckenmiller titled “Let the Bond Market Speak”. It took direct aim at Treasury Secretary Scott Bessent’s bond-market interventions — the kind of column that moves both markets and Washington at once.

There was just one thing the Journal didn’t tell you: the prose was written with AI. Druckenmiller confirmed it the next day in an interview with NOTUS, and his reaction was a shrug: “I’m not embarrassed by it.”

Here’s the uncomfortable thesis: this is not a scandal about one billionaire’s writing habits. It’s a stress test for opinion journalism — and the industry is failing it. When the most influential business opinion page in America can’t tell readers who actually wrote the words, “editorial judgment” stops meaning much.

This is what happened, what the Journal said in its defense, and what readers should demand from every byline they trust. Because the machine isn’t going back in the box.

A Mentor’s Broadside, Composed by a Language Model

Druckenmiller is 73, the founder of Duquesne Capital and one of the most respected macro investors of his generation, per the New York Post. He also worked alongside Bessent under George Soros — and is sometimes described as a mentor to the Treasury secretary, a relationship that made the column land harder than any anonymous attack ever could (NOTUS).

The column argued that Bessent’s efforts to hold down Treasury yields — including a plan to “at least double” government buybacks — amounted to price management, not liquidity management (NY Post). Druckenmiller’s prescription was old-school austerity: address the primary deficit, and reform entitlements through means testing, indexing changes, and eligibility adjustments “phased in over decades” (NY Post).

It landed like a grenade. The Financial Times ran a piece titled “Bessent gets Drucked” the same morning, and the New York Post’s version of the story was shared 72,736 times (NY Post). A mentor publicly dressing down his mentee is a story; that’s why it traveled.

The Machine’s Fingerprints Were All Over the Page

The tell didn’t come from Druckenmiller or the Journal — it came from the crowd. Pangram, an AI detection tool, flagged the column as AI-written, according to multiple social media posts, and economist Claudia Sahm posted her own Pangram test finding that 100 percent of the text was AI (NOTUS).

Read the prose and you can see why. “This wasn’t liquidity management, it was price management.” “There is a quieter cost, too.” “Not a malfunction but the machine doing its job.” The New York Post catalogued the telltale cadence: sentence after sentence built on the “It’s not this, it’s that” pattern (NY Post, NOTUS).

Detection tools are unreliable, and Pangram’s verdict shouldn’t be treated as gospel. But this wasn’t a borderline case of one or two borrowed phrases. The structure, the transitions, the rhetorical rhythm — all of it carried the model’s signature.

Here’s the part that should sting: nobody at the Journal flagged it before publication. The paper’s own website promises that “Work that includes AI inputs is reviewed by a journalist before publishing” (NY Post). The review process didn’t catch it. Readers did — after the fact, on social media.

“Of Course I Used AI”

Druckenmiller’s confirmation was matter-of-fact. “There’s a reason I moved from an English major to being an economics major,” he told NOTUS. “I’m not embarrassed by it … I write everything using AI now for the same reason I use a calculator when I do math problems” (NOTUS).

He pushed back on the claim that “the whole thing” was machine-written, saying he rejected many of the AI’s suggestions during the writing process (NOTUS). Then came the line that should worry editors more than anything he wrote: “I don’t know why this is relevant … My name is on the piece. It’s my message” (NOTUS).

Notice the worldview underneath. To Druckenmiller, words are packaging: the argument is the product, and the prose is just delivery. That’s a coherent view for an investor — and a fundamentally different view from the one that underpins bylined opinion journalism, where the words are the evidence of the thought.

The WSJ’s Defense Is Actually a Disclosure Policy in Disguise

Paul Gigot, the Journal’s editorial page editor, defended the piece. “AI is a fact of modern life. People will use it to assist in their work and their writing, including with research, checking grammar, editing and more,” Gigot said. “The question for us is whether what we publish from contributors reflects an author’s original argument, and if the author has the standing and credibility to make it” (NOTUS, TheWrap).

Note what Gigot didn’t say. He didn’t say the Journal disclosed the AI use, didn’t say editors knew before publication, and didn’t describe any review of the machine’s output. Asked whether it was aware the piece was AI-written before publishing, the Journal “did not immediately respond” (NY Post).

Here’s the problem with the “genuine opinion” standard: it’s unverifiable from the reader’s seat. Standing and credibility describe the author’s résumé, not the text’s provenance. The only way a reader can test whether a column reflects an author’s genuine opinion is to know how much of the words the author actually produced. That’s what disclosure is for — and it’s missing.

The FT Drew a Line. The WSJ Walked Past It.

Druckenmiller’s column isn’t the first AI-authorship controversy of the month. Earlier in August, Harvard economist Ricardo Hausmann published an FT column on Trump’s tariffs, and the Financial Times later appended a note: “It has come to our attention that AI was used to condense a longer draft of this column prior to submission to the FT and our own editorial involvement. The FT editorial code of conduct specifically prohibits the use of AI in the writing process” (NOTUS).

Contrast the two stances. The FT: AI in the writing process is prohibited, full stop. The Journal: AI is “a fact of modern life,” and what matters is the author’s intent (NOTUS, TheWrap).

Neither position is crazy. But they’re mutually incompatible — and readers have no way to know which regime governs the column in front of them. A Financial Times reader gets a guarantee. A Wall Street Journal reader gets a shrug.

That inconsistency is the real story. When every outlet improvises its own AI policy, the industry-wide promise that bylines mean human authorship quietly dissolves — not by decree, but by drift.

Drift has a compounding effect. Every undisclosed AI column that goes uncaught trains readers to assume the worst about the ones that are disclosed; every “genuine opinion” defense makes the next editor’s disclosure decision marginally harder to justify internally. The standard isn’t eroding because anyone chose it — it’s eroding because each outlet’s rational choice looks reasonable in isolation.

Ghostwriters Were the Original AI. The Norm Was Always Disclosure.

Let’s be honest about how opinion pages have always worked. Columns are shaped by editors, fact-checkers, speechwriters, and sometimes full ghostwriters. The difference was never purity — it was accountability. A ghostwriter can be questioned, negotiated with, and disclosed when the situation demands it.

What changed with models: the assistance is now infinitely scalable, invisible, and free. Any billionaire, CEO, or politician can produce flawless policy prose on demand — which is exactly what Druckenmiller says he does, “everything,” now (NOTUS).

Chris Roberts, a journalism ethics professor at the University of Alabama, put the risk plainly: using AI “raises questions about how much time and thought actually went into the piece.” “Any time you take humans out of the process of communicating to other humans there can be blowback when the words or the intent is wrong, or it doesn’t sound like a human” (NOTUS).

The fix isn’t to ban AI — it’s too late for that. The fix is a disclosure line: “This column was written with AI assistance.” One sentence. It preserves the byline, the argument, and the trust. It costs nothing except the admission.

The Slippery Slope Is Already Crowded

The Druckenmiller case is the third high-profile AI-authorship controversy in months. In March, the New York Times cut ties with freelancer Alex Preston after his book review incorporated elements of a Guardian review of the same book; he confirmed he had used an AI tool while drafting (TheWrap).

Creator Hank Green faced a similar backlash over an AI-generated script allegation. He denied the specific claim but admitted using AI in his research — and pledged that no part of any future video script would be written, edited, or outlined by a model (TheWrap).

Add the FT/Hausmann note and the pattern is unmistakable: in every case, the AI use was discovered after publication, not declared before it. The scandal isn’t the AI — it’s the silence. Disclosure was absent, so discovery landed as betrayal.

And consider the stakes in this specific case. This wasn’t a book review. It was a billionaire pressuring the Treasury Secretary’s bond-market policy with machine-composed prose, published on the most influential business opinion page in the world. When influence becomes this cheap to manufacture, who actually wrote the words stops being a craft question and starts being a power question.

What Readers Should Demand From Every Opinion Page

Demand one thing: provenance. If a column was written with material AI assistance, the page should say so — in the piece itself, not in a policy document buried in the footer. A single italic line under the byline would have turned this whole episode into a non-story.

Editors should stop treating AI assistance as shameful and start treating disclosure as routine — the same way they handle corrections, conflicts of interest, and paid relationships. The Journal’s own policy page already concedes that “Work that includes AI inputs is reviewed by a journalist before publishing” (NY Post). Review it, fine — then say so on the page.

Readers should apply a simple test: if an outlet won’t disclose how a piece was produced, that’s information about how much it respects your ability to judge. Provenance is the new fact-check.

There’s a business case hiding in that standard, too. Trust is the only durable asset an opinion page owns — it’s why the Journal’s page commands premium ad rates and premium access. A disclosure line doesn’t cost that franchise anything; the absence of one costs it a little more every time a reader finds out late. The outlets that institutionalize provenance now are buying insurance against the moment when disclosure becomes the default expectation, not the exception.

The parallel to the AI industry is uncomfortable. Just as AI’s hottest startups quietly stopped publishing research, the media is drifting toward less disclosure at the exact moment readers need more. When provenance becomes optional, credibility becomes a marketing claim — so if readers can’t tell who wrote the words anymore, what’s left of the byline’s promise?

The Bottom Line

The Druckenmiller affair will fade from the news cycle, but the question it raised won’t: opinion journalism is now produced on a spectrum of human and machine labor, and almost nobody is telling readers where on that spectrum a given column sits.

Druckenmiller shrugged because, for him, the argument is the message and the words are logistics. But for the reader, the words are the only evidence the argument is real. A billionaire’s op-ed was written by AI. The paper published it anyway — and if the most influential business opinion page in America won’t say who wrote the words, who will?

References

The post The WSJ Published a Billionaire’s AI-Written Op-Ed. Nobody Told You. appeared first on The AI Prism.

Terence Tao and the Mathematics of AI: What a Genius Sees That We Don’t

The AI Prism Admin — Tue, 04 Aug 2026 20:18:09 +0000

The Week an 87-Year-Old Conjecture Fell

On July 19, 2026, a problem mathematicians had chased since 1939 was finally settled. Not by a tenured professor. Not by a Fields Medalist. By Levent Alpöge, a mathematician who works at Anthropic, using the company’s Claude Fable 5 model to produce an explicit counterexample to the Jacobian conjecture in three dimensions.

Within 48 hours, Terence Tao had published a “digestion” of the counterexample on his blog, run a long ChatGPT Pro session hunting for a geometric explanation, and watched the Hacker News thread about it pull in 1,126 points and 635 comments — including a companion thread titled “Human mathematicians are being outcounterexampled.”

Five days later, Tao stood before the International Congress of Mathematicians 2026 and told his field the uncomfortable truth: “I believe we are entering a similarly turbulent period — a crisis in the foundations of mathematical values and practices.” That line is from his ICM public lecture, which compared the moment to the 1900-1930 crisis that forced mathematics to formalize its own foundations.

Here is the question nobody is asking: what does the world’s greatest living mathematician see that we don’t?

The World’s Greatest Living Mathematician Is Running a Public Experiment

Tao is not a casual AI observer. The “Mozart of Math” — a 2006 Fields Medalist routinely described as the finest mathematician alive — has spent four years publishing his AI experiments in real time on his blog and Mastodon. That public record is the closest thing we have to a controlled study of how frontier AI changes the work of an elite scientist.

The arc is unmistakable. In April 2023, Tao reported that GPT-4 had “saved me a significant amount of tedious work” for the first time. By June 2024, he told Scientific American: “I think in three years AI will become useful for mathematicians. It will be a great co-pilot.” By November 2025, he was documenting that “AI assistance is now becoming routine” on the Erdős problems website.

Every stage came with receipts: shared ChatGPT conversations, Lean formalizations on GitHub, detailed Mastodon threads. This is not commentary about AI. It is a lab notebook.

What Tao Sees: A Mediocre, But Not Completely Incompetent, Graduate Student

In September 2024, after testing OpenAI’s o1 reasoning model, Tao delivered the most-quoted verdict in AI mathematics: the experience was “roughly on par with trying to advise a mediocre, but not completely incompetent, graduate student.”

He later corrected the viral reading of that line. He was not comparing o1 to a graduate student in general — he was comparing it to a mediocre research assistant. It handles routine computation reliably but is “very unimaginative” at the clever step, and it lacks the one property that makes human students valuable: learning. “These models are static,” Tao told The Atlantic. “Humans have growth.”

He also gave the field its first honest efficiency metric. Producing useful output with the best models still costs 2x to 5x the effort of doing the work yourself. His stated tipping point: when that ratio falls below 1x — which he expects within a few years — adoption stops being a debate.

What the Numbers Say

The benchmark arc moves faster than most people can track. In July 2024, DeepMind’s AlphaProof and AlphaGeometry 2 solved four of six IMO 2024 problems for 28 of 42 points — silver-medal standard. The hardest problem had been solved by only 5 of 609 human contestants, and gold started at 29 points. The methodology behind AlphaProof was later published in Nature.

Then the goalposts moved. In November 2024, Epoch AI released FrontierMath: hundreds of original research-level problems written by more than 60 mathematicians. Leading models solved less than 2%. Tao called the problems “extremely challenging”; Timothy Gowers said they sit “at a different level of difficulty from IMO problems.” In December 2024, OpenAI’s o3 jumped to 25.2% — a leap that later revealed OpenAI had quietly funded FrontierMath’s creation, a transparency failure Epoch AI has since acknowledged.

In 2026 the frontier moved from benchmarks to open problems. First Proof, an independent assessment project, tested four AI harnesses against ten novel research problems on May 28, 2026: seven of ten were solved at publication-level quality, at compute costs of $10 to $1,000 per problem. In March 2026, a GPT-5.4 Pro-driven team became the first to solve a FrontierMath open problem — a Ramsey-theoretic construction Epoch estimates would take an expert human 1-3 months. In May 2026, DeepMind’s AlphaProof Nexus resolved 9 of 353 open Erdős problems and proved 44 of 492 OEIS sequence conjectures at a few hundred dollars per problem.

And then came the Jacobian counterexample: a degree-7 polynomial whose Jacobian cancellation involves 1,329 coefficients against only 120 degrees of freedom — what Tao called “a massive miracle” that brute force would never have found.

The Quiet Workhorse: Lean and the Formalization Pipeline

Generative models get the headlines, but Tao’s workflow runs on a quieter technology: Lean, an interactive theorem prover that checks proofs line by line. In October 2023, formalizing his own paper in Lean surfaced a small but non-trivial bug in an argument he had already published — an error no human referee had caught.

Lean also enabled the largest collaborative proof project in recent memory: the formalization of the Polynomial Freiman-Ruzsa (PFR) conjecture, where more than 20 mathematicians contributed pieces of one proof. “You don’t need to trust them, because they upload code and the Lean compiler verifies it,” Tao explained. “You can do much larger-scale mathematics than we do normally.”

Watch how routine this has become. In November 2025, on Erdős problem #367: a human contributor produced a disproof contingent on an unverified congruence identity; Tao handed the identity to Gemini DeepThink, which proved it in about ten minutes; Tao spent half an hour rewriting it into an elementary proof; and another mathematician formalized the result in Lean in two to three hours. Tao’s own summary: “AI assistance is now becoming routine.” A month earlier, an extended AI conversation helped him answer a MathOverflow question — a task he says he “would have been very unlikely to even attempt” unassisted.

The Erdős Wiki: Proof That AI Assistance Is Now Routine

The best evidence is a living document: the AI contributions to Erdős problems wiki, maintained by Tao’s project with 962 revisions and data through June 30, 2026. It logs dozens of AI attempts against Erdős’s open problems, with color-coded outcomes: full solutions, partial progress, incorrect proofs, and unverified candidates.

The list reads like a who’s who of frontier AI: GPT-5.5 Pro, Claude Fable 5 and Claude Mythos, Gemini 3 Pro, DeepMind prover agents, AlphaProof, Aristotle, Codex. Full solutions are recorded for problems #38, #90, #205, #457, #694, #960, #987, #990, #1014 and #1091, among others — several delivered in Lean, meaning they are machine-checked.

What makes the wiki credible is what it refuses to hide. It also records the incorrect proofs — the confident failures on #11, #51, #233, #616, #647, #888, #963, #1041 and #1044. The disclaimers are blunt: “This page is not a benchmark,” and success rates should not be inferred. That honesty is the difference between a marketing claim and a research log.

Where Machine Reasoning Hits Its Limits

Every serious observer now agrees on where AI math breaks down: without formal verification, an AI proof is just a confident story. Natural-language models hallucinate plausible-looking arguments — the entire point of the Lean pipeline is that a checker, not a vibe, decides correctness.

But verification is not the only bottleneck. Tao’s ICM lecture called out what he terms “proof indigestion”: the Erdős problems site already holds “dozens of AI-generated proof submissions. Many are likely to be correct, but no human expert has yet volunteered to verify and vouch for them.” Some submitters have declared themselves unqualified to check their own AI’s output. Could we get a verified proof of a major result that no human can explain? Tao thinks the question is live.

Then there are the softer limits. AI exposition “dwells at length on trivialities, while passing very briefly through the most interesting and novel portions of the argument.” AI knowledge is frozen at training time — the same week the Jacobian counterexample went public, the models had to be told it existed, because their knowledge cut off before the discovery. And metrics corrupt: Tao invoked Goodhart’s law — when a measure becomes a target, it stops being a measure — and the FrontierMath funding episode showed how benchmark scores can be shaped by the companies being scored. Even the models’ training data is a separate battleground, as we explored in our piece on AI companies shredding rare books for training data.

What This Means for Science

Mathematics is the canary, but the pattern generalizes. Tao’s framing is the cleanest available: for centuries, mathematics ran on proof scarcity — the hard part was producing results. AI inverts the economics. The hard parts become verification, exposition, community acceptance, and what Tao calls canonicalization: a result only matters once it is digested, taught, and built into the theory that everyone else relies on. “We will transition from an era of proof scarcity to an era of proof abundance,” he warned.

His proposed guardrail is beautifully simple: if authors cannot convincingly give a clear, expert-level talk on their results, correctly attributed, the result should not be published. The Leiden declaration, referenced in his talk, pushes the same norms: disclose AI use, keep humans accountable. Meanwhile institutions are betting real money on the trend — DARPA’s ExpMath program funds AI-driven mathematics, and Tao himself has co-authored a philosophy-of-math paper, “Mathematical methods and human thought in the age of AI.”

Beyond pure math, the same machinery is quietly eating the verification economy: AlphaProof Nexus’s authors point to combinatorics, optimization and algebraic geometry, but the underlying capability — generating formally checkable proofs at a few hundred dollars each — is exactly what smart-contract auditing and zero-knowledge cryptography have been waiting for. If “the job description is changing,” as Tao told Nature, it is changing everywhere proof matters: mathematics, software, security, science itself.

What You Should Do About It

If you work in a reasoning-heavy field, the playbook is already visible in Tao’s workflow:

Learn the verifier, not just the model. Lean (or Rocq, or HOL) is the difference between “the AI says so” and “it is so.” Tao’s own Lean journey began with GPT-4’s help, and open-source agents like Mistral’s Leanstral now lower the bar further.
Use AI where output is checkable. Numerical searches, case verification, literature sweeps, formalization — Tao’s wins all share one property: a machine (or a 29-line Python script) can confirm them.
Keep the “talk test.” If you cannot explain your AI-assisted result to an expert from memory, you do not own the result. Treat unexplained AI output as raw material, not a finding.
Disclose AI use. Tao’s ICM slides carry a footnote admitting AI autocompleted text and generated diagrams. Normalize the disclosure, and you starve the covert-use scandals before they start.

The Bottom Line

Terence Tao’s real message is not that AI will solve mathematics. It is that AI is forcing mathematics to decide what it is for — and the same question is coming for every field that runs on verified reasoning. A genius sees this first because he has the strongest incentive: his entire craft is the production of trustworthy arguments, and the production half just got cheap.

The scarcity that remains — understanding, explanation, judgment, taste — is the part that was always human. The question is whether we treat it as the bottleneck or as the point. If the world’s greatest living mathematician is right, the mathematicians who thrive in the age of AI will not be the fastest provers. They will be the ones who know what a proof is for.

So here is the question we are leaving you with: when an AI produces a correct proof that no human alive can explain, is it mathematics — or is it just output?

References

The post Terence Tao and the Mathematics of AI: What a Genius Sees That We Don’t appeared first on The AI Prism.