Improved AI Models Do Worse at Identifying Prime Numbers

(p. A2) . . . new research released this week reveals a fundamental challenge of developing artificial intelligence: ChatGPT has become worse at performing certain basic math operations.

The researchers at Stanford University and the University of California, Berkeley said the deterioration is an example of a phenomenon known to AI developers as drift, where attempts to improve one part of the enormously complex AI models make other parts of the models perform worse.

“Changing it in one direction can worsen it in other directions,” said James Zou, a Stanford professor who is affiliated with the school’s AI lab and is one of the authors of the new research. “It makes it very challenging to consistently improve.”

. . .

The goal of the team of researchers, consisting of Lingjiao Chen, a computer-science Ph.D. student at Stanford, along with Zou and Berkeley’s Matei Zaharia, is to systematically and repeatedly see how the models perform over time at a range of tasks.

Thus far, they have tested two versions of ChatGPT: version 3.5, available free online to anyone, and version 4.0, available via a premium subscription.

The results aren’t entirely promising. They gave the chatbot a basic task: identify whether a particular number is a prime number. This is the sort of math problem that is complicated for people but simple for computers.

Is 17,077 prime? Is 17,947 prime? Unless you are a savant you can’t work this out in your head, but it is easy for computers to evaluate. A computer can just brute force the problem—try dividing by two, three, five, etc., and see if anything works.

To track performance, the researchers fed ChatGPT 1,000 different numbers. In March, the premium GPT-4, correctly identified whether 84% of the numbers were prime or not. (Pretty mediocre performance for a computer, frankly.) By June its success rate had dropped to 51%.

. . .

The phenomenon of unpredictable drift is known to researchers who study machine learning and AI, Zou said. “We had the suspicion it could happen here, but we were very surprised at how fast the drift is happening.”

For the full commentary, see:

Josh Zumbrun. “THE NUMBERS; AI Surprise: It’s Unlearning Basic Math.” The Wall Street Journal (Saturday, Aug. 5, 2023): A2.

(Note: ellipses added.)

(Note: the online version of the commentary has the date August 4, 2023, and has the title “THE NUMBERS; Why ChatGPT Is Getting Dumber at Basic Math.”)

“An Inalienable Right to Sit In AC”

(p. C4) “Let’s sit in AC.” An American friend of mine, recently living in Mumbai, was wildly amused to hear this said in that steamy megalopolis, as if retreating to the tantalizing cool of an air-conditioned room were an activity in itself.

It took me a moment to see what he found so funny. I had grown up with the deprivations of socialist India in the 1980s. I was hardwired to fetishize air-conditioning. It was not an adjunct to life, sewn seamlessly into our daily routines, as it is in the U.S., where 82.7 million homes have central AC. It was, as the philosopher Immanuel Kant would say, the “thing-in-itself,” and to sit “in” AC was something of a national pastime.

. . .

Our first AC was an unbranded gimcrack contraption, jerry-built by a local electrician, but—my god!—how we loved it.

. . .

India loves to assert the demands of belonging through pacts of mutual suffering, and to be in AC was almost to be a little less Indian, as if you had decamped for the West. Even now that the country is the world’s fastest growing market for air-conditioners—projected by the International Energy Agency to be the biggest by 2050—the first line of attack from your average troll is: “What do you know of the realities of India, sitting in AC?”

. . .

. . . this summer, as newspapers report the hottest temperatures ever recorded on Earth and Amazon blasts me with discounts on their best-selling ACs, I cannot help feeling that our turn has come at a bad time. If nothing is done to make air-conditioning more energy-efficient, India alone is projected to use 30 times more electricity in 2030 than it did in 2010. Globally, air conditioning is projected to account for 40% of the growth in energy consumption in buildings by 2050—the equivalent of all the electricity used today in the U.S. and Germany combined. It’s enough to send a chill down the spine of the most ardent of AC evangelists.

The irony of a world made hotter by our need to be cool strikes some as proof of our rapacity. To me, having grown up in the place where so much of the new demand is coming from, I see it as part of a necessary realignment. As the global south gets richer, it will act as a frontier and laboratory. My hope is that it will achieve a miraculous breakthrough in energy efficiency, even as it asserts an inalienable right to sit in AC.

For the full commentary, see:

Aatish Taseer. “My Love Affair With Air- Conditioning.” The Wall Street Journal (Saturday, July 15, 2023): C4.

(Note: ellipses added.)

(Note: the online version of the commentary has the date July 14, 2023, and has the same title as the print version.)

Blue Cross of California Seeks to End Drug Rebates and Hidden Fees

(p. A3) A major health insurer says it will jettison the complicated system that Americans use to pay for drugs, and create something that aims to be better, with partners including Amazon.com and the entrepreneur Mark Cuban.

Blue Shield of California said it is dropping CVS Health’s Caremark, the pharmacy-benefit manager it currently uses, which negotiates drug prices and wraps in other services such as a mail-order pharmacy.

. . .

Blue Shield said that, working with its partners, it aims to negotiate prices with pharmaceutical makers in a way that is different from the typical approach—with a simple net price structure that is supposed to eliminate rebates and hidden fees.

Blue Shield executives said that with one company handling many aspects of how drugs are procured through the system, it is often hard to track the flow of payments accurately.

“The current pharmacy supply chain is a forest of opacity and profit,” said Paul Markovich, Blue Shield’s chief executive officer, in an interview with The Wall Street Journal. “It is overwhelmingly complex, it is designed to maximize the earnings of the participants.” His company’s new setup, he said, will be “flipping that on its head.”

For the full story, see:

Anna Wilde Mathews. “Health Insurer Revamps Drug Pricing Model.” The Wall Street Journal (Friday, Aug. 18, 2023): A3.

(Note: ellipsis added.)

(Note: the online version of the story was updated Aug. 17, 2023, and has the title “A Big Health Insurer Is Ripping Up the Playbook on Drug Pricing.”)

Nimbly Use What Is Available Now Rather Than Wait for Adoption of Perfect Global Standards

(p. A9) For more than five decades, Don Bateman led teams of engineers at what is now Honeywell International in creating and enhancing technology that warns pilots of impending disasters.

The result is an array of software and equipment, much of it mandatory, that squawks warnings and flashes digital admonitions if a plane is heading into a mountain, a ridge, a radio tower or some other obstacle.

. . .

Rather than waiting years for global industry standards to be adopted, he always wanted to use whatever technology was available immediately. Ratan Khatwa, a former Honeywell colleague of Bateman, recalled his advice: “You’ve got to work like farmers,” using whatever is available now rather than waiting for perfection.

For the full obituary, see:

James R. Hagerty. “Safety Engineer Helped Pilots Avoid Crashes.” The Wall Street Journal (Saturday, June 3, 2023): A9.

(Note: ellipsis added.)

(Note: the online version of the obituary has the date May 30, 2023, and has the title “Don Bateman, Champion of Airline Safety, Dies at 91.”)

With Repetitions Surgeons Gain Informal Knowledge, Such as “Muscle Memory”

(p. C6) Imagine you’ve been admitted to the hospital and you’re meeting the physician taking care of you for the first time. Who are you hoping walks through that door? Would you rather they be in their 50s with a good amount of gray hair, or in their 30s, just a few years out of residency?

In a study published in 2017, one of us (Dr. Jena) and colleagues set out to shed some light on the role of age when it came to internists who treat patients in hospitals. These physicians, called hospitalists, provide the majority of care for elderly patients hospitalized in the U.S. with some of the most common acute illnesses, such as serious infections, organ failure and cardiac problems.

. . .

. . ., the results suggested if the over-60 doctors took care of 1,000 patients, 13 patients who died in their care would have survived had they been cared for by the under-40 doctors. We repeated the analysis using 60- and 90-day mortality rates, in case longer term outcomes might have been different, but again, the pattern persisted: Younger doctors had better outcomes than their more experienced peers.

. . .

Younger doctors possess clinical knowledge that is more current. If older doctors haven’t kept up with the latest advances in research and technology, or if they aren’t following the latest guidelines, their care may not be as good as that of their younger peers.

. . .

. . ., a separate study by Dr. Jena and colleagues looked at about 900,000 Medicare patients who underwent common non-elective major surgeries (for example, emergency hip fracture repair or gall bladder surgery) performed by about 46,000 surgeons of varying age.

. . .

The results showed that unlike hospitalists, surgeons got better with age. Their patient mortality rates had modest but significant declines as they got older: mortality was 6.6% for surgeons under 40, 6.5% for surgeons age 40-49, 6.4% for surgeons age 50-59, and 6.3% for surgeons over age 60.

Clearly something different was happening here. It may be that for hospitalists, the benefit of steadily increasing experience starts to be outweighed by their waning knowledge of the most up-to-date care. It’s different for surgeons, though, who hone many of their skills in the OR. Surgeons build muscle memory through repetition, working in confined spaces with complex anatomy. They learn to anticipate technical problems before they happen and plan around them based on prior experience. Over time, they build greater technical skills across a wider variety of scenarios, learn how to best avoid complications, and choose better surgical strategies.

What does this mean for all of us as patients when we meet a new doctor? Taking studies of hospitalists and surgeons together, it’s clear that a doctor’s age isn’t something that can be dismissed out of hand—age does matter—but nor can it be considered in isolation. If we’re concerned about the quality of care we’re receiving, the questions worth asking aren’t “How old are you?” or even “How many years of experience do you have?” but rather “Do you have a lot of experience caring for patients in my situation?” or “What do you do to stay current with the research?”

For the full essay, see:

Anupam B. Jena and Christopher Worsham. “Do Younger or Older Doctors Get Better Results?” The Wall Street Journal (Saturday, July 8, 2023): C6.

(Note: ellipses added.)

(Note: the online version of the essay was updated July 8, 2023, and has the same title as the print version.)

The essay quoted above is adapted from the book:

Jena, Anupam B., and Christopher M. Worsham. Random Acts of Medicine: The Hidden Forces That Sway Doctors, Impact Patients, and Shape Our Health. New York: Doubleday, 2023.

Hybrids Appeal to Consumers with Short-Term E.V. “Range Anxiety”

(p. A19) . . . there’s a good argument to be made that the government, and automakers, are leaning too hard into all-electric and neglecting the virtues of hybrid technology. When I first heard this counterintuitive argument from Toyota, I dismissed it as heel-dragging by a company that lags in electrics, but I’ve come around to the idea that hybrids — at least for now — do have a lot of advantages over all-electric vehicles.

. . .

(p. A6) “Toyota’s claim is accurate. We’ve crunched the numbers on this,” Ashley Nunes told me. He is a senior research associate at Harvard Law School and the director for federal policy, climate and energy at the Breakthrough Institute, a think tank. He testified on the topic in April [2023] before the House Subcommittee on Environment, Manufacturing and Critical Materials.

. . . electric vehicles consume huge quantities of lithium and other materials because they have huge batteries. And they have huge batteries because customers suffer from “range anxiety” and won’t buy an E.V. unless it can go for hundreds of miles without charging — even though the vast majority of trips are short.

. . .

Some people will keep driving old ICE-mobiles (cars with internal combustion engines) because they can’t afford an E.V. And those ICE-mobiles will continue to be major emitters of greenhouse gases.

The production of electric vehicles produces more greenhouse gases than the production of cars with combustion engines. So E.V.s have to travel between 28,000 and 68,000 miles before they have an emissions advantage over similarly sized and equipped ICE-mobiles, according to Nunes. That may take 10 years or more if the E.V. isn’t driven much.

For the full commentary, see:

Peter Coy. “We May Not Be Ready for an All-E.V. World.” The New York Times (Monday, July 17, 2023): A19.

(Note: ellipses added.)

(Note: the online version of the commentary has the date July 14, 2023, and has the title “A Climate Hawk’s Issues With Electric Vehicles.”)

“Engineering Is Achieving Function While Avoiding Failure”

(p. A21) Dr. Petroski, a longtime professor of civil and environmental engineering at Duke University, adapted the architectural axiom “form follows function” into one of his own — “form follows failure” — and addressed the subject extensively in books, lectures, scholarly journals, The New York Times and magazines like Forbes and American Scientist.

“Failure is central to engineering,” he said when The Times profiled him in 2006. “Every single calculation that an engineer makes is a failure calculation. Successful engineering is all about understanding how things break or fail.”

. . .

“Even though I had three degrees in engineering, and had been teaching engineering and was registered as a professional engineer,” he told The Times in 2014, “if some neighbor asked me, ‘What is engineering?,’ I said, ‘Duh.’ I couldn’t put together a coherent definition of it.” His best effort, he said, was, that “engineering is achieving function while avoiding failure.”

Pencils proved a prosaic object for Dr. Petroski’s failure analysis.

. . .

“By asking why and how a pencil point breaks in the way it does,” he concluded, “we are not only led to a better understanding of the tools of stress analysis and their limitations, but we are also led to a fuller appreciation of the wonders of technology when we analyze the aptness of such a manufactured product as the common pencil.”

Two years later, he expanded on the journal article with “The Pencil: A History of Design and Circumstance,” a 448-page tour through its invention and evolution — with brands like Faber-Castell, Dixon Ticonderoga and Koh-I-Noor among them — that included a chapter about the pencil-making business of Henry David Thoreau’s family in Concord, Mass.

Thoreau, best known for writing about his experience living simply in the woods in “Walden,” was a self-taught pencil engineer who learned about the graphite and clay mixture that made European pencils superior, and who helped adapt them to his family’s pencil manufacturing.

For the full obituary, see:

Richard Sandomir. “Henry Petroski, Whose Books Decoded Engineering, Is Dead at 81.” The New York Times (Friday, June 23, 2023): A21.

(Note: ellipses added.)

(Note: the online version of the obituary has the date June 22, 2023, and has the title “Henry Petroski, Whose Books Decoded Engineering, Dies at 81.”)

Petroski’s best-known book is:

Petroski, Henry. The Pencil: A History of Design and Circumstance. New York: Knopf, 1989.

Less Fire on World’s Land Since Early 2000s

(p. A15) One of the most common tropes in our increasingly alarmist climate debate is that global warming has set the world on fire. But it hasn’t. For more than two decades, satellites have recorded fires across the planet’s surface. The data are unequivocal: Since the early 2000s, when 3% of the world’s land caught fire, the area burned annually has trended downward.

In 2022, the last year for which there are complete data, the world hit a new record-low of 2.2% burned area. Yet you’ll struggle to find that reported anywhere.

. . .

This summer, the focus has been on Canada’s wildfires, the smoke from which covered large parts of the Northeastern U.S. Both the Canadian prime minister and the White House have blamed climate change.

. . .

In the case of American fires, most of the problem is bad land management. A century of fire suppression has left more fuel for stronger fires. Even so, last year U.S. fires burned less than one-fifth of the average burn in the 1930s and likely only one-tenth of what caught fire in the early 20th century.

When reading headlines about fires, remember the other climate scare tactics that proved duds. Polar bears were once the poster cubs for climate action, yet are now estimated to be more populous than at any time in the past half-century. We were told climate change would produce more hurricanes, yet satellite data shows that the number of hurricanes globally since 1980 has trended slightly downward.

. . .

Surveys repeatedly show that most voters are unwilling to support the very expensive climate policies activists and green politicians have proposed. Overheated headlines about climate Armageddon are an attempt to scare us into supporting them anyway, at the cost of sensible discussion and debate.

For the full commentary, see:

Bjorn Lomborg “Climate Change Hasn’t Set the World on Fire.” The Wall Street Journal (Tuesday, Aug. 1, 2023): A15.

(Note: ellipses added.)

(Note: the online version of the commentary has the date July 31, 2023, and has the same title as the print version.)

Latest High-Efficiency Air Conditioners Focus on Cutting Humidity

(p. B4) Air conditioners make people cooler and the world hotter. A slew of startups are launching new products to break that cycle.

. . .

Companies such as Blue Frontier, Transaera and Montana Technologies are raising money from investors including industry giant Carrier Global and Bill Gates’s Breakthrough Energy Ventures to develop more efficient technologies. Many of those efforts focus on the humidity rather than the heat, using new materials like liquid salt to dry out the air.

. . .

Blue Frontier aims to separate humidity and temperature control using a liquid salt solution that was developed with the National Renewable Energy Laboratory. The solution also stores energy, reducing consumption at peak times, when electricity grids are strained on hot days.

The salt solution is an industrial version of the little packets that absorb moisture to keep products dry during shipping. The solution is heated up, releasing water and boosting the concentration of salt, making it more absorbent. This can be done when electricity demand is low and effectively stores energy until cooling is needed.

When air conditioning is needed, the solution is brought in contact with air, absorbing water and removing humidity. The air is cooled within a component called a heat exchanger using a high-efficiency method to lower air temperature by exposing it to water. The dry air absorbs the water, lowering its temperature and the temperature of the heat exchanger. That air that absorbs the water becomes warm and humid and is moved outside. At the same time, air that moves through the chilled heat exchanger flows into the room that is being cooled.

After raising $20 million from investors including Breakthrough last year, Blue Frontier is trialing ACs for businesses. “Air conditioning could be a solution to the problem rather than being the problem,” Betts said.

. . .

“The climate problem is only going to get worse if we continue to add the same types of air conditioners to meet that demand,” said Sorin Grama, CEO of Transaera, which is developing a new AC using highly absorbent materials that remove humidity. The company raised $4.5 million from investors including Carrier last year and is currently making prototypes.

Grama co-founded Transaera with a Massachusetts Institute of Technology professor after working in India for a refrigeration company and seeing that air conditioners were too expensive for many consumers in the country.

For the full story, see:

Amrith Ramkumar. “Companies Race To Build a Better Air Conditioner.” The Wall Street Journal (Thursday, June 29, 2023): B4.

(Note: ellipses added.)

(Note: the online version of the story was updated June 28, 2023, and has the title “The Race to Build a Better Air Conditioner.”)

United Airlines CEO Gave Up on Flying United Airlines

United Airlines had major flight cancellations on Sun., June 25, 2023, on the day we were to fly United through O’Hare airport on our way to a European trip. Stress, exhaustion, chaos. United Airlines chaos continued for days. My brain has not yet totally processed the story quoted below. My gut, on the other hand, wants the CEO of United Airlines to be fired.

(p. B11) United Airlines Chief Executive Scott Kirby apologized for taking a private jet from Teterboro Airport in New Jersey to Denver this week as his airline grappled with widespread weather disruptions.

“Taking a private jet was the wrong decision because it was insensitive to our customers who were waiting to get home,” Kirby said in a statement Friday. “I sincerely apologize to our customers and our team members who have been working around-the-clock for several days—often through severe weather—to take care of our customers.”

A United spokeswoman said Kirby took the flight Wednesday because he was unable to secure a seat on a commercial flight. The company didn’t pay for the private flight, she said.

Wednesday was a hectic day for United: The carrier canceled over 750 mainline flights, according to FlightAware, over a quarter of what it had scheduled. The night before, a long stretch of bad storms in New York led to logjams at the area’s airports, including United’s Newark hub.

Some travelers over the past week have been stranded for days while waiting for space on flights home, in some cases sleeping in the airport. Travelers said they spent hours waiting in line for assistance or to be reunited with checked bags.

For the full story, see:

Alison Sider. “United CEO Apologizes for Flying on Private Jet Amid Airline’s Cancellations.” The Wall Street Journal (Saturday, July 1, 2023): B11.

(Note: the online version of the story was updated June 30, 2023, and has the title “United Airlines CEO Apologizes for Taking Private Jet During Flight Disruptions.”)

Unsound Trucking Firm “Blew Through” $700 Million of Federal Covid “Bailout” Loan

(p. A4) The Treasury Department erred in giving a loan to a troubled trucking company as part of a 2020 Covid-19 rescue package and should refrain from similar sector-specific loan programs in the future, according to a new congressional report.

Yellow, a trucking company, received a $700 million loan from the Treasury Department as part of an aid program for private industries included in bipartisan legislation known as the Cares Act enacted early in the pandemic.

But Treasury had to skirt the program’s rules to make the loan, the report said. The agency designated Yellow—then known as YRC Worldwide—as critical to national security even though the company didn’t meet the standard for that designation, the report said.

. . .

In exchange for the loan, Treasury received a roughly 30% stake in the company.

. . .

At the time of the loan the company was rated noninvestment grade by Moody’s Investors Service and was at risk of bankruptcy, according to the report.

. . .

In recent months, Yellow has again suffered from the broader freight slowdown.

. . .

Teamsters President Sean O’Brien said the union is abiding by the terms of its contract with the company.

“After decades of gross mismanagement, Yellow blew through a $700 million bailout from the federal government, and now it wants workers to foot the bill,” O’Brien said in a statement.

For the full story, see:

David Harrison. “Treasury Faulted for Loan to Troubled Trucking Firm.” The Wall Street Journal (Wednesday, June 28, 2023): A4.

(Note: ellipses added.)

(Note: the online version of the story was updated June 27, 2023, and has the title “Treasury Shouldn’t Have Given Pandemic Aid to Trucking Company, Report Finds.”)