Good Reading -- October 2014
Facts and Figures
Just 10 years ago the New York Stock Exchange handled approximately 80% of all stock trades. Today it handles approximately 20%. (Source: WSJ)
Words of Wisdom and Advice, with Arnold van den Berg of Century Management -- Great stuff in this short video clip. (See here and here as a starting place to learn more.)
The Empire Reboots -- Bethany McLean's profile of Microsoft and its leadership. Highly recommended.
The U.S. Population Population Has Aged Significantly Over the Past Two Decades -- This sliding-panel map shows the country by the portion of each county's population that is over age 50 in 1990 and 2010. Obviously the title applies to the whole country, but it was interesting to see which areas have and have not aged more quickly than others.
"Risk Revisited" -- I normally wouldn't mention one of Howard Marks' memos because I just assume everyone is already reading them. But this one is so good that if it reaches just one additional reader (or a previous reader a second time) it will be worth it.
The New House of Money -- I haven't read the whole book (only two chapters have been released so far) but the interview with Jim Chanos in Chapter 2 was very good. (Free registration required.)
"How Fractals Explain What's Wrong with Wall Street" -- This article by the fractal authority himself, Benoit Mandelbrot, originally ran in 1999 and was reprinted in 2008 due to the Lehman crisis. I missed it then but Michael Mauboussin recently sent it around and it's definitely worth reading (and re-reading). I also recommend his book The (Mis)Behavior of Markets.
Berkshire Beyond Buffett: The Enduring Value of Values by Lawrence Cunningham -- In the vast and growing pile of Buffett/Berkshire books, this one is unique in that it looks at Berkshire's culture, which the author believes is Berkshire's competitive advantage and one that will outlive Buffett himself. The author is already very familiar with both subjects, which helps a great deal in keeping the history and context brief but insightful. The book combines the best of corporate biography and management philosophy.
The Education of a Value Investor by Guy Spier -- This is easily the most honest, genuine autobiography of an investor that I've ever read. The author has no hesitation in calling out his own flaws, which is especially refreshing given the constant deluge of self-promotion we often see in this industry. It's his story, and he's telling us honestly what does and does not work for him with no pretense about what will make him look good. There were certainly parts of the book I didn't care for, but that is to be expected. This is a quick read, and while there are some brief case studies and investing-related tools/rules, make sure you set your expectations off of the opening paragraph. "My goal in writing this book is to share some of what I've learned on my path as an investor. It's about the education ofthis investor, not any other investor. This story is not an investment how-to. It's not a road map. Rather, it's the story of my journey and of what I've learned along the way." Judged against that goal I think it's a success, and I enjoyed reading it.
Capital Allocation: Evidence, Analytical Methods, and Assessment Guidance -- great work as always from Michael Mauboussin. "Capital allocation is a senior management team’s most fundamental responsibility. The problem is that many CEOs don’t know how to allocate capital effectively...Capital allocation is always important but is especially pertinent today because return on invested capital is high, growth is modest, and corporate balance sheets in the U.S. have substantial cash. Internal financing represented almost 90 percent of the source of total capital for U.S. companies from 1980-2013. M&A, capital expenditures, and R&D are the largest uses of capital for operations, and companies now spend more on buybacks than dividends. This report discusses each use of capital, shows how to analyze that use, reviews the academic findings, and offers a near-term outlook. We provide a framework for assessing a company’s capital allocation skills, which includes examining past behaviors, understanding incentives, and considering the five principles of capital allocation."
"The Odds, Continually Updated" -- Bayesian statistics brought to life.
The Odds, Continually Updated
By F. D. FLAMSEPT. 29, 2014
Statistics may not sound like the most heroic of pursuits. But if not for statisticians, a Long Island fisherman might have died in the Atlantic Ocean after falling off his boat early one morning last summer.
The man owes his life to a once obscure field known as Bayesian statistics — a set of mathematical rules for using new data to continuously update beliefs or existing knowledge.
The method was invented in the 18th century by an English Presbyterian minister named Thomas Bayes — by some accounts to calculate the probability of God’s existence. In this century, Bayesian statistics has grown vastly more useful because of the kind of advanced computing power that didn’t exist even 20 years ago.
It is proving especially useful in approaching complex problems, including searches like the one the Coast Guard used in 2013 to find the missing fisherman, John Aldridge (though not, so far, in the hunt for Malaysia Airlines Flight 370).
Now Bayesian statistics are rippling through everything from physics to cancer research, ecology to psychology. Enthusiasts say they are allowing scientists to solve problems that would have been considered impossible just 20 years ago. And lately, they have been thrust into an intense debate over the reliability of research results.
When people think of statistics, they may imagine lists of numbers — batting averages or life-insurance tables. But the current debate is about how scientists turn data into knowledge, evidence and predictions. Concern has been growing in recent years that some fields are not doing a very good job at this sort of inference. In 2012, for example, a team at the biotech company Amgen announced that they’d analyzed 53 cancer studies and found it could not replicate 47 of them.
Similar follow-up analyses have cast doubt on so many findings in fields such as neuroscience and social science that researchers talk about a “replication crisis”
Some statisticians and scientists are optimistic that Bayesian methods can improve the reliability of research by allowing scientists to crosscheck work done with the more traditional or “classical” approach, known as frequentist statistics. The two methods approach the same problems from different angles.
The essence of the frequentist technique is to apply probability to data. If you suspect your friend has a weighted coin, for example, and you observe that it came up heads nine times out of 10, a frequentist would calculate the probability of getting such a result with an unweighted coin. The answer (about 1 percent) is not a direct measure of the probability that the coin is weighted; it’s a measure of how improbable the nine-in-10 result is — a piece of information that can be useful in investigating your suspicion.
By contrast, Bayesian calculations go straight for the probability of the hypothesis, factoring in not just the data from the coin-toss experiment but any other relevant information — including whether you’ve previously seen your friend use a weighted coin.
Scientists who have learned Bayesian statistics often marvel that it propels them through a different kind of scientific reasoning than they’d experienced using classical methods.
“Statistics sounds like this dry, technical subject, but it draws on deep philosophical debates about the nature of reality,” said the Princeton University astrophysicist Edwin Turner, who has witnessed a widespread conversion to Bayesian thinking in his field over the last 15 years.
Countering Pure Objectivity
Frequentist statistics became the standard of the 20th century by promising just-the-facts objectivity, unsullied by beliefs or biases. In the 2003 statistics primer “Dicing With Death,”Stephen Senn traces the technique’s roots to 18th-century England, when a physician named John Arbuthnot set out to calculate the ratio of male to female births.
Arbuthnot gathered christening records from 1629 to 1710 and found that in London, a few more boys were recorded every year. He then calculated the odds that such an 82-year run could occur simply by chance, and found that it was one in trillions. This frequentist calculation can’t tell them what’s causing the sex ratio to be skewed. Arbuthnot proposed that God skewed the birthrates to balance the higher mortality that had been observed among boys, but scientists today favor a biological explanation over a theological one.
Later in the 1700s, the mathematician and astronomer Daniel Bernoulli used a similar technique to investigate the curious geometry of the solar system, in which planets orbit the sun in a flat, pancake-shaped plane. If the orbital angles were purely random — with Earth, say, at zero degrees, Venus at 45 and Mars at 90 — the solar system would look more like a sphere than a pancake. But Bernoulli calculated that all the planets known at the time orbited within seven degrees of the plane, known as the ecliptic.
What were the odds of that? Bernoulli’s calculations put them at about one in 13 million. Today, this kind of number is called a p-value, the probability that an observed phenomenon or one more extreme could have occurred by chance. Results are usually considered “statistically significant” if the p-value is less than 5 percent.
PhotoThe Coast Guard, guided by the statistical method of Thomas Bayes, was able to find the missing fisherman John Aldridge.Credit Daniel Shea
But there’s a danger in this tradition, said Andrew Gelman, a statistics professor at Columbia. Even if scientists always did the calculations correctly — and they don’t, he argues — accepting everything with a p-value of 5 percent means that one in 20 “statistically significant” results are nothing but random noise.
The proportion of wrong results published in prominent journals is probably even higher, he said, because such findings are often surprising and appealingly counterintuitive, said Dr. Gelman, an occasional contributor to Science Times.
Looking at Other Factors
Take, for instance, a study concluding that single women who were ovulating were 20 percent more likely to vote for President Obama in 2012 than those who were not. (In married women, the effect was reversed.)
Dr. Gelman re-evaluated the study using Bayesian statistics. That allowed him to look at probability not simply as a matter of results and sample sizes, but in the light of other information that could affect those results.
He factored in data showing that people rarely change their voting preference over an election cycle, let alone a menstrual cycle. When he did, the study’s statistical significance evaporated. (The paper’s lead author, Kristina M. Durante of the University of Texas, San Antonio, said she stood by the finding.)
Dr. Gelman said the results would not have been considered statistically significant had the researchers used the frequentist method properly. He suggests using Bayesian calculations not necessarily to replace classical statistics but to flag spurious results.
A famously counterintuitive puzzle that lends itself to a Bayesian approach is the Monty Hall problem, in which Mr. Hall, longtime host of the game show “Let’s Make a Deal,” hides a car behind one of three doors and a goat behind each of the other two. The contestant picks Door No. 1, but before opening it, Mr. Hall opens Door No. 2 to reveal a goat. Should the contestant stick with No. 1 or switch to No. 3, or does it matter?
A Bayesian calculation would start with one-third odds that any given door hides the car, then update that knowledge with the new data: Door No. 2 had a goat. The odds that the contestant guessed right — that the car is behind No. 1 — remain one in three. Thus, the odds that she guessed wrong are two in three. And if she guessed wrong, the car must be behind Door No. 3. So she should indeed switch.
In other fields, researchers are using Bayesian statistics to tackle problems of formidable complexity. The New York University astrophysicist David Hogg credits Bayesian statistics with narrowing down the age of the universe. As recently as the late 1990s, astronomers could say only that it was eight billion to 15 billion years; now, factoring in supernova explosions, the distribution of galaxies and patterns seen in radiation left over from the Big Bang, they have concluded with some confidence that the number is 13.8 billion years.
Bayesian reasoning combined with advanced computing power has also revolutionized the search for planets orbiting distant stars, said Dr. Turner, the Princeton astrophysicist.
In most cases, astronomers can’t see these planets; their light is drowned out by the much brighter stars they orbit. What the scientists can see are slight variations in starlight; from these glimmers, they can judge whether planets are passing in front of a star or causing it to wobble from their gravitational tug.
PhotoAndrew Gelman, a statistics professor at Columbia, says the Bayesian method is good for flagging erroneous conclusions.Credit Jingchen Liu
Making matters more complicated, the size of the apparent wobbles depends on whether astronomers are observing a planet’s orbit edge-on or from some other angle. But by factoring in data from a growing list of known planets, the scientists can deduce the most probable properties of new planets.
One downside of Bayesian statistics is that it requires prior information — and often scientists need to start with a guess or estimate. Assigning numbers to subjective judgments is “like fingernails on a chalkboard,” said physicist Kyle Cranmer, who helped develop a frequentist technique to identify the latest new subatomic particle — the Higgs boson.
Others say that in confronting the so-called replication crisis, the best cure for misleading findings is not Bayesian statistics, but good frequentist ones. It was frequentist statistics that allowed people to uncover all the problems with irreproducible research in the first place, said Deborah Mayo, a philosopher of science at Virginia Tech. The technique was developed to distinguish real effects from chance, and to prevent scientists from fooling themselves.
Uri Simonsohn, a psychologist at the University of Pennsylvania, agrees. Several years ago, he published a paper that exposed common statistical shenanigans in his field — logical leaps, unjustified conclusions, and various forms of unconscious and conscious cheating.
He said he had looked into Bayesian statistics and concluded that if people misused or misunderstood one system, they would do just as badly with the other. Bayesian statistics, in short, can’t save us from bad science.
At Times a Lifesaver
Despite its 18th-century origins, the technique is only now beginning to reveal its power with the advent of 21st-century computing speed.
Some historians say Bayes developed his technique to counter the philosopher David Hume’s contention that most so-called miracles were likely to be fakes or illusions. Bayes didn’t make much headway in that debate — at least not directly.
But even Hume might have been impressed last year, when the Coast Guard used Bayesian statistics to search for Mr. Aldridge, its computers continually updating and narrowing down his most probable locations.
The Coast Guard has been using Bayesian analysis since the 1970s. The approach lends itself well to problems like searches, which involve a single incident and many different kinds of relevant data, said Lawrence Stone, a statistician for Metron, a scientific consulting firm in Reston, Va., that works with the Coast Guard.
At first, all the Coast Guard knew about the fisherman was that he fell off his boat sometime from 9 p.m. on July 24 to 6 the next morning. The sparse information went into a program called Sarops, for Search and Rescue Optimal Planning System. Over the next few hours, searchers added new information — on prevailing currents, places the search helicopters had already flown and some additional clues found by the boat’s captain.
The system couldn’t deduce exactly where Mr. Aldridge was drifting, but with more information, it continued to narrow down the most promising places to search.
Just before turning back to refuel, a searcher in a helicopter spotted a man clinging to two buoys he had tied together. He had been in the water for 12 hours; he was hypothermic and sunburned but alive.
Even in the jaded 21st century, it was considered something of a miracle.
A version of this article appears in print on September 30, 2014, on page D1 of the New York edition with the headline: The Odds, Continually Updated. Order Reprints|Today's Paper|Subscribe