A little over two years ago, I wrote an article called Male Chauvinist Machines. At the time, men outnumbered women in artificial intelligence development roles by about eight to one. A more recent report suggests the ratio is now about three to one.
The problem is not just that men outnumber women. Data mining also presents an issue. If machines mine data from the past (what other data is there?), they may well learn to mimic biases from the past. Amazon, for instance, recently found that its AI recruiting system was biased against women. The system mined data from previous hires and learned that resumés with the word “woman” or “women” were less likely to be selected. Assuming that this was the “correct” decision, the system replicated it.
Might men create artificial intelligence systems that encode and perpetuate male chauvinism? It’s possible. It’s also possible that the emergence of AI will mean the “end of men” in high skill, cognitively demanding jobs.
That’s the upshot of a working paper recently published by the National Bureau of Economic Research (NBER) titled, “The ‘End of Men’ and Rise of Women In The High-Skilled Labor Market”.
The paper documents a shift in hiring in the United States since 1980. During that time the probability that a college-educated man would be employed in a
“… cognitive/high wage occupation has fallen. This contrasts starkly with the experience for college-educated women: their probability of working in these occupations rose.”
The shift is not because all the newly created high salary, cognitively demanding jobs are in traditionally female industries. Rather, the shift is “….accounted for by a disproportionate increase in the female share of employment in essentially all good jobs.” There seems to be a pronounced female bias in hiring for cognitive/high wage positions — also known as “good jobs”.
Why would that be? The researchers consider that “…women have a comparative advantage in tasks requiring social and interpersonal skills….” So, if industry is hiring more women into cognitive/high-wage jobs, it may indicate that such jobs are increasingly requiring social skills, not solely technical skills. The researchers specifically state that:
“… our hypothesis is that the importance of social skills has become greater within high-wage/cognitive occupations relative to other occupations and that this … increase[s] the demand for women relative to men in good jobs.”
The authors then present 61 pages on hiring trends, shifting skills, job content requirements, and so on. Let’s just assume for a moment that the authors are correct – that there is indeed a fundamental shift in the good jobs market and an increasing demand for social and interpersonal skills. What does that bode for the future?
We might want to differentiate here between “hard skills” and “soft skills” – the difference, say, between physics and sociology. The job market perceives men to be better at hard skills and women to be better at soft skills. Whether these differences are real or merely perceived is a worthy debate – but the impact on industry hiring patterns is hard to miss.
How will artificial intelligence affect the content of high-wage/cognitive occupations? It’s a fair bet that AI systems will displace hard skills long before they touch soft skills. AI can consume data and detect patterns far more skillfully than humans can. Any process that is algorithmic – including disease diagnosis – is subject to AI displacement. On the other hand, AI is not so good at empathy and emotional support.
If AI is better at hard skills than soft skills, then it will disproportionately displace men in good jobs. Women, by comparison, should find increased demand (proportionately and absolutely) for their skills. This doesn’t prove that the future is female. But the future of good jobs may be.
What’s harder: physics or sociology?
We tend to lionize physicists. They’re the people who send spacecraft to faraway places, search for extraterrestrial life, and create modern wonders like virtual reality goggles. In short, many of us have physics envy.
On the other hand, we tend to make fun of sociologists. What they’re doing seems to be nothing more than fancified common sense. I once heard a derisive definition of a sociologist: “He’s the guy who needs a $100K federal grant just to find the local bookie.” Few of us have sociology envy.
But is physics really harder than sociology? I thought about this question as I listened to an episode of 99% Invisible, one of my favorite podcasts. The episode, titled “Built to Burn” is all about forest fires and how we respond to them.
We take a fairly simple approach to forest fires: we try to put them out. But this leads to unintended consequences. If we successfully fight fires, the forest becomes thicker. The next fire becomes more intense and more difficult to stop. As one forest ranger puts it: “A fire put out is a fire put off.”
A general question is: Why do we need to put out forest fires? The specific answer is that we need to protect homes and properties and buildings. We assume that we have to stop the fire to protect the property.
But do we? Enter Jack Cohen, a research scientist for the Forest Service. Cohen has studied forest fires intensively. He has even set a few of his own. His conclusion: we can separate the idea of stopping wildfires from the goal of protecting property.
Cohen’s basic idea is a home ignition zone that stretches about 100 feet in all directions around a house. By spacing trees, planting fire resistant crops, and modifying the home itself (no wood roofs), we can protect homes while letting nature takes its course. We no longer have to risk lives and spend millions if our goal is to protect homes.
Cohen has done the hard scientific work. So, can we assume that his ideas have caught on like … um, wildfire? Not so fast. People seem to understand the science but are still reluctant to change their behavior.
Cohen relates a conversation with a friend about the difference between fighting fires and saving homes. It goes something like this:
Friend: “Modifying homes to make them fire resistant isn’t rocket science.”
Cohen: “No. This is much harder. This is social science.”
Friend: “Oh, jeez. We’re screwed.”
Cohen has done the hard science but the hard work remains. As Albert Einstein, the most famous physicist of all, said: “It’s easier to smash an atom than a prejudice.” Perhaps it’s time to develop some sociology envy.
Daniel Kahneman, the psychologist who won the Nobel prize in economics, reminds us that, “What you see is not all there is.” I thought about Kahneman when I saw the videos and coverage of the teenagers wearing MAGA hats surrounding, and apparently mocking, a Native American activist who was singing a tribal song during a march in Washington, D.C.
The media coverage essentially came in two waves. The first wave concluded that the teenagers were mocking, harassing, and threatening the activist. Here are some headlines from the first wave:
ABC News: “Viral video of Catholic school teens in ‘MAGA’ caps taunting Native Americans draws widespread condemnation; prompts a school investigation.”
Time Magazine: “Kentucky Teens Wearing ‘MAGA’ Hats Taunt Indigenous Peoples March Participants In Viral Video.”
Evening Standard (UK): “Outrage as teens in MAGA hats ‘mock’ Native American Vietnam War veteran.”
The second media wave provided a more nuanced view. Here are some more recent headlines:
New York Times: “Fuller Picture Emerges of Viral Video of Native American Man and Catholic Students.”
The Guardian (UK): “New video sheds more light on students’ confrontation with Native American.”
The Stranger: “I Thought the MAGA Boys Were S**t-Eating Monsters. Then I Watched the Full Video.”
So, who is right and who is wrong? I’m not sure that we can draw any certain conclusions. I certainly do have some opinions but they are all based on very short video clips that are taken out of context.
What lessons can we draw from this? Here are a few:
Alabama and Clemson have met each year for the past four years in the college football playoffs. Alabama has won two games; Clemson has won two. The aggregate score of the four games: Clemson 121 — Alabama 120. If Alabama hadn’t missed an extra point in last night’s game, the aggregate score would be tied. The two teams are so close that they might as well be one. Let’s call them Clembama.
Meanwhile, no other team has come close. The great teams of years past – Notre Dame, Oklahoma, Georgia, Southern Cal, Nebraska, and Texas – have all fallen by the wayside. When they match up against Clemson or Alabama, they don’t lose by inches. They lose by yards.
What’s it all mean? Simply that skill is unevenly distributed in college football. As Michael Mauboussin points out, when skill is evenly distributed, luck plays a greater role in the outcome of any competitive event, including sports and business competition. When skill is unevenly distributed, luck’s role is greatly diminished.
It seems counter-intuitive that luck should be more important in some situations than in others. Isn’t luck more or less random? Shouldn’t it apply equally in all situations? It’s true that luck is essentially random but when everything else is even, even a little bit of luck can make a huge difference. A funny bounce, an odd hop, a slippery field can determine who wins and who loses.
To see the difference, just look at the NFL, where skill is more evenly distributed. More specifically, look at Sunday’s game between the Chicago Bears and the Philadelphia Eagles. The Eagles were ahead by one point when the Bears maneuvered into position to kick a field goal near the end of the game. Make the field goal and the Bears win. Miss it and the Eagles win. The Bears kicked, the ball hit an upright, bounced downward, hit the crossbar, and then bounced back into the field of play. A bouncing football is a pretty random thing. If the ball had bounced off the crossbar and through, the Bears would have won. As it was, the Eagles won. In truth, luck – not skill –determined the outcome.
If Oklahoma, say, had made the same kick the last time they played Alabama, it would not have made a whit of difference. The game wasn’t close. The skill levels weren’t close. Luck didn’t matter.
Mauboussin’s paradox of skill states that: “In activities that involve some luck, the improvement of skill makes luck more important…” The paradox makes me feel somewhat humble. My business career was in the highly competitive computing industry, where skill is very widely distributed. As I look back on both my successes and my failures, I wonder how many were caused by skill (or lack of it) and how many were caused by luck. When I won, maybe it was because I was more skilled. Or maybe I just got lucky.
I first wrote about Clembama two years ago. Click here to find that article, which includes several links to Michael Mauboussin’s work.
The Soviet Union collapsed on December 26, 1991. While signs of decay had been growing, the final collapse happened with unexpected speed. The union disappeared almost overnight and surprisingly few Soviet citizens bothered to defend it. Though it had seemed stable – and persistent – even a few months earlier, it evaporated with barely a whimper.
We could (and probably will) debate for years why the USSR disappeared, I suspect that two cognitive biases — false consensus and preference falsification — were significant contributors. Simply put, many people lied. They said that they supported the regime when, in fact, they did not. When they looked to others for their opinions, those people also lied about their preferences. It seemed that people widely supported the government. They said so, didn’t they? Since a majority seemed to agree, it was reasonable to assume that the government would endure. Best to go with the flow. But when cracks in the edifice appeared, they quickly brought down the entire structure.
Why would people lie about their preferences? Partially because they believed that a consensus existed in the broader community. In such situations, one might lie because of:
False consensus and preference falsification can lead to illogical outcomes such as the Abilene paradox. Nobody wanted to go to Abilene but each person thought that everybody else wanted to go to Abilene … so they all went. A false consensus existed and everybody played along.
We can also see this happening with the risky shift. Groups tend to make riskier decisions than individuals. Why? Oftentimes, it’s because of a false consensus. Each member of the group assumes that other members of the group favor the riskier strategy. Nobody wants to be seen as a wimp, so each member agrees. The decision is settled – everybody wants to do it. This is especially problematic in cultures that emphasize teamwork.
Reinhold Niebuhr may have originated this stream of thought in his book Moral Man and Immoral Society, originally published in 1932. Niebuhr argued that individual morality and social morality were incompatible. We make individual decisions based on our moral understanding. We make collective decisions based on our understanding of what society wants, needs, and demands. More succinctly, “Reason is not the sole basis of moral virtue in men. His social impulses are more deeply rooted than his rational life.”
In 1997, the economist, Timur Kuran, updated this thinking with his book, Private Truths, Public Lies. While Niebuhr focused on the origins of such behavior, Kuran focused more attention on the outcomes. He notes that preference falsification helps preserve “widely disliked structures” and provides an “aura of stability on structures vulnerable to sudden collapse.” Further, “When the support of a policy, tradition, or regime is largely contrived, a minor event may activate a bandwagon that generates massive yet unanticipated change.”
How can we mitigate the effects of such falsification? Like other cognitive biases, I doubt that we can eliminate the bias itself. As Lady Gaga sings, we were born this way. The best we can do is to be aware of the bias and question our decisions, especially when our individual (private) preferences differ from the (perceived) preferences of the group. When someone says, “Let’s go to Abilene” we can ask, “Really? Does anybody really want to go to Abilene?” We might be surprised at the answer.