The Royal Observatory stood on a hill overlooking the city, its copper dome green with verdigris and its telescopes pointed toward heavens that remained untroubled by the calculations of men. Lord Peter Ashwick arrived at a quarter to noon and stationed himself beside the great meridian line, where tourists queued to straddle the boundary between the eastern and western hemispheres. It seemed to him a fitting location for a meeting about thresholds and the invisible lines that divide one category of human being from another.
She arrived precisely at noon, a young woman in a severe blue coat and spectacles that failed entirely to conceal the intelligence behind them. She carried a leather satchel pressed tightly against her side, as though it contained something volatile. Her eyes swept the courtyard with the practiced caution of someone who had learned to expect surveillance.
"Lord Ashwick," she said, extending a hand. "My name is Beatrice Webb. I work in the Office of Statistical Oversight. Or rather, I did work there. I resigned this morning."
She was younger than he had expected, perhaps twenty-five, with the pale complexion of someone who spent too many hours under electric light and the precise diction of a woman who had been educated beyond the expectations of her class. Ashwick guided her to a bench overlooking the river, where they could speak without being overheard.
"You said you were a friend of Harold Minter."
"I was the analyst assigned to his file." She spoke the words with the careful neutrality of someone who had been trained to separate emotion from data. "When a citizen's Propensity Score crosses the eighty-percent threshold, their file is transferred to a senior analyst for what is called deep evaluation. Colonel Minter's file came to me six months ago."
"And what did you find?"
Beatrice opened her satchel and withdrew a slim folder. "I found that the algorithm had made a mistake. Not a computational error—the mathematics was flawless. But the variables it had been trained to recognize as indicators of criminal propensity were, in Colonel Minter's case, indicators of something entirely different. It had interpreted his persistence as aggression. His organizational skills as conspiracy. His willingness to challenge authority as anti-systemic hostility. Every quality that had made him an exceptional military officer had been repurposed by the algorithm as evidence of latent criminality."
She paused, her fingers tightening on the folder. "I submitted a report recommending that his score be reduced. My supervisor rejected it. He said the algorithm had been validated by the Ministry's statistical committee and could not be overridden on the basis of individual judgment. He said the system was designed to eliminate human bias, not reintroduce it."
"And what happened to your report?"
"It was destroyed. And I was reassigned to a different portfolio. But I kept copies." She handed the folder to Ashwick. "This contains the original deep evaluation, my dissenting report, and a list of forty-three citizens whose scores exceed eighty percent and who have been referred to something called the Erasure Tribunal."
Ashwick felt the word settle into his mind like a stone dropping into still water. "Erasure."
"The official term is Preemptive Neutralization. The Tribunal has the authority to authorize the removal of individuals whose Propensity Scores indicate an unacceptable risk of future criminality. The method varies, but the outcome is always the same. The individual ceases to exist, and their death is attributed to suicide, accident, or natural causes."
"How many?"
Beatrice looked away, toward the river that glittered in the pale autumn sun. "I have confirmed seventeen cases in the past eighteen months. But the Tribunal has been operating for at least three years. The true number may be considerably higher."
Seventeen. Seventeen human beings reduced to statistical liabilities and quietly erased. Seventeen deaths recorded as suicides or accidents or overdoses, each of them tidily explained and filed away. And Harold Minter had been number eighteen—or would have been, if Beatrice's dissenting report had not already marked him for something worse.
"There is something else," said Beatrice. "Something I discovered only yesterday, when I was clearing my desk. The algorithm is not static. It is being retrained on new data, and the new data includes the outcomes of Tribunal decisions. Every time someone is neutralized, the algorithm incorporates that outcome into its calculations. It is learning to be more efficient. More aggressive. The latest iteration has begun flagging individuals whose scores are as low as sixty percent, on the grounds that they may influence others to commit crimes."
"A multiplier effect," said Ashwick. "It is no longer merely identifying potential criminals. It is identifying anyone who might, through association or influence, contribute to the criminality of others."
"Exactly. And the pool of eligible targets is expanding exponentially. At the current rate of escalation, within five years, one in every twelve citizens will be classified as a Potential Incipient Offender. Within ten years, the algorithm will have effectively criminalized dissent, protest, and any form of organized opposition to government policy."
Ashwick thought of the clerks he had watched that morning in the Ministry courtyard, each of them hurrying about their business without the faintest suspicion that their futures were being calculated in a windowless room somewhere above them. He thought of the tourists queuing at the meridian line, laughing as they straddled the hemispheres, unaware that a far more significant boundary was being drawn through their lives by a machine that never laughed and never slept.
"I need to see the Tribunal in session," he said. "Can you arrange it?"
Beatrice hesitated. "It is not open to the public. The proceedings are classified under the Official Secrets Act. Anyone who attends without authorization is subject to immediate detention."
"Then I shall require an invitation from someone who is authorized. Who sits on the Tribunal?"
"The membership is classified, but I have been able to identify three individuals. Sir Angus Coldwell, the Permanent Secretary for Public Order. Dame Marguerite Holloway, the Chief Psychiatric Advisor to the Ministry. And Professor Leopold Crane, the mathematician who designed the original algorithm."
"Coldwell," said Ashwick. "I have met him. He delivered a lecture at the Royal Society last year on the statistical foundations of modern governance. He argued that human judgment was an obsolete instrument, a relic of a pre-scientific age, and that all policy decisions should be delegated to algorithmic systems that could process information without the distortions of emotion or self-interest."
"I was at that lecture," said Beatrice. "I remember thinking that he spoke of human beings as though they were inconvenient interruptions to the smooth functioning of his equations."
"Then we must disrupt his equations." Ashwick rose from the bench and offered Beatrice his arm. "Miss Webb, I am about to ask you to do something that may increase your own Propensity Score considerably. You are, of course, at liberty to refuse."
"I resigned my position this morning," she said. "I believe my score is already being recalculated. What do you require?"
"Information. Everything you know about the Tribunal's meeting schedule, its location, and its security protocols. And the list—the complete list of everyone whose file has been referred for evaluation. I need to know who else is at risk."
They walked together down the hill toward the city, and as they walked, Beatrice talked. She described the Office of Statistical Oversight as it appeared from the inside: a converted warehouse in the industrial district of East Aldwich, its exterior deliberately nondescript, its interior a labyrinth of cubicles and server rooms where analysts sat in silent concentration, feeding data into the algorithm and receiving its judgments with the passive acceptance of priests interpreting auguries. She described the culture of the place—the institutional conviction that they were engaged in a noble enterprise, that they were pioneers of a new science of justice, and that any moral qualms were merely evidence of insufficient training in statistical reasoning. And she described the moment when she had first understood that the algorithm was not predicting crime but creating it, by defining dissent as a form of incipient criminality and then eliminating those who dared to disagree.
"The most frightening thing," she said, as they reached the embankment and paused to watch a barge making its slow way downstream, "is not that the system is evil. It is that the system is logical. Every step follows rationally from the one before it. The offset that Colonel Minter challenged was perfectly legal. The algorithm that calculated his score was mathematically sound. The Tribunal that authorized his neutralization was following procedures that had been approved by the highest levels of government. There is no villain in this story, Lord Ashwick. There is only a chain of reasoning that has led, with impeccable logic, to the conclusion that some people must be erased for the greater good."
"Impeccable logic," said Ashwick, "is not the same as justice. The greatest crimes in human history have been committed by people who were merely following the logic of their premises."
That evening, he sat alone in his study, the folder of documents spread before him like the pieces of a puzzle that formed an intolerable picture. Forty-three names. Forty-three human beings whose lives hung in the balance of an equation. And somewhere in the city, in a converted warehouse in East Aldwich, the algorithm was processing new data, refining its calculations, and preparing to deliver its next set of recommendations to the Erasure Tribunal.
Bunter entered with the evening post. Among the bills and invitations was a plain envelope bearing no return address. Inside was a single sheet of paper, typed in the same precise font that Ashwick had seen on the suicide note in Harold Minter's study. The message was brief:
"Your inquiry has been noted. Your score is being calculated. The Tribunal will consider your case at its next session. You are advised to cease your investigation immediately. This is your only warning."
Ashwick read the message twice, then placed it carefully on the desk beside the folder of documents. The machine had noticed him. The ledger was being updated. And somewhere, in a room without windows, a committee was preparing to decide whether he, too, was surplus to the requirements of a perfectly logical world.
He rang for Bunter. "I shall be going out this evening. Please lay out my dinner jacket. And Bunter—"
"My lord?"
"Pack a bag. We may be traveling unexpectedly."
Bunter's expression did not waver. "Very good, my lord. And may I inquire as to our destination?"
"East Aldwich," said Ashwick. "I believe it is time I paid a visit to the Office of Statistical Oversight. I wish to see the machine that has calculated my worth and found it insufficient."
No comments yet. Be the first to comment!