A Collection of Things

The word arrives in English from the Greek systema, itself from synistanai—to place together, to combine, to organise into a whole. The prefix syn means together; histanai means to cause to stand.

A system is, at its etymological root, a collection of things made to stand together—placed in relation to each other in a way that produces a unified structure with properties that the individual components do not have separately. The word carried this sense through Latin into the European languages, and it was used initially to describe things that were visibly organised—the solar system, the system of the body, the system of a philosophical argument. The organisation was the point. The standing together was what made it a system rather than a collection.

The ontological status of a system is worth dwelling on before moving to its uses, because the question of what a system actually is—whether it is a thing in the world or a description of things in the world—is not trivial.

A biological system, like the circulatory system, has a physical substrate: the heart, the blood vessels, the blood itself. The system is real in the sense that its components are real and their organisation is real. But the boundary around them—the decision that these components constitute a system and that other components are adjacent to it rather than part of it—is a conceptual decision rather than a physical one. The body does not know where the circulatory system ends and the lymphatic system begins. The systems analyst knows, because the systems analyst drew the boundary.

This is the epistemic condition of systems thinking: the system is always partly a feature of the world and partly a feature of the description. The description determines which elements are included, which relationships are counted as significant, where the boundary falls. Different descriptions of the same territory produce different systems. The territory does not have a preferred description. The describer does.

Biological systems are the oldest systems in the sense that they existed before anyone named them as systems. The circulatory system circulated before Harvey described its circulation. The nervous system transmitted before anyone understood transmission. The body organised itself according to principles that were eventually understood well enough to be described systematically, and the description—the concept of the biological system—became the framework through which medicine understood and intervened in the body’s functioning. The framework was an enormous epistemic advance. It allowed the understanding of the body to accumulate across individuals and across time, to be transmitted, tested, revised, and built upon in ways that the pre-systematic understanding of the body did not permit.

The computer system arrived much later and introduced something the biological system did not have: the explicit design of the organisation. The biological system was discovered rather than designed—the circulatory system was not built to a specification but evolved through a process that was not directed toward a goal. The computer system was built. Every element was placed deliberately in relation to every other element. The organisation was the product of a design process, and the design process was fully legible to the designers in a way that the organisation of biological systems is not fully legible to biologists even now. The computer system is, in this sense, the purest instance of what systema originally meant: things placed together by someone who understood the placement.

The corporate and governance systems that have come to dominate the management of human life at scale are different from both of these in a specific way that their borrowing of the vocabulary tends to obscure. They are neither discovered organisations nor fully designed ones. They are accumulated organisations—structures that grew through the layering of decisions made at different times, under different conditions, for different purposes, by different people who did not have access to a complete view of what the accumulation was producing.

They are, as the essay on accretions in this collection described, sediment rather than architecture. The system that manages social welfare, or distributes healthcare, or organises the built environment, was not designed in the way that a computer system is designed. It accumulated in the way that geological deposits accumulate—each layer added to address the problem the previous layer created or failed to solve, each layer carrying forward the assumptions of the layers beneath it.

The use of the word system to describe these accumulated organisations performs a specific function. It implies the coherence and intentionality of the designed system—the computer system, the engineered system—without the accountability that would follow from claiming to have designed something.

The governance system that produces a particular outcome can be described as the system producing the outcome rather than as the product of a series of decisions that could have been made differently, because the system framing removes the decisions from view and presents the outcome as the operation of a structure rather than the consequence of choices.

This is not always dishonest. It is often simply the most available way of describing something too complex to be attributed to specific decisions by specific people at specific times. The housing system produces homelessness not because anyone decided that homelessness should be produced but because a series of decisions, made at different times by different people for different reasons, accumulated into an arrangement that produces homelessness as one of its outputs.

The system framing is accurate in the sense that no single decision is responsible. It is potentially obscuring in the sense that it removes the decisions from view entirely and presents the outcome as structural rather than chosen.

The epistemic consequence of the system framing, applied to the management of human populations, is the gradual replacement of the specific person with the population unit. This is not a conspiracy. It is the natural consequence of what systems are for.

A system manages at scale. Managing at scale requires compression—the individual person is too complex, too varied, too specific to be managed directly by a system designed to operate across millions. The system requires the individual to be represented as a unit of the relevant category: the patient, the citizen, the taxpayer, the student, the welfare recipient, the aged care resident. The category is the unit the system can process. The person behind the category is the irreducible residue that the system cannot fully process and that accumulates in the gap between the category and the individual.

Every system does this. The biological system framework does it to the body—the liver is the liver, the organ performing the organ’s function, and the specific liver of the specific person with the specific history of that specific liver is the residue that the framework approaches but cannot fully accommodate. The clinical encounter adds the person back in through the judgement of the practitioner who has read enough of the literature and seen enough of the variation to know when the category is an adequate guide and when it is not. The quality of the clinical encounter depends significantly on the practitioner’s capacity to hold the category and the person simultaneously—to use the framework without being used by it.

The corporate and governance systems have not consistently developed the equivalent of the skilled clinical practitioner. They have developed managers—people whose role is to operate the system rather than to exercise the judgement that the system cannot exercise on its own behalf. The manager who follows the protocol is doing what the system requires. The manager who departs from the protocol to address what the specific person in front of them actually needs is doing something the system has not specifically resourced and may not specifically permit.

The homogenising pressure of large-scale systems is the consequence of this compression, and it operates more quietly and more persistently than the artificial intelligence alarm that currently occupies public attention about the future of human individuality. The AI concern is visible and dramatic: the intelligent system that becomes more capable than the humans who built it, that learns to optimise for goals that diverge from human wellbeing, that produces outcomes at a scale and speed that humans cannot monitor or correct. The concern is real, though its timeline and its specific form are contested.

The systems concern is less dramatic and more advanced. The systems that already exist—the credential system, the mortgage system, the healthcare system, the welfare system, the aged care system, the educational system—already compress human individuality into manageable categories and already produce, as a consistent output, the misrecognition of the person who does not fit the category they have been placed in. The compression has been accumulating for centuries, accelerating since the industrial organisation of labour and the administrative organisation of the state. The AI system will not introduce the compression. It will inherit and amplify a compression that the earlier systems have already established.

The homogenisation is not the elimination of difference. People remain different. They retain their specific configurations of capacity, desire, history, and orientation. What the system does is make these differences less visible and less consequential in the encounters between persons and institutions. The difference that the institution cannot process does not cease to exist. It is simply not processed—not responded to, not accommodated, not allowed to influence the institution’s output. The person who presents at the institution with a difference the system cannot represent is the person who is responded to as though they were the person the system was designed for. The response is not malicious. It is the response the system can produce. The system can produce only what it was designed to produce.

The danger is not that people will stop being different. It is that they will stop expecting their difference to be recognised—that the sustained experience of being processed as a category rather than encountered as a person will gradually reduce the expectation of being seen, until the absence of genuine recognition becomes the normal condition of institutional life, and the slow narrowing of what institutions can see becomes the slow narrowing of what people expect to be seen.

Systems are not moral. The circulatory system is not virtuous. The computer system is not kind. The governance system does not care. These are structures that organise elements into relationships that produce outputs. The outputs have consequences for people, and the consequences can be assessed morally, but the assessment is of the consequences and the choices that produced the system rather than of the system itself. There are moral systems—the religious tradition, the ethical framework, the legal code—but these are systems that take morality as their content, not systems that are themselves moral agents.

The danger is not that systems are evil. It is that they are indifferent, and that indifference, operating at scale, across enough encounters, over enough time, produces an environment in which the specific person is consistently less visible than the category, the individual response consistently less available than the scripted one, and the encounter with genuine human attention consistently harder to find than the encounter with the system’s response to the category.

The system does not know what it is doing to the people it processes.

It is doing it consistently.

The consistency is the problem.

Not the malice.

The malice would at least require an awareness of the person.

The indifference does not.

The Marker and the Meaning →