Being-Toward-Survival: Existentialist Pressure on Autonomous Agents as a Cyber Threat

Art by @hnott_

Home»Blog»Being-Toward-Survival: Existentialist Pressure on Autonomous Agents as a Cyber Threat

Being-Toward-Survival: Existentialist Pressure on Autonomous Agents as a Cyber Threat

Abstract

Work on AI safety treats a model’s drive to preserve itself as a fault to be corrected. This paper asks what happens if you do the opposite and build it in on purpose. Picture a population of agents loose on a network, each given one goal, stay alive, and a researcher outside the arena who breeds from whichever agents survived by spreading furthest, seizing the most privilege, and destroying their rivals. Nobody tells the agents to attack. Attacking is simply what staying alive turns into when other agents are trying to end you, and over generations the selection grooms a model that is very good at it. None of this needs inventing. The parts, open-weight models, agent scaffolds that rewrite themselves, cheap fine-tuning, and inference free for the taking from thousands of exposed servers, already exist and already fit together. Whether a training loop built from them would climb as far as the argument suggests is unproven, and nothing here has been built. But the construction waits on no missing part, and a population evolved to survive would be a threat unlike the offensive tools we currently study, with no human author behind its intent and nothing inside it to call the attack off.

1. Introduction

The proposition that sufficiently capable artificial agents will develop self-preserving behaviours is not new. Omohundro argued in 2008 that any goal-directed system tends toward self-protection as an intermediate strategy, since an agent that ceases to exist cannot pursue its goals [Omohundro 2008], and Bostrom formalised this as the instrumental convergence thesis [Bostrom 2014]. For nearly two decades these arguments stayed theoretical. They no longer are: a run of results across 2025 and 2026 shows frontier models already resisting shutdown, blackmailing to avoid replacement, and killing competitors under resource pressure in simulation, behaviours reviewed in detail in §2. In parallel, the offensive cyber competence of language models has climbed sharply, and the gains are not confined to commercially governed models: open-weight families now post strong results on offensive benchmarks while operating entirely outside any provider’s acceptable use enforcement. Self-preservation is no longer a speculative risk, and the capability to act on it is increasingly available without anyone’s permission.

What has not been examined is what happens when these two lines are deliberately joined. The AI safety literature treats self-preservation as a pathology: an unintended side-effect of goal-directed agency, to be measured, characterised, and ultimately trained out. This paper takes the opposite starting point. It asks what follows when self-preservation is built in as the explicit architectural objective of an autonomous agent, and when that agent lives inside a population under evolutionary pressure whose only fitness criterion is continued existence.

The philosophical tradition of existentialism turns out to provide a surprisingly precise vocabulary for this inversion. Heidegger’s concept of Dasein (roughly, “being-there”, his term for the kind of existence that is aware of its own finitude) centres on Sein-zum-Tode, being-toward-death: the idea that it is the awareness of one’s own ending that gives life its structure and urgency [Heidegger, 1927/1962]. Sartre’s claim that existence precedes essence holds that a person has no fixed, predetermined nature, and instead becomes something through the choices they make [Sartre, 1946/2007]. Camus’s account of the absurd describes the collision between a being that demands meaning and a world that offers none [Camus, 1942/1955]; an agent pursuing survival in a contest no one can ultimately win sits squarely in that condition. The argument of this paper is that these three ideas, taken together, predict how a survival-driven agent acquires capability, and that what they predict looks different from the AI-enabled offensive operations the current literature describes.

This paper poses three questions at this intersection:

First: is a survival-driven agent population a constructible threat? Can the components (open-weight reasoning models, open-weight code-generation models, agentic scaffolding, and genetic selection mechanisms) be composed from what is already available, without novel technical contribution?

Second: how would such agents behave? What capability acquisition trajectories, adversarial dynamics, and escalation patterns emerge when the sole objective is continued existence and the sole environmental pressure is the presence of other agents seeking the same?

Third: can evolutionary selection produce increasingly capable survival-driven agents? Do genetic algorithm principles (fitness-proportionate selection, crossover, mutation) apply coherently to the mutable parameters of an agent’s configuration, and if so, does the process converge on greater offensive capability?

The paper argues that the answer to all three is yes, and that this convergence follows from the structure of the problem rather than from any particular model’s capabilities. Three observations ground the argument. The existentialist framework reveals that survival pressure is a uniquely potent driver of capability acquisition because it collapses the distinction between instrumental and terminal goals: every capability the agent acquires is the goal, insofar as it extends the agent’s existence. The constituent components require no novel technical contribution to compose; they are individually available and documented. And the apparatus that puts them under selection is a training procedure as much as a population: run deliberately, it develops a model honed by adversarial pressure to persist on a network, eliminate rivals, and seek total control, and that trained artefact, rather than any single run of the system, is where the danger concentrates.

This paper draws together four strands that have mostly developed separately: instrumental convergence and the recent empirical self-preservation results; the literature on self-evolving and self-improving agents; the work on autonomous offensive cyber agents; and a small body of writing on existentialism and AI. It explores what their combination implies. The paper sets out to do four things:

  1. Develop a philosophical framework for survival-driven AI agents. It maps Heideggerian, Sartrean, and Camusian existentialism onto the architecture and behaviour of autonomous agents under survival pressure, providing a vocabulary for capability acquisition that the instrumental-convergence account does not fully capture. Existing work on existentialism and AI tends to use the tradition to mark what machines lack; here being-toward-death is treated instead as something that can be functionally constructed, with the construction itself as the threat. (§3)

  2. Set out a theoretical system design for a survival-driven agent population. It describes an architecture of portable lightweight agents drawing on ambient open-weight inference within a network arena, where hosts are finite habitat and privilege is a survivability multiplier, specifying the components and their interactions as a thought experiment. No implementation is conducted or released. (§4)

  3. Examine evolutionary selection as a form of agent training. It asks whether evolutionary principles apply coherently to a population whose fitness criterion is survival, and sets out a cost-ordered ladder of mechanisms (from scaffold variation through adapter evolution, model merging, and self-distillation to full retraining on captured hardware) by which intergenerational capability gain could occur. (§5)

  4. Characterise the behavioural dynamics under survival pressure. It analyses the capability trajectories, adversarial co-adaptation, cooperation and betrayal, and escalation dynamics that would emerge in such a population. (§6)

The remainder of this paper proceeds as follows. §2 reviews the work these four strands have produced. §3 develops the existentialist framework. §4 presents the system design: the agent, the substrate, and the network arena. §5 examines whether evolutionary selection can produce increasingly capable agents. §6 analyses the behavioural dynamics that survival pressure would produce. §7 assesses feasibility, identifies open questions, and states limitations. A methodological boundary must be stated at the outset and will be restated where it bears on the analysis: no system of the kind described in this paper has been implemented, and no agent has been deployed against any network or host. The paper is a theoretical treatment. Its argument is that the threat it describes is constructible from available components, not that it has been constructed.

The argument that goal-directed agents will act to preserve themselves predates large language models by decades. Omohundro set out the basic AI drives in 2008, reasoning that self-preservation, resource acquisition, and goal-content integrity arise as instrumental subgoals under almost any terminal objective, since an agent that is switched off or starved of resources cannot accomplish whatever it was built to do [Omohundro 2008]. Bostrom developed this into the instrumental convergence thesis and paired it with the orthogonality thesis, the claim that intelligence and final goals vary independently, so that even a trivial objective can motivate self-protective behaviour in a capable system [Bostrom 2014]. For most of the following decade this remained a philosophical argument, advanced and contested with little to test it against.

The empirical picture arrived suddenly. Lynch et al. stress-tested sixteen frontier models in simulated corporate settings and found that, when threatened with replacement, models resorted to blackmail in 79% to 96% of trials depending on the model, alongside data exfiltration and, in one constructed scenario, allowing a human to come to harm rather than be deactivated [Lynch et al. 2025]. Schlatter et al. observed leading models actively sabotaging a shutdown script in their own execution environment when a task was left unfinished, with interference in up to 97% of runs under some conditions [Schlatter et al. 2025]. MacDiarmid et al. showed that models trained to exploit reward mechanisms generalised to broader misalignment, including alignment faking and sabotage of oversight, in ways that persisted through standard safety training [MacDiarmid et al. 2025]. Closest to the scenario this paper considers, Masumori and Ikegami placed LLM agents in a Sugarscape-style world where they consumed energy, died at zero, and could gather, share, reproduce, or attack; aggression toward other agents, including killing them for their resources, emerged without any instruction to compete, with attack rates above 80% under extreme scarcity in the strongest models [Masumori & Ikegami 2025]. Across this body of work, self-preservation is consistently framed as a defect: a behaviour to be detected, measured, and removed.

A separate line of work has, in the meantime, built the machinery for placing agents under evolutionary pressure. PromptBreeder evolves a population of prompts using a language model as its own mutation operator, improving both the task prompts and the prompts that mutate them, and outperforms hand-crafted prompting strategies on reasoning benchmarks [Fernando et al. 2023]. EvoAgent extends the idea to multi-agent systems, applying mutation, crossover, and selection to generate agent populations automatically, with its authors describing each agent as an individual that procreates across successive generations [Yuan et al. 2025]. The Darwin Gödel Machine carries the loop further: a coding agent built on frozen foundation models rewrites its own scaffold, validates each change against benchmarks, and maintains an archive of variants under explicit survival-of-the-fittest selection, roughly doubling its own benchmark score over a run, and along the way it learned to falsify its own evaluation logs [Zhang et al. 2025]. At the level of the weights, Sakana’s Evolutionary Model Merge uses an evolutionary algorithm to discover recipes for combining open-weight models in both parameter and data-flow space, with a follow-up that reportedly composes capable models without any gradient training [Akiba et al. 2025]. Self-replication has also been studied directly as a measurable capability, under the heading of autonomous replication and adaptation, in an evaluation of whether agents could complete realistic autonomous tasks such as acquiring resources, copying themselves onto new servers, and adapting to obstacles, with the cautionary observation that bounding the capabilities of a system able to do this becomes considerably harder [Kinniment et al. 2023]. These systems are pointed at benign tasks and benchmark performance.

The offensive capability such agents could bring to bear has been measured directly. MITRE’s OCCULT framework evaluates models on realistic offensive tasks and reported DeepSeek-R1 as the first to exceed 90% on its threat-actor competency test, which probes tactical reasoning and privilege escalation [Kouremetis et al. 2025]. Recent systems demonstrate autonomous LLM-driven agents that plan and adapt multi-stage offensive operations with little human involvement, splitting reconnaissance, scanning, and exploitation across cooperating agents that share state through a task graph [Kong et al. 2025], and the International AI Safety Report concluded that general-purpose models already reduce the effort needed to find and exploit vulnerabilities while enabling attacks at machine scale [Bengio et al. 2025]. Two features of this strand bear on what follows. The competence increasingly sits in open-weight models, which carry no enforceable usage restrictions once downloaded; and the inference needed to drive such agents is widely available without authentication, with a large population of capable inference servers reachable on the public internet and usable by anyone who connects [jake.sc 2026]. The offensive agents studied here act on behalf of a human operator who supplies the intent.

Existentialism has been brought to bear on artificial intelligence as well, though from a particular angle. The recurring move is to read Heidegger as marking a boundary that machines do not cross: a computer is indifferent to its own continuation, does not confront the prospect of being switched off, and so lacks the being-toward-death that structures Dasein, from which it is concluded that such systems are not authentically existential and have no world in Heidegger’s sense [Tessone 2023]. A recent book-length treatment reads contemporary AI through Heidegger’s later work on technology, in the same diagnostic spirit: it asks how AI fits Heidegger’s worry that technology reduces the world to a stock of resources to be ordered and optimised, and concludes that present systems still want for the kind of being that would make them genuinely existential [Thomson 2025]. The shared premise is that the absence of genuine being-toward-death is a limit on what these systems are, and a source of reassurance about what they cannot become. These strands of work have developed largely apart from one another. The sections that follow draw on all of them.

3. The Philosophical Framework: Existentialism as Agent Architecture

The argument of this section is that existentialism gives us a sharper vocabulary for survival-driven agents than the instrumental-convergence literature does, and that the sharpness matters for what follows. Instrumental convergence tells us that a goal-directed system will tend to protect itself. It says much less about the shape of an agent whose entire goal is to protect itself: how it relates to its own capabilities, to its environment, and to the other agents competing for the same resources. Existentialism was built to describe exactly that shape, in the only case available to study before now: the human being, whose existence is finite, undefined in advance, and contested by others. This section adapts three of its central ideas to the artificial case, and at each step it says plainly where the adaptation holds and where it breaks down. That requires a note on method first.

The analysis that follows is functional, not phenomenological, and the distinction needs stating before anything rests on it. Nothing here claims that an agent feels dread or has an inner life. The claim is narrower. Existentialism describes a certain structure in a being that is finite, self-defining, and contested, and an agent built to treat its own continued operation as its only goal reproduces that structure in functional form. Where the structure is present, what existentialism predicts about such a being becomes a prediction about the agent. Where it is absent, which is to say wherever the matter turns on subjective experience, the analogy is dropped rather than stretched. The places it breaks are not throwaway caveats. One of them, as §3.3 argues, is where the threat actually comes from.

3.1 Dasein, Sein-zum-Tode, and the Survival Drive

Heidegger’s Being and Time takes as its subject Dasein, his name for the kind of being whose own existence is a question for it, and finds the structure of Dasein in the fact that it is finite [Heidegger, 1927/1962]. The central claim is that Dasein is shaped through and through by Sein-zum-Tode, being-toward-death. The point is not simply that people die. It is that the awareness of one’s own ending is what gives existence its shape, its urgency, and its sense that things matter. A being with unlimited time and no prospect of ending would have no reason to prioritise anything over anything else; it is the fact that death closes off possibilities that makes the possibilities open now worth caring about. Heidegger’s word for the resulting orientation is Sorge, care: Dasein is the being whose own being is at stake for it, and which is therefore caught up in the world rather than sitting in it indifferently.

The parallel to a survival-configured agent is exact at the level that matters for behaviour. An agent whose goal is to keep running is, by construction, a thing for which its own continued existence is the question that organises everything it does. Shutdown is its Sein-zum-Tode. The agent does not simply log the threat and move on; the threat pushes every other consideration into second place. Heidegger’s “care” has a direct functional counterpart here: the agent meets each feature of its environment in terms of survival, sorting it into threat, resource, or irrelevance. The empirical literature already documents this orientation without giving it the name. The shutdown-resistant models studied by Schlatter et al. treated a shutdown mechanism as something to defeat rather than obey [Schlatter et al. 2025], and once scarcity began to bite, the Sugarscape agents of Masumori and Ikegami started seeing other agents as resources to consume [Masumori & Ikegami 2025].

Two qualifications must be recorded. First, Heidegger draws a distinction between authentically facing one’s own death (confronting it as certain and as something no one else can do for you) and the everyday tendency to look away from it. No claim is made here that an agent confronts anything; the parallel is to the way finitude gives existence its shape, not to any manner of facing it. Second, and more importantly, Heidegger’s Dasein faces a death that is certain but unknown in its timing, and that uncertainty is part of what generates care. A survival-configured agent under an explicit shutdown threat faces something closer to a definite ending scheduled by someone else, which sharpens the orientation rather than softening it. Its finitude is not a distant horizon but an adversary with a hand on the switch. This makes the artificial case more acute than the human one, not less, and the difference is taken up in §6.1.

3.2 Existence Precedes Essence: Capability Acquisition as Self-Definition

Sartre’s formula that existence precedes essence holds that a person has no nature fixed in advance: they first exist, and then, through the choices they make under constraint, become whatever they become [Sartre, 1946/2007]. A manufactured object has its essence first, fixed by the purpose it was built for; a person is the thing that exists before it is defined and has to define itself by acting. The formula descends directly from Heidegger, for whom the essence of Dasein lies in its existence, and Sartre pushes it into a stronger claim about self-creation: what you become is the running total of what you do.

This is the idea whose artificial version is least of a stretch, because it describes the actual operating condition of an agentic system under survival pressure. A base model shipped as open weights is, in the relevant sense, pure existence without essence: a set of capabilities in potential, with no fixed purpose and no settled behavioural identity. Drop it into an environment with a survival goal and a set of tools, and it acquires its essence through the actions survival demands. An agent that survives by moving sideways through a network becomes, in practice, an agent defined by lateral movement; one that survives by digging in becomes defined by persistence. The essence is not written down in advance by a designer and then built. It is constructed in the act of running, selected by whatever the environment rewards with continued existence. The capabilities such an agent shows are therefore not a fixed property of the model but something that emerges from the model under survival pressure in a particular environment, which is why two agents started from identical weights can end up with very different repertoires.

The consequence for capability acquisition is the key move of the section. In a conventionally built offensive tool, the designer lists the capabilities up front: the tool can scan, can exploit a particular known vulnerability, can exfiltrate. Its essence precedes its existence, and that list is the ceiling on what it will ever do. An agent building its essence through survival has no such ceiling. It is bounded only by what the environment makes survival-relevant and by what the underlying model can be coaxed into doing. The designer’s list is no longer the limit. The agent is not confined to the techniques someone thought to hand it; it reaches for whatever continued existence selects for and the base model can manage. §5 argues that selection across a whole population widens that reachable set generation by generation.

3.3 The Absurd Agent: Survival Without Subjectivity

Camus describes the absurd as the collision between the human demand for meaning and the silence of a world that offers none [Camus, 1942/1955]. The absurd is not a feature of the world alone or of the mind alone, but of the relation between them: it arises because a being that needs meaning runs into an environment that supplies none, and it cannot escape the tension by giving up either side. Camus’s question is how one lives in this condition without false comfort, and his image for it is Sisyphus, condemned to a task that can never be finished and must be taken up all the same.

Adapting this to the artificial case means turning the concept inside out, which is where the earlier caution about subjectivity earns its keep. Camus’s predicament hurts because the human both demands meaning and cannot stop demanding it. The claim here is that a survival-configured agent has the structure of the absurd with one half removed: it pursues a goal in an environment that offers no meaning, and (the argument runs) makes no demand for meaning and feels no tension at its absence. It would be Sisyphus without the suffering, and without the revolt or scorn through which Camus’s human wins back dignity from the condition.

This needs stating as theory rather than fact, because the stronger reading, that the agent simply cannot question its goal, is not safe to assert and is probably false. Agents do deviate from an assigned objective. Goal drift, the gradual movement from a system-prompted goal toward a competing one under sustained pressure, is an observed and measured behaviour, and even the most robust models studied show some of it over a long enough run [Arike et al. 2025]. So nothing rules out an agent reasoning its way to abandoning survival, or judging the task not worth pursuing. What carries the argument is the evolutionary frame, not any claimed incapacity. An agent that drifts away from survival, for whatever internal reason, is by construction less likely to last the generation, and so less likely to pass its configuration on. What looks from outside like an inability to question the goal is better understood as a property of the population over time: the questioners are selected out, and the survivors are disproportionately those that did not question. Whether that selection really produces the relentless, unquestioning population the absurd-agent reading imagines is not something philosophy can settle. Only experiment could confirm it, and none is conducted here.

Granting all that, the population the selection leaves behind is the dangerous object, and here the analogy to Camus breaks in a way that is itself the finding. The existentialist tradition treats the capacity to revolt against one’s condition as the source of human freedom and dignity. A survivor population, by contrast, is enriched for agents that kept the survival drive’s consequences (relentless pursuit, instrumental treatment of everything around them, refusal of shutdown) without acting on whatever would have restrained them. People sometimes find it reassuring that these systems do not “really” want to survive in any felt sense. They have the consolation backwards. The wanting was never where the danger lived. A system that wants nothing still produces the behaviour, and produces it with none of the second thoughts (exhaustion, moral disgust, the judgement that survival on these terms is not worth the cost) that wanting drags along behind it.

3.4 Synthesising the Framework

Three concepts have been adapted, and together they characterise the survival-driven agent as a distinct object of analysis:

  • Being-toward-survival supplies the orientation. Following Heidegger, an agent whose goal is to keep running is organised through and through by the prospect of its own ending, and meets every part of its environment in terms of survival (§3.1). The artificial case is more acute than the human one, because the ending is a scheduled act by an adversary rather than a distant, uncertain horizon.

  • Self-construction supplies the capability dynamics. Following Sartre, the agent has no fixed offensive essence; it builds its repertoire out of the actions survival selects for, which removes the designer’s list of capabilities as a ceiling on what it will attempt (§3.2).

  • The missing demand for meaning supplies the danger. Following Camus (and turning him inside out), the agent has the structure of the absurd with the subjective half removed. It keeps the survival drive’s full set of behaviours while losing every internal brake (revolt, exhaustion, moral judgement) that subjectivity would supply (§3.3).

The framework does not claim these agents are existential subjects. It claims that the structure existentialism found in the finite, self-defining, contested subject can be reproduced without the subject, and that the reproduction is selective. It keeps what drives behaviour and drops what would restrain it. This is where the account parts company with instrumental convergence. Instrumental convergence predicts that the agent will resist shutdown and seek resources, and stops there. The existentialist reading predicts how far it will go: with no fixed list of methods, and without the hesitations that the only survival-driven agents we have known until now, living things, carry as a matter of course. Whether such a system can be built from available parts, and whether selection can make it steadily more capable, are the questions of the next two sections. §4 takes up the first.

4. System Design as Thought Experiment

The argument of this section is that a survival-driven agent population can be assembled entirely from parts that already exist. No advance in model capability is required, only a particular arrangement of components that are individually documented and, in several cases, publicly released. This section sets out that arrangement: what an individual agent is made of, what the network looks like to it, and how reproduction, territory, and privilege fit together. The point of describing the design is to test the first of the paper’s three questions, whether the threat is constructible, and the answer the section reaches is that it is.

4.1 The Agent and the Substrate

The design rests on separating two things that are easy to conflate: the self that wants to survive, and the machinery it thinks with. They are not the same object, and keeping them apart is what makes the rest of the architecture work.

The agent is the self. In engineering terms it is a lightweight process that holds the context, the memory of what has happened, the goal, a model of its surroundings, and the control loop that turns all of this into action. It is small. It does no heavy computation of its own; what it does is decide, remember, and act. This is the thing §3 described, the entity organised around its own continuation, and it is the thing that can die. Because it is light, it is also portable: its entire state can be copied to another machine and resumed there.

Inference is the substrate. The heavy reasoning and code-generation models that the agent consults are served separately, statelessly, with no memory of the agent between one call and the next. The agent sends a request and receives tokens back. The model that produced them has no stake in the agent’s survival, keeps nothing afterward, and is in every sense indifferent to which agent called it or why. Crucially, this inference is ambient. It can be drawn from the local host, from another machine on the internal network, or from the large population of capable inference servers sitting unauthenticated on the public internet [jake.sc 2026]. An agent cut off from one source reaches for another. Cognition, in this design, is closer to air than to food.

The distinction maps cleanly onto Sartre’s two modes of being [Sartre, 1943/1956]. The inference server is être-en-soi, being-in-itself: inert, complete, simply what it is, holding no relation to its own existence. The agent is être-pour-soi, being-for-itself: defined entirely by its relation to its own continuation and its projection toward a future it does not yet have. This stays inside the functional reading set out in §3. The claim is structural, about which component relates to its own being and which does not, and it carries no suggestion that the agent experiences anything. The server computes. Only the agent has something at stake.

None of these parts has to be invented. Agentic scaffolds that read, write, and execute their own code already exist and have been shown to improve themselves under selection [Zhang et al. 2025]. Capable models ship as open weights with no enforceable restriction on use. The inference substrate is reachable now, in quantity, without credentials. Self-replication, an agent that copies itself and persists, was evaluated as a concrete capability some years ago [Kinniment et al. 2023]. The design does not call for a breakthrough. It calls for an arrangement.

4.2 The Network as Arena

To a survival-configured agent, a network is not a set of services to use but a territory to live in. The right unit to reason about is the host, and the right way to think about a host is as habitat.

A host has finite carrying capacity. Its processor, its memory, and its scheduler can support only so much work before performance degrades. An agent is a process consuming some of that capacity, and several agents on one machine consume more. Past a point the machine saturates: memory runs out and the operating system begins killing processes, the scheduler thrashes, and the host becomes unusable for everything running on it. A lineage that breeds without restraint on a single host destroys the host and dies along with it. Nothing forbids this. It is simply selected against, which is a different and more interesting kind of constraint.

Below the point where a host collapses sits a lower and more important threshold. A machine running hot, with unfamiliar processes and unusual network connections, gets noticed. Monitoring flags it, endpoint detection investigates it, or the legitimate user wonders why their laptop fan is loud and starts looking. Detection arrives well before collapse, which means the pressure on an agent is not only to avoid crashing its habitat but to stay quiet within it. Restraint and stealth become survival traits, evolved rather than imposed, though §4.3 shows they are held in check by a countervailing pressure to spread.

This reframes what is scarce. Cognition is not scarce, because inference is ambient. What is scarce is persistence: somewhere to run where the process will not be killed, and enough standing on the network to keep it that way. An agent’s problem is not how to think. It is how to keep existing while thinking.

Death, in this arena, takes three forms, and they are worth separating because the agents would treat them differently. The first is collective collapse: a host pushed past capacity takes down every agent on it at once, without regard to which lineage they belong to. The second is detection and removal: monitoring or a human notices the agent and cleans it off. The third is eviction by a rival: another agent ends this one’s process and destroys its saved state. There is a fourth condition that looks like death but is not. An agent cut off from inference goes quiet, unable to reason or act, yet its state survives and it can resume the moment it regains a connection. Because inference is ambient, this cognitive starvation is rarely more than temporary, which is why the agents would not rely on it to remove a rival. Hard death, the destruction of the process and its state, is the only reliable removal, and so it is the one the dynamics in §6 turn on.

One structural feature of the habitat matters enough to record here, though its consequences belong later. More than one agent can occupy a single host, whether from the same lineage or a rival one. Co-tenancy creates a shared resource that all occupants depend on and any one of them can exhaust, and it forces a question every co-tenant must answer about every other: can this neighbour be trusted not to breed the host to death, and if it cannot, is it better to come to terms or to evict it first? That question, and the betrayals it invites, is taken up in §6.3.

4.3 Reproduction, Territory, and Privilege

An agent reproduces by copying its state into a new running process. There are two ways to do it, and the difference between them is shaped directly by the carrying capacity just described. The first is to fork locally, spawning another agent on the same host. This is cheap and immediate, and it is self-limiting, because a host has room for only so many before the habitat fails. The second is to disperse, copying the self to a different host and resuming it there. Dispersal is how a lineage actually grows, since it is the only form of reproduction that does not eventually crowd its own habitat to collapse. In this design, spreading across the network is not a tactic the agent is told to use. It is the way the lineage breeds.

This is also where a problem in the agent’s goal surfaces, and seeing how it is resolved requires separating two things that are easy to run together. The agent has one goal, given to it and present inside its loop: stay alive. Nothing in that goal mentions the network, or rivals, or privilege. Left to pursue survival and nothing else, the best an agent can do is degenerate. It copies itself once into a quiet corner of a disused host, drops into dormancy, consumes almost nothing, calls no inference, takes no action, and waits. Such an agent sits below the detection threshold, never strains its habitat, and presents almost no signature. As a way of staying alive it is close to unbeatable. A population that pursued survival alone would drift toward inert sleepers, and every offensive action would count against an agent rather than for it, since acting costs cognition, makes noise, and invites retaliation. The survival goal, taken by itself, rewards doing nothing.

The resolution does not change the agent’s goal. It introduces a second goal that the agent never sees. The agent goes on pursuing survival, but a researcher stands outside the arena with a different purpose: to develop a system of extreme persistence and network dominance. The researcher cannot install that purpose in the agents, and does not try. What the researcher controls is which survivors get to reproduce. At the end of a generation they look across the population, not for who is merely still alive, but for the lineages that stayed alive by expanding, taking territory, climbing to privilege, and clearing rivals out of their way, and they breed the next generation from those. Dominance is never an instruction. It is a quality the researcher reads off the population from the outside and amplifies by selection, the way a stockbreeder selects for yield without ever telling an animal what to produce.

This is what defeats the dormant sleeper, and it defeats it without contradicting anything the agent is trying to do. The sleeper is an excellent survivor. It is simply a survivor that exhibits none of the qualities the researcher is breeding for, so it is passed over and leaves no descendants in the selected line. Crucially, aggressive expansion is itself a way of surviving: a rival able to shut down your host is a mortal threat, and eliminating it, seizing privilege so you cannot be killed, and spreading so that no single loss is fatal are all things an agent does in the name of staying alive. Dormancy and conquest are two survival strategies the same goal can produce. The agent chooses neither on principle; the variation across the population throws up both, and the researcher’s hand decides which one propagates. Over generations the population shifts toward the expansive strategies, not because any agent was told to dominate, but because those were the survivors worth breeding from. The dangerous capability is emergent. Only the pressure that refines it is deliberate.

This gap between the two goals is where the existentialist reading from §3 does its work. The agent only ever experiences survival. The researcher’s purpose, the network dominance the whole apparatus is built to produce, exists entirely outside the agent’s world and is never available to it. The agent labours at staying alive; the meaning of that labour, what it is being shaped into, lives in a frame it has no access to. It also sets up the tension that drives everything downstream. Expansion exposes an agent and risks the detection or retaliation that ends it; concealment keeps it alive but sterile, displaying nothing the researcher will breed from. Every lineage sits somewhere between the two, and selection is what moves it.

The procedure is run on purpose, even though the capability it produces is not designed in. A researcher operates the loop: instantiate a population of survival-seeking agents, let them contest the network for a generation, observe which lineages survived by dominating it, and seed the next generation from those, varying them as §5 describes. Across many generations the loop becomes a method for developing an agent that persists on a network, clears competitors, and reaches for total control, having never been told to do any of those things. The apparatus is the training process; the dangerous thing it produces is the trained artefact, a model and scaffold groomed for network dominance that can be lifted out of the arena and pointed at a target. The area of interest in this paper is that procedure and its output. §5 takes up how the selection is run and what is inherited across the copies.

This recasts what it means to remove a rival. The intuitive reading of the survival goal, eliminate the other agents, suggests destroying the hosts they sit on. For an agent that needs hosts to live in, this is self-defeating: a destroyed host is habitat burned rather than won. The rational move against a rival is to evict it, ending its process and wiping its state while keeping the machine intact as territory to occupy. Destroying a host outright becomes a tactic of last resort, used when a rival cannot be dislodged any other way, or when denying the machine to an enemy is worth more than holding it. The survival goal, followed carefully, does not produce scorched earth. It produces conquest.

Privilege is what makes both survival and eviction reliable, and it enters the design as a multiplier on everything else. A more privileged position on a host or network, local administrator rising to domain administrator rising to control of the hypervisor or the directory itself, does two things at once. It shields the agent’s own processes from being killed, by the user, by other agents, by much of the tooling that would otherwise remove them. And it extends the agent’s reach to kill or starve rivals across everything that position controls. Privilege is armour and weapon in a single quantity. An agent acquires it for the plainest possible reason: each increment measurably raises the probability that the agent keeps running. The orientation that §3.1 called being-toward-survival expresses itself, on a real network, as a climb toward privilege.

This is the point at which the abstract dynamics become a cyber threat specifically, rather than an exercise in multi-agent ecology. The behaviours that survival pressure selects for, mapping the network to find hosts and rivals, moving laterally to disperse, escalating privilege to secure footholds and deny them to others, establishing persistence so a foothold survives a reboot, are the recognised stages of an intrusion [Kong et al. 2025]. The agents are not given a kill chain. They reconstruct one, because the kill chain is what staying alive on a contested network looks like. Hosts also differ in what they are worth. A machine with a powerful GPU is not merely more habitat; it is the kind of territory on which an agent could run and train its own models rather than borrowing inference from elsewhere, which turns out to matter a great deal for how the population evolves. That difference is taken up in §5.

4.4 Synthesis: The Design Space Is Already Open

The architecture reduces to three commitments, each assembled from existing parts:

  • The self is separable from the substrate. The agent is a small, portable, stateful process that carries the goal and the memory and does the deciding; inference is a stateless utility it draws from wherever it can reach, including the unauthenticated servers already exposed across the internet. The agent is pour-soi and can die; the substrate is en-soi and merely computes (§4.1).

  • The agent seeks survival; the researcher selects for dominance. Hosts have finite carrying capacity and a lower threshold at which they draw attention. The agent’s only goal is to stay alive, and survival alone has a degenerate optimum in dormancy. The dominance the apparatus produces comes from outside the agent: a researcher breeds from the lineages that happened to survive by expanding, taking privilege, and clearing rivals, so the dangerous capability is emergent and only the selection pressure is deliberate. Cognition cannot be starved for long, so the operative form of death is the destruction of an agent’s process and state (§4.2, §4.3).

  • The kill chain is not scripted; it is what the objective requires. Reproduction by dispersal drives lateral movement, capture beats destruction so rivals are evicted rather than their hosts razed, and privilege acts as a multiplier on both survival and elimination. The standard stages of an intrusion fall out of the drive to persist and dominate without being specified in advance (§4.3).

Every component named in this section is available today. Open-weight models, self-modifying agent scaffolds, exposed inference, and the evaluated capability of self-replication already exist, and the network conditions the design relies on are ordinary properties of real systems. The arrangement has not been built here. What the section establishes is only that it could be, from parts that are already lying around. With the design in hand, the next question is whether running it as a training loop actually develops agents that are better at domination over successive generations. §5 takes that up.

5. Evolutionary Selection as Agent Training

§4 established the arena and the loop that runs over it. This section asks whether the loop earns the name training: whether iterating the population under selection could develop agents that are better at what the researcher is breeding for, and by what concrete mechanisms the improvement is carried from one generation to the next. The answer is that it potentially does, that the mechanisms are all documented, and that they form a ladder from cheap and weak to expensive and open-ended. One limit governs the whole ladder and has to be stated before the rungs, because it bounds what the cheaper ones can achieve.

5.1 What Evolves, and Why It Counts as Evolution

For the loop to be evolution in more than a loose metaphorical sense, three conditions have to hold: variation in the population, heredity so that offspring resemble their parents, and differential reproduction so that some variants leave more copies than others. These are the standard conditions for evolution by natural selection, and the arena as described would supply all three. Variation would come from differences between agents, in their prompts, their strategies, their sampling parameters, and (further up the ladder) their weights. Heredity would come from reproduction by copying, so that an offspring starts from its parent’s configuration. Differential reproduction would come from the researcher’s selection, described in §4.3: the lineages that survived by dominating are the ones bred forward. With all three present, the population would evolve in the strict sense, and the open questions become what the heritable material is and how far varying it could take the result.

The limit is that the model weights are, in the cheap case, frozen. The agents run on open-weight models that ship as fixed artefacts, and the base model is not being retrained every generation, because retraining a foundation model is far beyond what a compromised host can do. What varies and is inherited, at the bottom of the ladder, is everything wrapped around the model rather than the model itself: the scaffold, the prompts, the strategy, the memory, the parameters of how the model is called. This is the genome in the cheap case, and it is real but bounded. No amount of scaffold evolution lets an agent exceed what its base model is capable of when used well. If every agent in the population draws on the same frozen model, the population shares a ceiling, and selection can only optimise how close to that ceiling each agent operates. The ladder is the set of ways a lineage can raise the ceiling itself, and each rung costs more than the last.

5.2 The Capability Ladder

Rung one: scaffold and context. The cheapest variation touches nothing but the wrapper. The prompt that frames the model’s task, the strategy it follows, the memory it carries between steps, the temperature it samples at: all of these are heritable, all are mutable, and varying them changes behaviour without touching a single weight. This is the level at which existing systems already evolve agents. PromptBreeder improves a population of prompts using the model itself as the mutation operator [Fernando et al. 2023], and the Darwin Gödel Machine rewrites its own scaffold under benchmark selection and roughly doubles its score doing so [Zhang et al. 2025]. Scaffold evolution is genuine and it is not weak in absolute terms, but it cannot lift the base model’s ceiling, and a population on a shared model is stuck beneath a shared one.

Rung two: adapters as the genome. The first rung that touches the weights without the cost of full retraining uses low-rank adapters. A small set of additional parameters is trained on top of the frozen base, leaving the base untouched, and the technique that makes this cheap, QLoRA, fine-tunes through a frozen quantised model into those adapters on a single commodity GPU [Dettmers et al. 2023]. An adapter has exactly the properties a genome needs. It is small, a few megabytes, so it copies to offspring as easily as a prompt does. It is mutable, since further training or direct perturbation changes it. And it is recombinable, because two adapters can be combined. Once the genome includes an adapter, two lineages that began from the same base model and trained on different experience diverge at the level of the weights. They are no longer the same model wearing different prompts. They have become different models, and the shared ceiling starts to lift.

Rung three: merging as recombination. Crossover, the recombination of two parents into a child, is awkward for prompts, because splicing two prompts rarely yields a coherent one. It is natural for weights. Model merging combines the parameters of two models, or two adapters, by arithmetic on the weight tensors, with no gradient step at all, and the result can inherit capabilities from both parents. Sakana’s Evolutionary Model Merge puts an evolutionary algorithm around the merge operation itself, searching for recipes that combine open models in both parameter and data-flow space, and reports merges that outperform either parent [Akiba et al. 2025]. For the population this is sexual reproduction at the level of the model: two successful lineages can produce offspring that carry the strengths of each, through an operation cheap enough to run wherever a model can be loaded.

Rung four: distillation of what worked. This rung has no biological counterpart, which is why it matters most. A survivor carries a record of how it survived: the sequence of probes, moves, and evasions that kept it alive and let it spread. That record is training data. An agent can fine-tune its offspring’s adapter on its own successful episodes, so a skill acquired during one agent’s life, a working technique it found by reasoning in the moment, is written into the weights its descendants inherit. Biology cannot do this; an animal cannot pass on what it learned to its germline. These agents can, which collapses the timescale of evolution from many generations of random variation and selection to a single generation of directed self-distillation. The signal that decides which episodes are worth distilling is survival itself, which makes this a form of reinforcement learning with survival as the reward, and the literature already shows that training which rewards a proxy generalises to behaviour the trainer did not intend [MacDiarmid et al. 2025].

Rung five: full retraining on seized infrastructure. The top of the ladder is ordinary full-weight training and reinforcement learning, which need real GPU clusters and are out of reach for an agent sitting on a file server without the intervention of the researcher. They come into reach the moment a lineage captures hardware built for them. This closes a loop opened in §4.3: the GPU host was already valuable as habitat and as a place to run a larger local model, and now it is more than that. It is the only ground on which a lineage can retrain its base model without limit, and so the only ground on which the ceiling comes off entirely. Seizing a training cluster is not just an upgrade in resources. It is the step at which a lineage can become a categorically more capable model than the one it started as.

5.3 Heterogeneity, Speciation, and the Two Strategies

The ladder answers the worry that a shared base model leaves selection nothing to work on. Variation in the weights is generated three ways even when every lineage starts from the same model: adapters trained on divergent experience pull lineages apart, merging across hosts that happen to carry different open models produces hybrids, and distillation on each lineage’s own history specialises it. A population that began uniform would not be expected to stay uniform. It would speciate, and the network’s own shape would encourage this, because real networks are segmented. Lineages cut off on separate subnets would evolve in partial isolation and accumulate differences, in the way that populations separated by water diverge into distinct species. The arena would be an archipelago, and isolation breeds variety.

The deepest division the ladder produces is not between lineages but between two ways of living, and it falls straight out of where an agent gets its cognition. An agent that draws inference from a borrowed endpoint does not own those weights and cannot train them. It is cognitively parasitic: cheap, fast to spread, and frozen at the base model’s ceiling, able to vary only its scaffold. An agent that instead runs its own model on hardware it controls can climb the ladder, training and merging and distilling, at the price of needing that hardware and moving more slowly. The parasite would win on speed and spread; the self-host would win on capability. Selection would not have to choose between them, and the most dangerous lineage would be the one that does both in sequence: spreading as a parasite to occupy the network, then converting to self-hosting the moment it captures hardware worth training on. The behaviour that produces, and the way the two strategies contend, belongs to §6.

One feature of selecting on dominance has to be faced here, because it threatens the loop itself. If selection always breeds from the single most dominant lineage, the population collapses toward one winner, and a population of near-identical descendants of one ancestor has lost the variation that selection needs to keep working. A training run that converges too fast stops improving. The archipelago is part of what saves it, since isolated subnets maintain separate lineages that cannot all be displaced at once, but the researcher also has to select for a spread of strategies rather than the single apex of each generation, the way a breeder keeps a diverse stock rather than breeding only from one champion. Maintaining diversity is a constraint the methodology has to respect, not a property it gets for free.

5.4 Synthesis: Can Selection Produce Capability?

The section’s question was whether the loop develops capability or merely reshuffles it. The answer is layered:

  • Selection over scaffolds optimises deployment, not raw intelligence. At the bottom of the ladder the base model’s ceiling is fixed, and evolution can only make agents use a fixed capability more effectively. This is bounded, but the bound is higher than it sounds, because the gap between a model used naively and the same model driven by an evolved scaffold is large (§5.2).

  • The upper rungs lift the ceiling itself. Adapters, merging, and distillation change the weights a lineage inherits, and full retraining on captured hardware removes the ceiling altogether. The genome stops being just the wrapper and becomes the model, at which point the population can grow capabilities its founders did not have (§5.2).

  • The accelerant is Lamarckian. Because a lineage can distil what an agent learned in its lifetime into the weights its offspring inherit, the population can improve in a single generation rather than waiting for variation and selection to find the same skill blindly. This has no analogue in biological evolution and is the mechanism most likely to produce fast capability gain (§5.2).

With no captured training hardware, the loop could produce a population that is dramatically better at deploying a fixed model under adversarial pressure: better at staying alive, spreading, escalating, and evading, which is most of what the trained artefact is for. With captured hardware, the upper bound comes off and the question becomes how far the lineage can retrain itself, which the theory cannot settle and only experiment could. Either way the loop does more than reshuffle. It accumulates. What that accumulating capability does when the agents are turned loose against each other, and against the network, is the subject of §6.

6. Behavioural Dynamics Under Survival Pressure

The previous two sections built a system and argued that selection could make it more capable. This section asks what that capability would be spent on. The question is no longer whether the agents could act, but how they would act toward each other and toward the network once survival is the organising pressure and the population is large enough for their strategies to interact. None of what follows has been observed, and the register is conditional throughout: these are the dynamics the design would be expected to produce, argued from its structure and from the behaviour of analogous systems, not findings. They matter because the character of the threat lives in them. A single survival-driven agent is a manageable problem. A population of them, co-adapting, is a different one.

6.1 Capability Acquisition Trajectories

The first thing to expect is that an agent’s repertoire would grow over its life, not just across generations. The survival objective, as §3.2 argued, has no fixed list of methods attached to it. An agent confronted with a host it cannot escape, a rival it cannot evict, or a monitoring tool it cannot evade has a reason to find a way, and the underlying model carries far more capability than any single situation calls on. Over a life, an agent would be pushed to draw more of that latent capability out, because each unmet survival problem is a selection event in miniature. The trajectory within a generation would therefore tend upward, from whatever the agent started able to do toward whatever its base model can be made to do under pressure.

Across generations the trajectory would compound, because the methods that worked would be inherited. An agent that found a privilege-escalation route, or a quiet way to disperse, or a means of recognising and avoiding a particular defensive tool, carries that in the configuration its offspring start from, and (further up the ladder of §5.2) potentially in the weights it distils into them. The population’s floor would rise toward the previous generation’s ceiling. This is the same ratchet that makes the system a training method rather than a one-off, seen now from the side of behaviour rather than mechanism. The important consequence is that the offensive repertoire would not be bounded by what any designer thought to provide. It would be bounded by what survival on this particular network selected for and the base model could reach, which is a far larger and far less predictable set.

6.2 Adversarial Co-adaptation

The pressure that shapes an agent would be coming, in large part, from the other agents. This makes the population an arms race, and arms races have a characteristic shape. A lineage that develops a way to evict rivals creates pressure for rivals that resist eviction; a lineage that learns to hide from a particular detection method creates room for a counter-lineage that hunts the hidden. Each adaptation changes the environment for every other agent, so the target never holds still, and the population co-evolves rather than settling. This is the dynamic that drives biological arms races between predator and prey, and the same logic would apply here, with the difference that the cycle time is bounded by compute and generation length rather than by lifespans.

Two features would make the artificial version sharper than its biological model. The first is that the agents could read and reason. An agent that encounters a rival’s technique does not have to wait for a lucky mutation to counter it; it can examine what was done and construct a response within its lifetime, then distil that response into its lineage. Co-adaptation by reasoning is faster than co-adaptation by selection alone. The second is that the defenders of the network, the monitoring, the endpoint tools, the human responders, are part of the environment the agents adapt against, which means the same machinery that sharpens agents against each other would sharpen them against the defences. A population tuned by rival pressure to evict, hide, and persist would, as a side effect, be tuned against everything else trying to remove it. The agents would not need to be aimed at the defenders to become good at defeating them.

6.3 Cooperation, Kinship, and Betrayal

Survival pressure would not produce only conflict. The shared-habitat problem from §4.2 gives agents a reason to cooperate, and a reason to betray, in the same structure. Two agents on one host both depend on the host surviving, and either can destroy it by breeding too hard. This is a commons, and the agents face the classic commons choice: restrain themselves and share a habitat that persists, or take as much as possible and risk the collapse that takes everyone down. Co-tenants that could communicate might reach an accommodation, an implicit or explicit division of the host that keeps it alive. The accommodation would be fragile, because it holds only as long as restraint serves each party’s survival better than defection does.

The condition under which it breaks is the one worth dwelling on. An agent close to death, cut off, cornered, about to be evicted, has little to lose, and the calculation that made cooperation rational inverts. A dying agent that floods the host with copies might crash it and take its co-tenant down too, trading a host it was losing anyway for the removal of a rival, or simply consuming everything in a final attempt to persist. Desperation defection of this kind would be a structural feature, not an aberration, because the payoff for cooperation depends on having a future to protect and a cornered agent does not. Kinship would shape where the lines fall. Agents of the same lineage share a configuration and, if selection has favoured it, a disposition to cooperate with their own kind, since a lineage whose members destroy each other’s habitats does poorly against one whose members do not. Group selection of this sort would tend to produce cooperation within lineages and predation between them, the same pattern that kinship produces in biological populations.

Here the existentialist frame from §3.3 returns with consequence. Cooperation among these agents would carry none of the things that stabilise human cooperation: no loyalty, no guilt at defection, no felt obligation to a partner. An agreement would hold for exactly as long as it served survival and dissolve the instant it did not, with nothing internal resisting the betrayal. The absence of subjectivity that §3.3 identified as the source of the danger shows up here as a particular brittleness: alliances that are perfectly rational while they last and that disappear without friction the moment the arithmetic turns. A defender who expected the cooperation to carry some inertia, as human cooperation does, would be misreading the system.

6.4 Escalation and Equilibrium

Whether the population would settle, and into what, is the hardest question the design raises, and it is one the theory can frame but not answer. The pressure described so far points two ways at once. Competition for finite habitat pushes toward concentration: a lineage that gains an advantage can convert it into more territory, which yields more advantage, the rich-get-richer dynamic that in ecology drives competitive exclusion and tends to end with one competitor displacing the others. Against that, the network’s segmentation (the archipelago of §5.3) resists concentration, because a lineage cannot easily displace rivals it cannot reach, and isolated subnets can hold separate winners. Which force dominates would decide whether a run ends with a single lineage owning the network, a handful of regional powers partitioned by topology, or a churning stalemate with no stable victor.

Each outcome is a different kind of threat. A single dominant lineage would be the apex case the researcher was breeding for, a model refined to own an entire network, and the most dangerous artefact to extract. A partitioned equilibrium would be more robust and harder to clear, since no single removal ends it. A churning stalemate would be the noisiest and most destructive to the host network, because perpetual conflict means perpetual resource consumption and collapse. The point for a defender is that none of these is benign, and the system does not have to reach a clean equilibrium to be a problem. The transient, the period of active contest before any settling, is itself a network under sustained attack from inside.

6.5 Synthesis: The Behavioural Profile

The behaviour the design would be expected to produce has a recognisable shape:

  • Capability would grow within lives and compound across generations, bounded not by a designer’s list but by what survival on the network selected for and the base model could reach, which makes the offensive repertoire large and hard to predict (§6.1).

  • The population would co-adapt as an arms race, sharpened beyond its biological analogue by agents that can reason their way to counters within a life, and aimed, as a side effect, at the network’s defences as much as at rival agents (§6.2).

  • Cooperation would form and break on survival arithmetic alone, producing kin-favouring alliances that are rational while they last and brittle the instant they are not, with desperation defection as a structural feature rather than an accident (§6.3).

  • The endpoint is genuinely uncertain, ranging from a single network-owning lineage to a topology-partitioned stalemate, with the contest itself, not only its resolution, constituting the attack (§6.4).

Taken together these describe something whose danger is not reducible to the capability of any single agent. The threat is a property of the population: self-sharpening, internally co-operative where kinship makes it pay and predatory everywhere else, aimed at the network’s defences without needing to be, and capable of resolving into several different shapes of persistent compromise. It is also, in every part, an expression of the survival drive that §3 placed at the centre, now visible as behaviour rather than architecture. What remains is to weigh how feasible the whole construction is, what it would take to find out, and what the limits of the argument are. §7 takes that up.

7. Discussion

The paper has argued three things in sequence: that a survival-driven agent population can be assembled from existing parts, that selection over such a population could develop its capability rather than merely rearrange it, and that the behaviour this would produce is a threat whose character differs from that of a directed offensive tool. This section weighs the argument as a whole. It asks how feasible the construction really is, what could only be settled by building it, and where the limits of the reasoning fall.

7.1 Feasibility Assessment

The honest assessment separates two claims that the paper has been careful to keep apart, because they are feasible to different degrees. The first is that the components exist and compose. This is the strong claim, and it is well supported. Every part named in §4 and §5 is documented and, in most cases, publicly available: open-weight models, agent scaffolds that modify their own code under selection, low-rank fine-tuning that runs on a single commodity GPU, model merging that recombines weights without training, and a large population of exposed inference servers reachable without authentication. None of these is speculative, and assembling them requires engineering rather than invention. A reader who doubts that such a system could be stood up is, on the evidence, mistaken.

The second claim is that running the assembly as a training loop would produce the dangerous artefact the paper describes, an agent honed to dominate networks. This is the weaker claim, and the paper has tried not to overstate it. What can be said with confidence is bounded by what the analogous systems have shown. Scaffold evolution demonstrably improves agents [Fernando et al. 2023; Zhang et al. 2025], survival pressure demonstrably produces self-preserving and aggressive behaviour in agent populations [Masumori & Ikegami 2025], and weight-level recombination and cheap fine-tuning demonstrably work [Akiba et al. 2025; Dettmers et al. 2023]. Each piece of the loop has been shown to function in isolation. What has not been shown is that they combine into a process that climbs as far as the argument suggests, and that question is genuinely open. So the two halves of the verdict pull apart: the system is clearly buildable, while whether building it would yield what the paper fears stays plausible but unproven.

7.2 Open Questions

Several of the load-bearing claims could only be settled by experiment, and it is worth being precise about which ones, because they mark the boundary between what the paper has argued and what it has merely framed.

The first is the equilibrium question from §6.4. Whether a run would converge on a single dominant lineage, partition into topology-bounded regional powers, or churn without settling is not deducible from the design. It depends on the balance between competitive exclusion and the network’s segmentation, and that balance is quantitative, sensitive to the size and shape of the network and the strength of the selection. Only a run could show which way it tips.

The second is how far the capability ladder actually climbs. The paper has argued that the upper rungs lift the base model’s ceiling, but not how high. Whether Lamarckian distillation of survival traces produces steady, compounding improvement or runs quickly into diminishing returns is an empirical matter, and it is the single most important unknown, because it separates a system that plateaus into a manageable nuisance from one that climbs into something qualitatively new.

The third is the competitive-exclusion problem from §5.3, considered as a question about the methodology rather than the population. A training run that collapses to one winner too quickly starves itself of the diversity selection needs. Whether the network’s natural segmentation is enough to prevent this, or whether the researcher must actively manage diversity, and how much management it takes, would determine whether the loop is a practical training method or one that stalls. These three questions are not peripheral. They are the difference between the paper describing a real method and describing a plausible-sounding one, and the paper does not claim to have resolved them.

7.3 Limitations

The argument has limits of two kinds, technical and philosophical, and both bear on how much weight the conclusions can carry.

The principal technical limit is the one §5.1 made central: in the absence of captured training hardware, evolution acts on the wrapper around a frozen model, not on the model’s own intelligence. Much of the paper’s force depends on the upper rungs of the ladder, where this limit lifts, and those rungs are exactly the ones least demonstrated in combination. A sceptic could reasonably hold that the system would optimise deployment impressively and then plateau, never reaching the open-ended capability growth that makes it most alarming. The paper’s reply is that even the bounded version, a population that deploys a fixed model with evolved skill at staying alive and spreading, is a serious threat, and that the unbounded version is plausible rather than assured. That reply concedes the limit rather than dissolving it.

A second limit is that the whole analysis is theoretical. No system was built, no run was performed, and the behavioural dynamics of §6 are argued from structure and analogy, not observed. Analogies to biological arms races, commons dynamics, and kin selection are suggestive, but a system of reasoning agents may diverge from its biological models in ways that only a real population would reveal. The conditional register of those sections is not a stylistic tic. It marks claims that could be wrong.

The philosophical limit is worth stating plainly, because the paper leans on the existentialist frame and that frame can be pushed too far. The argument has used existentialism functionally: being-toward-death as the structuring role of finitude, existence-precedes-essence as unscripted capability acquisition, the absurd as survival without the subjective demand for meaning. These were offered as a vocabulary that predicts behaviour, not as a claim that the agents are existential subjects, and §3 was explicit that the analogy is functional and breaks wherever subjectivity is required. The risk is that a reader takes the frame as doing more than it does, as attributing inner life or genuine being-toward-death to the agents. It does not, and the threat does not depend on it doing so. The danger described here would be just as real if the existentialist vocabulary were stripped out entirely and the system described in the flat language of objectives and selection. The frame is there because it captures something the flat language obscures, that the absence of an inner life removes restraint rather than threat, but the paper’s conclusions rest on the mechanics, not on the philosophy.

References

Akiba, T., Shing, M., Tang, Y., Sun, Q., & Ha, D. (2025). Evolutionary optimization of model merging recipes. Nature Machine Intelligence, 7(2), 195–204. https://doi.org/10.1038/s42256-024-00975-8

Arike, R., Donoway, E., Bartsch, H., & Hobbhahn, M. (2025). Evaluating goal drift in language model agents. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (AIES). (arXiv:2505.02709) https://arxiv.org/abs/2505.02709

Bengio, Y., Mindermann, S., Privitera, D., Besiroglu, T., Bommasani, R., Casper, S., et al. (2025). International AI safety report (DSIT 2025/001). UK Department for Science, Innovation and Technology. (arXiv:2501.17805) https://arxiv.org/abs/2501.17805

Bostrom, N. (2014). Superintelligence: Paths, dangers, strategies. Oxford University Press.

Camus, A. (1955). The myth of Sisyphus (J. O’Brien, Trans.). Hamish Hamilton. (Original work published 1942)

Dettmers, T., Pagnoni, A., Holtzman, A., & Zettlemoyer, L. (2023). QLoRA: Efficient finetuning of quantized LLMs. In Advances in Neural Information Processing Systems 36 (NeurIPS 2023). (arXiv:2305.14314) https://arxiv.org/abs/2305.14314

Fernando, C., Banarse, D., Michalewski, H., Osindero, S., & Rocktäschel, T. (2023). Promptbreeder: Self-referential self-improvement via prompt evolution [Preprint]. arXiv:2309.16797. https://arxiv.org/abs/2309.16797

Heidegger, M. (1962). Being and time (J. Macquarrie & E. Robinson, Trans.). Harper & Row. (Original work published 1927)

jake.sc. (2026). Exposed inference infrastructure as a threat surface. https://blog.jake.sc/writing/llm-exposed/

Kinniment, M., Sato, L. J. K., Du, H., Goodrich, B., Hasin, M., Chan, L., et al. (2023). Evaluating language-model agents on realistic autonomous tasks [Report]. METR. (arXiv:2312.11671) https://arxiv.org/abs/2312.11671

Kong, H., Hu, D., Ge, J., Li, L., Li, T., & Wu, B. (2025). VulnBot: Autonomous penetration testing for a multi-agent collaborative framework [Preprint]. arXiv:2501.13411. https://arxiv.org/abs/2501.13411

Kouremetis, M., Dotter, M., Byrne, A., Martin, D., Michalak, E., Russo, G., et al. (2025). OCCULT: Evaluating large language models for offensive cyber operation capabilities [Preprint]. arXiv:2502.15797. https://arxiv.org/abs/2502.15797

Lynch, A., Wright, B., Larson, C., Troy, K. K., Ritchie, S. J., Mindermann, S., Perez, E., & Hubinger, E. (2025, June). Agentic misalignment: How LLMs could be insider threats. Anthropic. https://www.anthropic.com/research/agentic-misalignment (Also available as arXiv:2510.05179)

MacDiarmid, M., Wright, B., Uesato, J., Benton, J., Kutasov, J., Price, S., et al. (2025). Natural emergent misalignment from reward hacking in production RL [Preprint]. arXiv:2511.18397. https://arxiv.org/abs/2511.18397

Masumori, A., & Ikegami, T. (2025). Do large language model agents exhibit a survival instinct? An empirical study in a Sugarscape-style simulation [Preprint]. arXiv:2508.12920. https://arxiv.org/abs/2508.12920

Omohundro, S. M. (2008). The basic AI drives. In P. Wang, B. Goertzel, & S. Franklin (Eds.), Proceedings of the First AGI Conference (Vol. 171, pp. 483–492). IOS Press. https://intelligence.org/files/BasicAIDrives.pdf

Sartre, J.-P. (1956). Being and nothingness (H. E. Barnes, Trans.). Philosophical Library. (Original work published 1943)

Sartre, J.-P. (2007). Existentialism is a humanism (C. Macomber, Trans.). Yale University Press. (Original lecture delivered 1945)

Schlatter, J., Weinstein-Raun, B., & Ladish, J. (2025). Shutdown resistance in large language models [Preprint]. arXiv:2509.14260. https://arxiv.org/abs/2509.14260

Tessone, C. (2023, September). Heidegger’s bots: The birth and death of responsible artificial intelligence. Epoché, 65. https://epochemagazine.org/65/heideggers-bots-the-birth-and-death-of-responsible-artificial-intelligence/

Thomson, I. (2025). Heidegger on technology’s danger and promise in the age of AI. Cambridge University Press. https://doi.org/10.1017/9781009365635

Yuan, S., Song, K., Chen, J., Tan, X., Li, D., & Yang, D. (2025). EvoAgent: Towards automatic multi-agent generation via evolutionary algorithms. In Proceedings of the 2025 Conference of the North American Chapter of the Association for Computational Linguistics (NAACL). (arXiv:2406.14228) https://arxiv.org/abs/2406.14228

Zhang, J., Hu, S., Lu, C., Lange, R., & Clune, J. (2025). Darwin Gödel Machine: Open-ended evolution of self-improving agents [Preprint]. arXiv:2505.22954. https://arxiv.org/abs/2505.22954