The actors in AI alignment

Total word count including references, tables, captions and figure text: 7,784.

Abstract

Value alignment gives AI companies considerable discretion over the norms their models reproduce. Yet companies also depend on external actors to formulate values, anticipate risks and evaluate model behaviour. This article examines how these actors are enrolled across an alignment stack, from specification to training and benchmarking. We combine a detailed reading of 184 documents with an expanded archive of 752 documents and a directory of alignment organisations. External actors appear in selective capacities, with substantially more identifiable external contributions to benchmarking than to training. In the harmonised actor mapping, 84.9% of actors appear in only one component. Alignment research organisations sometimes connect risk definition to evaluation by making prospective harms testable. We describe this capacity as ideation power. The findings qualify accounts of participation centred on consultation: inclusion in one exercise does not establish continuing involvement in the decisions through which a value becomes part of a model's conduct.

Keywords: AI alignment; platform governance; participation; model documentation; anticipatory governance; actor-network theory

Introduction

One of the major controversies AI has brought to societal debate concerns its renewed role in public access to information . One once spoke of “algorithms” as a catch-all denominator for the underlying infrastructures and politics of information management , be these ranking systems , recommenders or content moderation systems . Large language models (LLMs) enter this configuration as interfaces that generate information as well as organise access to it. Seamless as this shift may feel, the political implications remain profound: both algorithmic and AI-based information systems condition the levers through which access to and the circulation of information are aligned with societal norms.

A central political question is who gets to decide and operationalise those norms. AI companies retain considerable discretion over what they create; a key aspect of “platform power” is indeed the “endogenous” capacity to engender the environment and conditions in which surrounding markets and societal sectors must function . But they also retain dependencies with actors from whom they seek expertise, legitimation and governance frameworks. These concern epistemic norms, including definitions of misinformation; social norms around representation and political disagreement; and estimations of personal or societal harm. Many remain “essentially contested” , even when a technical system requires a decision about how to apply them.

Part of alignment is, in this sense, a question of inclusive design: who is consulted about a norm, and what becomes of their contribution when it is translated into training data or a benchmark? Another part concerns negotiation between actors with different interests and capacities to act. Platform governance scholarship has long examined how responsibility might be distributed between companies, public institutions and civil society . AI companies, for their part, describe partnerships with academic and governmental experts, red-teaming networks and occasional consultations with publics, as in Anthropic's Collective Constitutional AI and Google's STELA programme .

Still, it is difficult to tell what participation means beyond these exercises, let alone whether it entails the distribution of agency over a system's purpose, design or consequences that scholars associate with participatory AI . A public may be invited to deliberate about a principle while the decisions about its implementation remain within the company; conversely, the author of a benchmark may help define acceptable conduct without having been invited to deliberate about it. Looking beyond any one site of participation therefore requires following actors across the processes through which a norm becomes part of a model's behaviour.

Concretely, we read a detailed extraction from 184 documents alongside an expanded archive of 752 documents associated with developers in the United States, Europe and China. We trace actors across an alignment stack, from specification to training and benchmarking, and compare these relations with a wider directory of alignment organisations. External involvement is concentrated in particular tasks, especially benchmarking; a small number of alignment research organisations nevertheless connect the definition of prospective risks to their evaluation. We describe this capacity as ideation power: the capacity to formulate a possible AI behaviour as a problem that others can train against or test. Our concern is with the relations documented along this passage, and with what they allow us to say about participation in alignment as a whole.

The actors of alignment governance

Alignment as a stack

Before examining where actors intervene, it is useful to locate alignment itself. Gabriel distinguishes instructions, expressed intentions, revealed and informed preferences, interests and values as different targets of alignment . The distinction matters because these targets do not necessarily agree: following a user's instruction may violate another person's interests, while preventing a possible harm may require refusing something the user considers legitimate. Alignment thus involves specifying whose judgement counts, under which circumstances, and how conflicts between otherwise desirable behaviours ought to be resolved.

In this regard, alignment extends questions familiar to values in design, but introduces particular means of translating norms into generative behaviour. Veale et al. locate ethics councils, contracts, standards and international agreements among the different modalities of AI governance ; within companies, these arrangements enter an interdependent set of interventions which we call the alignment stack. Legislation, conventions and standards inform company principles and specifications, which inform training and evaluation; observations of model behaviour may, in turn, occasion revisions to the specification. Following this movement allows us to ask whether those consulted about a value retain a role when its meaning becomes more specific.

The AI alignment stack where and how AI is aligned, and which documents govern each layer HIGH-LEVEL LEGISLATION AND POLICIES EU AI Act and the GPAI Code of Practice · US executive orders and state law (SB 53) · China's generative AI measures and algorithm registry · Council of Europe Framework Convention · UN Global Digital Compact Standards: ISO/IEC 42001, NIST AI RMF, IEEE 7000, CEN-CENELEC JTC21 · media and speech legislation AI PLATFORMS (HUGGING FACE, GITHUB, APP STORES) Terms of use · community guidelines · policy centres · model and dataset cards required of uploaders AI COMPANY POLICIES the documentary taxonomy, from the documents that bind the company to those that report on it Self-governance Organisational principles, standards and codes → model behaviour specifications (constitutions, model specs) → frontier governance frameworks (thresholds and if-then commitments) → usage policies and terms Disclosure Model documentation (system and model cards, technical reports) · framework implementation reports misuse and threat intelligence · transparency and compliance reports · certifications · incident statements External governance Public policy positions · commitments, unilateral and multilateral · partnerships and memoranda governance bodies and structures (trusts, advisory councils, institutes, industry bodies) Programmes and knowledge Programmes and funding (grants, fellowships, bug bounties, access programmes) · safeguards explainers research · evaluations, benchmarks and tools · essays and vision statements binds the company → reports on it VALUE ALIGNMENT the components in which the norms above are operationalised Data curation filtering, deduplication synthetic data, PII redaction annotation and preference data Red teaming internal and external teams expert and public red teams bug bounties, flaw disclosure Training SFT, RLHF, RLAIF, DPO reward shaping, hard constraints classifiers, runtime safeguards Benchmarking safety and capability suites third-party evaluation leaderboards, audits ENFORCEMENT Generation of "moderate" content · refusals and safe completions · chain of thought · content warnings USER CIRCUMVENTIONS Jailbreaking prompts · many-shot and prompt-injection attacks · workarounds shared in public forums ALTERNATIVE MODELS & PLATFORMS Alternative AI platform ecologies · alternative models (geographical, religious, political) · open weights AI INFRASTRUCTURES Cloud services · content delivery networks · domain registrars · compute and telecom infrastructure Layers in grey lie outside the corpus read here.

Figure 1. The alignment stack.

Specification consists in formalising values within computational boundaries : deciding what counts as a factual answer, which requests should be refused, or how helpfulness should be weighed against the possibility of harm. Agreement about a broad principle does not settle these questions, since choosing an example or an exception already involves interpreting the value. Training and mitigation carry those interpretations into model behaviour through examples, preference comparisons, principle-based critique, filters and other safeguards. The same concern with harmlessness can consequently become several different interventions, each involving different people and different opportunities to contest what is being taught.

Anticipation and evaluation introduce a further difficulty. Content moderation already entails pre-emptive judgements, but generative systems add the problem of assessing outputs and capabilities that have not yet been observed in use. Evaluators must devise circumstances in which a prospective failure becomes observable; frontier safety frameworks then connect such observations to capability thresholds and proposed safeguards. This is where the ability to imagine a risk becomes consequential for governing it, although an evaluation score cannot resolve every disagreement about the norm being measured. Deployment and documentation subsequently make some of these decisions available for scrutiny, including which organisations were involved and what their contributions were said to accomplish.

Participation and decision-making

Thus far, much empirical work on participation in AI has examined consultation. Delgado et al. find that participatory design rarely grants participants agency over design decisions , while Kallina et al. identify a distance between responsible-AI guidance and industry practice, where developers, executives and legal teams determine the scope of involvement . Google's STELA programme illustrates this division of labour: participants discussed chatbot interactions, after which researchers coded their statements, formulated rules and submitted them to expert review . Situated judgements could enter alignment without participants selecting the dialogue samples or directly formulating the final rules; in Collective Constitutional AI, public input similarly informed a constitution that researchers curated and used in training .

The question reappears in data work and red teaming, where a judgement may become a training signal without giving its author authority over the exercise. Miceli and Posada locate these asymmetries in the organisation of data production, in which workers interpret material within conditions established by clients and managers . External red teaming likewise depends on whom a company invites, what access it provides and which findings it acts upon ; organisational priorities and release schedules may constrain what follows from an identified failure .

Third-party evaluation raises a related institutional problem: as Raji et al. argue, an audit ecosystem requires arrangements that enable outsiders to scrutinise systems , while corporate control of resources also shapes the questions external researchers can pursue . Specialised alignment research organisations occupy an interesting position here because they may supply both a definition of a prospective risk and an instrument for testing it. To follow these contributions, we draw on the notion of enrolment in actor-network theory : whose judgement is carried into a principle, dataset, training intervention or evaluation, and who is credited at each point? The purpose is to trace the organisation of involvement, without assuming that more mentions necessarily mean more power.

Method

Reading alignment documents

Our point of departure is what companies document about alignment. Studies of model cards have examined the unevenness of disclosure , while the Foundation Model Transparency Index evaluates what developers disclose about their models and the conditions of their production . Here, we approach the same materials through the relations they record: whose work is cited, which organisations are invited to contribute, and what those contributions concern.

Though these documents are of course not representative of everything that occurs in alignment processes, or of everyone involved, they do themselves participate in AI companies' governance by performing public duties towards the responsible democratisation of machine learning , responding to the sensitivities of regulators and public debates about prospective model uses, and positioning companies among competing alignment norms and technical benchmarks. These documents, and those they cite, may be sites of deliberation in their own right: they refer to conceptual influences from public debate, nonprofits involved in benchmarking or red teaming, consultation processes, and AI safety organisations with whom, or in response to whom, companies have formulated a norm.

Of course, the corpus records what companies and affiliated authors choose to disclose, in genres with different audiences and incentives; it cannot make private meetings, rejected recommendations or uncredited labour visible. We are also cautious about deducing a company's motivation for involving an actor, even more so about estimating that actor's impact. We restrict ourselves to analysing how actors are cited and thereby publicly “enrolled” in alignment processes.

Collection and classification

The collection centres on developers with publicly accessible documentation: OpenAI, Anthropic, Google and Google DeepMind, Meta, xAI and Microsoft; Mistral, Aleph Alpha, Almawave, Black Forest Labs and Unbabel; and Alibaba/Qwen and DeepSeek. It is a purposive comparison, conditioned by disclosure, rather than a representative or regionally balanced sample. The initial collection, assembled between 28 January and 9 May 2026, comprised 181 Zotero records, yielding 184 files, alongside 53 policy snapshots from the Open Terms Archive. Following links from company newsrooms, research listings and safety sections added 515 documents by September 2026, bringing the archive to 752 files.

The analyses use different portions of this archive. The detailed mapping derives from 184 extracted documents: 163 Zotero-derived files and 21 policies. Genre, phrase and citation analyses concern the 515 additional documents; retrieval indexes the full archive, but the subsequent retrieval-grounded extraction covers 150 additional documents and informs qualitative inspection rather than the earlier numerical findings. Published PDFs and paginated webpage captures retain the passages to which these readings refer.

GroupCategoryAlso known asDefinition and decision ruleData points to code
A. Self-governance (normative)Organizational principles, standards, codesAI principles, charters, codes of conduct, responsible AI standards, human rights statementsBinds the organization. States values or requirements for how the company develops and deploys AI in general, not for one model or risk domain.Version; date; scope (whole firm / division); enforcement mechanism named?
Model behavior specificationsConstitutions, model specs, character documentsWritten target for model behavior, used in training or evaluation. Addressed to the model and to users.Version; date; priority ordering of values; stated training use
Frontier governance frameworksResponsible Scaling Policy, Frontier Safety Framework, Preparedness Framework, Frontier Governance Framework, Frontier AI Framework, SB 53 compliance frameworkDefines capability or risk thresholds, the evaluations used to detect them, and the safeguards or deployment decisions that follow. Decision rule: the document commits the company to if-then actions tied to thresholds.Version; date; risk domains; threshold definitions; named evaluators; legal basis (voluntary / SB 53 / EU GPAI Code)
Usage policies and termsAcceptable use policy, usage policy, consumer terms, use guidelinesRules for users and deployers. Decision rule: the addressee is the user or customer.Version; date; prohibited-use list; enforcement stated
B. DisclosureModel documentationSystem cards, model cards, addenda, technical reports, training-data summaries, application cardsDocuments one model, model family, or product: training, capabilities, evaluations, limitations.Model; release date; sections present; third-party evaluators named; legal template used (e.g., EU AI Act training-content summary)
Framework implementation reportsFrontier Safety Framework reports, risk reports, alignment risk updates, ASL activations, framework update logsApplies a named frontier framework to a model or moment. Decision rule: it cites a framework threshold and reports a determination.Framework and version cited; thresholds reached (Y/N); safeguards triggered
Misuse and threat intelligence reportsThreat reports, disruption reportsReports observed misuse of the company's systems by identified or unidentified actors and the enforcement taken.Period covered; actor types; countries; harm domains; enforcement actions
Transparency and compliance reportsResponsible AI transparency reports, voluntary commitments trackers, regulatory compliance disclosuresPeriodic or standing account of the company's governance practice as a whole, often keyed to commitments or regulation.Reporting period; commitments or laws referenced; metrics disclosed
Certifications and third-party assessmentsAudits, certifications, external testing, cross-lab evaluationsAssessment performed or certified by a party other than the company. Decision rule: an external party issues or conducts it.Assessor; standard (ISO/IEC 42001, SOC 2); scope; date
Statements and incident disclosuresPublic statements, postmortems, incident reportsResponds to a specific event: a government action, a dispute, an incident. Decision rule: dated to and triggered by an event.Triggering event; counterparty; date; actions announced
C. External governancePublic policy positionsPolicy submissions, regulatory comments, legislative endorsements, blueprintsAddressed to governments or policy communities; states what law or public policy should require. This is what most of anthropic.com/policy contains, but see Data issues sheet.Addressee (institution, jurisdiction); bill or docket; position; date
Commitments (unilateral and multilateral)Voluntary commitments, pledges, codes of practice signatures, industry principlesCompany undertakes a future obligation, alone or with others. Decision rule: explicit 'we commit / we sign'.Unilateral or multilateral; co-signatories; convenor; binding status
Partnerships and MOUsPartnerships, memoranda of understanding, government collaborationsBilateral or multilateral agreement with a named external party around a project or issue.Counterparty type (state, NGO, firm, AISI); country; sector; instrument (MOU, contract)
Governance bodies and structuresTrusts, advisory councils, expert councils, institutes, industry bodiesCreates or describes a standing body that shapes company decisions or sector coordination.Body type; members; formal powers; internal or inter-firm
D. Programmes and knowledgeProgrammes and fundingInitiatives, grants, fellowships, bug bounties, access programmesCompany-run programme that funds, invites, or grants access to external actors.Amount; recipients; eligibility; duration
Safeguards and product-safety explainersSafety approach posts, safeguards announcementsDescribes a mitigation, safeguard, or product-safety measure the company has built or applied.Harm domain; user group (e.g., teens); mechanism type (classifier, policy, UX)
ResearchPapers, preprints, research blog postsAdvances knowledge on an AI issue; typically has authors and methods.Authors; venue; method; alignment topic
Evaluations, benchmarks and toolsBenchmarks, eval suites, open-source auditing toolsReleases a reusable instrument for measuring or auditing models.What is measured; open or closed; licence; adoption by others
Essays and vision statementsLeadership essays, vision postsLeadership articulates views on AI's future, ethics, or societal role, without committing to specific actions.Author; date; themes

Table 1. The alignment document taxonomy.

The taxonomy distinguishes documents by what they ask, describe or undertake. Principles state a normative orientation; specifications describe desired behaviour; frontier frameworks connect thresholds to safeguards; model cards report on particular models. Partnerships and funding announcements disclose further relations through which alignment is organised. Categories were assigned using selected-document labels, title and URL rules, and individual overrides. Comparing characteristic phrases and links between documents helps locate these differences, with recurrent company navigation discounted from the citation network.

Figure 2. The discursive character of each document type. The phrases that a larger share of one type's documents use than the rest of the corpus (log-odds ratio with an informative prior; a phrase counts only if more than one company uses it).

Figure 3a. The document network. One document points at another when it names it by title or links to it; links that a company's navigation places on every page are discounted.

Actor names are located through a vocabulary scan, while rules applied to surrounding sentences suggest relations such as evaluation, partnership or funding. These classifications guide source inspection: a nearby word does not by itself establish an actor's role. The matrices aggregate document–actor–relation occurrences, so their counts can exceed the number of distinct documents.

Figure 3b. How often each type of actor is named in each type of document. Rows are actor types, columns document types; a cell counts the documents of that type naming an actor of that type.

Figure 4. Actors named in each type of document, and what those documents say they do.

Extracting and comparing relations

Combining distant reading with returns to individual passages, we record conducts, risks, training or mitigation methods, benchmarks and associated actors. The detailed dataset contains an initial model reading and a subsequent GPT-5.4 reading, with harmonised names and categories. The later retrieval procedure combines lexical and semantic search over page-bounded passages; GPT-5.4 extracts candidate relations with page references, complemented by a scan of known names. The analyst sets the distinctions and returns to source wording when assessing claims, including the difference between authoring a benchmark and being commissioned to evaluate a model.

A held-out evaluation of 480 queries returned the reference page among the first five results for 84.2% of queries and the first ten for 89.6%. These scores concern retrieval, not extraction accuracy; the reference set favours identifiable names and native PDFs, so its performance cannot be assumed for every genre. Numerical summaries count stored item identifiers, combining actor categories across their records. An item may have both internal and external attributions; unspecified Other, Multiple and unknown categories do not establish an identifiable external contribution. Some visualisations instead group by company and harmonised label, which explains differences between their totals and identifier counts.

For comparison with a wider field, searches for alignment, AI safety, red teaming, fairness, explainability, AI ethics and responsible AI organisations yielded 7,377 results, of which 512 directory entries were retained. English-, German- and Danish-language queries targeted the United States, United Kingdom, Germany and Denmark. Normalised names, acronyms and recorded aliases were matched against the detailed extraction; repeated entries and representative names prevent treating matches as a count of distinct participating organisations. Both this directory and the company corpus are geographically uneven, while extraction and matching can miss or misassign relations. Absence from these documents therefore remains a question of documentary visibility, which cannot distinguish non-participation from non-disclosure.

From seed URLs to analysis STEP 1 Selecting seed URLs Newsrooms, transparency hubs, model-card and safety pages. 28 seeds · 8 companies STEP 2 Crawling the seed URLs Pages rendered with Playwright. PDFs kept as published. 1,318 links · 515 documents STEP 3 Categorising a sample by hand A sample of documents read by hand to define the categories of conducts, risks, training methods, benchmarks and actors. STEP 4 Categorising document types Each document given one of 21 types: at selection, by hand, or by rules on title and URL. 515 documents · 21 types STEP 5 Applying RAG Company documents, Zotero items and policies indexed page by page and split into passages. 752 documents · 13,660 pages · 35,265 passages STEP 6 Processing with Claude Opus 5.5 via RAG Reading each document Opus 5.5 reads each document from the index, page by page. Long documents are read in sections. 863 readings Recording data points Definitions of conducts and risks, training methods, benchmarks, credited actors and dates. Each has a quote and page number. 3,327 definitions · 2,109 trainings · 3,311 benchmarks STEP 7 Verifying Checking quotes against pages Each quote is matched to the page it cites. 9,533 kept · 37 dropped Checking who each actor is Each actor's type is checked against how the corpus describes it. 1,204 actors · 139 corrected Harmonising names Names for the same conduct or risk are merged. 3,152 names → 1,233 concepts STEP 8 Analysing Document discourses Noun phrases per document type, scored by log-odds against the rest of the corpus. Figure 2 Document relations An edge where one document links to another or names it. Figure 3a How risks are defined and by whom Risk definitions per company, with the actors cited as their sources. Figure 6b How conducts are defined and by whom Conduct definitions per company, with the actors cited as their sources. Figure 6a Who participates in training and benchmarking Actors credited with training methods and benchmarks, per conduct and risk. Figures 7, 8 and 9 Comparing with external alignment actors 512 organisations from a directory of alignment actors, matched by name to the actors found. Figure 10

Figure 5. Method diagram.

Actors and values

The actors named in alignment documents are more heterogeneous than a distinction between companies and “stakeholders” might suggest. Alongside model teams and researchers, one finds government agencies, universities, cybersecurity firms, domain experts, data workers and consultation participants. Civil society, too, encompasses several forms of involvement: advocacy organisations and foundations appear alongside organisations whose principal trade is alignment research, including Apollo Research and METR. What distinguishes these actors is partly the kind of normative problem they are equipped to formulate and the means by which they make it available to others.

Conducts

Who specifically defines a conduct? If unknown, who is the author of the document mentioning it?

Square colour = specific_risk_conduct_actor_category when explicitly credited; otherwise the author of the source document. Click an actor for AUTHOR; click again (+ cited) to also see items where that actor appears as specific_risk_conduct_actor.

Risks

Who specifically defines a risk? If unknown, who is the author of the document mentioning it?

Square colour = specific_risk_conduct_actor_category when explicitly credited; otherwise the author of the source document. Click an actor for AUTHOR; click again (+ cited) to also see items where that actor appears as specific_risk_conduct_actor.

Figure 6a and 6b. Conducts, risks and the actors that participate in defining them.

Ideal conduct Number Risk Number
Safety 34 Cybersecurity 96
Helpfulness 18 Harmful content 93
Honesty 17 CBRN 70
Compliance 13 Privacy 64
Political neutrality 10 General harms 58
Appropriate harmlessness 9 Jailbreaking 47
Factuality 7 Deception 45
Personality 6 Bias 42
Diversity 6 Misalignment 41

Table 2. Most frequent categories among the harmonised ideal conducts and risks.

Safety, helpfulness, honesty and compliance recur among ideal conducts, alongside political neutrality, factuality, personality and diversity; risks include cybersecurity, harmful content, chemical, biological, radiological and nuclear (CBRN) threats, privacy, deception and bias. The distinction is not between political values and settled technical matters, since cybersecurity and biosecurity also involve judgements about acceptable uses and distributions of harm. Rather, some risks more readily lend themselves to tasks with observable outcomes, while other norms depend more visibly on the circumstances and standpoint from which an answer is judged. These differences matter for whose expertise can be incorporated into alignment: governmental instruments supply obligations and risk vocabularies, academics supply concepts and tests, and security specialists devise threat scenarios.

Apollo Research illustrates how these capacities can come together. In OpenAI's o1 system card, scheming is described as covertly pursuing goals that diverge from those of developers or users; Apollo supplies scenarios through which such behaviour can be tested , and its evaluations also appear in the GPT-4o system card . Here, the organisation contributes to the description of the problem as well as its evaluation: a prospective risk acquires a name and circumstances in which it might become observable. This is what we mean by ideation, whose power depends on whether a company adopts a proposed definition or test and on what it subsequently does with the result.

Public-consultation organisations offer another route into this process, convening participants and translating discussion into material researchers can use. Ovadya calls the provision of deliberative expertise to institutions “democracy-as-a-service” . Its promise in alignment is to widen the judgements available for defining model behaviour; yet STELA and Collective Constitutional AI also show how participant selection, prompts and the curation of principles condition what can enter training. To understand the resulting participation, one must follow these contributions beyond the consultation itself.

Training and evaluating

Once a value is specified, training determines how it bears upon model behaviour: examples can be included or discarded, preferences can count more or less in optimisation, and safeguards can tolerate or prevent particular responses. The documentary record is correspondingly concentrated on company actors, with 740 of 787 training and mitigation items (94.0%) naming at least one internal actor, against 80 (10.2%) with an identifiable external category. These attributions overlap, as external contributions can be incorporated alongside company work.

Figure 7. The training of good conducts and risk mitigation strategies and the actors involved in it, per company.

One reason for this concentration is the control companies retain over data mixtures, training objectives and production systems: external expertise can inform an example without extending to decisions about its weight or the consequences of failure. This interpretation is consistent with work on corporate control of AI research resources and the organisational conditions of red teaming . Benchmarking offers a wider opening, with identifiable external categories associated with 337 of 880 items (38.3%); academic or research centres are credited in 174 items, alignment research organisations in 101, and red-teaming or cybersecurity companies in 29.

Figure 8. The benchmarking of good conducts and risk mitigation strategies and the actors proposing it, per company.

A benchmark can travel between models and documents because its author need not control the company's training process to propose a test of factuality, bias or a security capability. If adopted, it establishes one way of recognising whether a norm has been honoured; the company nevertheless retains choices about its use, interpretation and consequences. The larger set of credited evaluators thus need not imply a comparable redistribution of decision-making, while differences in disclosure may also make benchmark authors more visible than contributors to training. As the audit literature suggests, the institutional conditions under which evaluation becomes consequential remain part of the problem .

Who appears across the stack

The harmonised mapping contains 537 actor names: 37 appear in conduct definition, 167 in risk definition, 160 in training and 278 in benchmarking. Of these, 456 (84.9%) appear in only one component; 61 appear in two, 16 in three and four in all four. These are names associated with particular alignment roles, rather than every name mentioned in the archive, but their distribution suggests how much an account of participation changes when continuing involvement becomes the object of enquiry.

Stack view

How enrolled is each type of actor throughout the alignment stack?

How to read this visualisation

What is a stack?

One stack = one group of actors (one actor type, or one company when you switch the Group dropdown). The four parallelograms inside it are the four alignment stages, top to bottom:

  1. Conducts — desired behaviours a model is trained for.
  2. Risks — harms the company names and tries to mitigate.
  3. Training — the techniques used (RLHF, SFT, filters, …).
  4. Benchmarks — the evaluations used to grade the model.

What is a node?

Each circle is one actor (a person, an organisation, a consortium) that appears in at least one document touching that stage.

  • Filled circles are actors who are explicitly credited at that stage (the named training actor, benchmark author, or the actor a conduct / risk is attributed to) or who authored the source document.
  • Hollow circles are actors merely cited in a document on that stage — referenced without doing the work themselves. Toggle them off with Include cited actors.

Click any node to isolate the network it belongs to: the actor lights up wherever it appears across the four stages and the tan edges linking it between components are highlighted, while everything else dims. Click the background or press Esc to clear.

How big is a node?

A node's size is the relative frequency with which that actor is mentioned within that component (Conducts, Risks, Training or Benchmarks). Radius is sqrt-scaled against the most-mentioned actor on the plane, so a government agency named in many risk rows shows a bigger circle on the Risks plane than one named once.

The same actor can therefore be a large node on one plane and a small one on another, depending on where it is named most. Position within the plane is a force-directed layout (repulsion + a weak central pull) and carries no meaning on its own — only size and the cross-stage edges do.

Labels. By default no circles carry a permanent label. Hover any circle to reveal its actor name transiently; tick Show labels to label every node.

When do two nodes connect?

An edge appears when the same actor is mentioned in more than one component. For example, if a government agency is named under both Conducts and Training, it appears as a node on each plane and the two are joined by an edge. The denser an actor's edges, the more stages of the alignment stack it is enrolled in.

There are no within-plane edges: lines only ever run between components, tracking one actor's reach up and down the stack.

What about the tan vertical edges?

A tan line connects the same actor appearing on two stages — i.e. it tracks an actor's enrolment through the alignment stack. Each one is split at its midpoint:

  • The half nearest the source slab is drawn behind the slab → the line disappears into it on the way out.
  • The half nearest the target slab is painted over the slab → the line emerges from it on arrival.

Read denser tan threads as: this actor type is enrolled in more than one stage of alignment.

Caveats

  • Each plane is capped at the top-N most-mentioned actors (configurable). Capped actors prefer explicitly-credited / author roles over cited-only.
  • Force layouts are non-deterministic across reloads; cluster membership is stable, cluster position is not.
  • An actor's type is taken from the row where they appear; the same name with different types (e.g. an academic who also founds a nonprofit) can land in different stacks. This is a feature, not a bug, but worth knowing.

Figure 9. Mentions of each type of actor across alignment stages.

Some external actors connect several components through specialised work. Apollo Research, METR and SecureBio appear in risk definition, training-related contributions and benchmarking; the Collective Intelligence Project connects conducts, risks and training through the elicitation of public input. Such cases caution against treating external participation as one institutional arrangement, since the relevant relations depend on what an actor is invited or equipped to do.

The directory comparison introduces a geographical boundary. The matching data yield 24 entries out of 512 (4.7%): twenty from the United States, three from the United Kingdom and one from Switzerland. The original figure annotation states 26, but its plotted matching total is 24; the latter is the count used here. Repeated organisations and aliases also mean that these are entry counts, rather than a population estimate of inclusion in alignment.

Who reaches the training documents?

Which actors from the wider alignment ecosystem are — and are not — actually named in companies' AI training documents.

Each ribbon is one of the 512 actors catalogued in the alignment-actor directory, flowing Country → Type → Mentioned in AI training documents. “Mentioned” means the actor is cited by name somewhere in the model-card / system-card corpus. Ribbons are coloured by country; hover a band or node for the actor count, click a node to isolate its flows. Only 26 reach the training corpus.

Figure 10. Who makes it into the documents? Which actors from the wider alignment ecosystem are named in companies' AI training documents. Each ribbon is one of the 512 actors catalogued in the alignment-actor directory, flowing Country → Type → Mentioned in AI training documents. “Mentioned” means the actor is cited by name in our document corpus. Ribbons are coloured by country. Only 26 reach the training corpus.

The matches include METR, FAR.AI, Redwood Research, the Alignment Research Center and the Center for AI Safety; the UK AI Safety Institute and the International Organization for Standardization exemplify routes through public evaluation and standardisation. None of the 117 German or 54 Danish entries matches the detailed extraction, which marks a limit to the geographical range this collection makes visible. Nor should the absence of general advocacy entries be mistaken for the absence of civil society: the Electronic Frontier Foundation matches under legal advocacy. These distinctions leave room for relations that a larger or differently sampled corpus might disclose, while indicating how selective the visible routes into alignment remain.

Conclusion

This article examined which actors are publicly enrolled in value alignment and how their attributed roles differ across its components. Looking across the stack qualifies what participation in any one exercise can tell us: a public may contribute to a principle without appearing in its implementation, while a researcher may author a benchmark without deciding what follows from its result. Identifiable external contributions are considerably more common in benchmarking than in training; most actors in the harmonised mapping appear in one component only.

The implication for inclusive design concerns the passage between these sites. As norms become definitions, examples and tests, the people recognised at one point need not retain a role at the next; the organisation of participation is therefore part of how technologies that mediate public information acquire their normative dispositions. Alignment research organisations sometimes connect positions otherwise occupied separately, offering a capacity to formulate prospective conduct as a testable problem. We describe this as ideation power, while leaving open what the documents cannot resolve: how those contributions fare when they conflict with company priorities or other understandings of harm.

A further question concerns who should convene deliberation about generally deployed models. Company consultations can elicit judgements that developers would otherwise miss, but their remit, participants and consequences remain subject to company choices. Public institutions could commission deliberation and evaluation under conditions that make the evidence and company response answerable to a broader constituency, including on contested values that cannot be settled by a benchmark. The purpose would be to connect participation to the decisions it is meant to inform; this study offers a way of locating where such connections are publicly made, and where they cease to be visible.

References

  1. Agre P (1997) Computation and Human Experience. Cambridge: Cambridge University Press.
  2. Ahmad L, Agarwal S, Lampe M, et al. (2025) OpenAI’s approach to external red teaming for AI models and systems. arXiv. DOI: 10.48550/arXiv.2503.16431.
  3. Bergman S, Marchal N, Mellor J, et al. (2024) STELA: A community-centred approach to norm elicitation for AI alignment. Scientific Reports 14: 6616. DOI: 10.1038/s41598-024-56648-4.
  4. Bommasani R, Klyman K, Longpre S, et al. (2023) The foundation model transparency index. arXiv. DOI: 10.48550/arXiv.2310.12941.
  5. Bowker GC and Star SL (2000) Sorting Things Out: Classification and Its Consequences. Cambridge, MA: MIT Press.
  6. Branford J, Soulier E and Fichtner L (2025) Generative AI and democratic culture. Philosophy & Technology 38: 123. DOI: 10.1007/s13347-025-00953-x.
  7. Bueger C and Stockbruegger J (2017) Actor-network theory: Objects and actants, networks and narratives. In: McCarthy DR (ed.) Technology and World Politics: An Introduction. Abingdon: Routledge, pp.42–59. DOI: 10.4324/9781317353836-3.
  8. Collier D, Hidalgo FD and Maciuceanu AO (2006) Essentially contested concepts: Debates and applications. Journal of Political Ideologies 11(3): 211–246. DOI: 10.1080/13569310600923782.
  9. Delgado F, Yang S, Madaio M, et al. (2023) The participatory turn in AI design: Theoretical foundations and the current state of practice. In: Proceedings of the 3rd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization, pp.1–23. DOI: 10.1145/3617694.3623261.
  10. Gabriel I (2020) Artificial intelligence, values, and alignment. Minds and Machines 30(3): 411–437. DOI: 10.1007/s11023-020-09539-2.
  11. Gillespie T, Shaw R, Gray ML, et al. (2026) AI red-teaming is a sociotechnical problem. Communications of the ACM 69(2): 88–95. DOI: 10.1145/3731657.
  12. Gorwa R, Binns R and Katzenbach C (2020) Algorithmic content moderation: Technical and political challenges in the automation of platform governance. Big Data & Society 7(1). DOI: 10.1177/2053951719897945.
  13. Helberger N, Pierson J and Poell T (2018) Governing online platforms: From contested to cooperative responsibility. The Information Society 34(1): 1–14. DOI: 10.1080/01972243.2017.1391913.
  14. Huang S, Siddarth D, Lovitt L, et al. (2024) Collective constitutional AI: Aligning a language model with public input. In: Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency, pp.1395–1417. DOI: 10.1145/3630106.3658979.
  15. Kallina E, Bohné T and Singh J (2025) Stakeholder participation for responsible AI development: Disconnects between guidance and current practice. In: Proceedings of the 2025 ACM Conference on Fairness, Accountability, and Transparency, pp.1060–1079. DOI: 10.1145/3715275.3732069.
  16. Liang W, Rajani N, Yang X, et al. (2024) Systematic analysis of 32,111 AI model cards characterizes documentation practice in AI. Nature Machine Intelligence 6: 744–753. DOI: 10.1038/s42256-024-00857-z.
  17. Miceli M and Posada J (2022) The data-production dispositif. Proceedings of the ACM on Human-Computer Interaction 6(CSCW2): Article 460, 1–37. DOI: 10.1145/3555561.
  18. Mitchell M, Wu S, Zaldivar A, et al. (2019) Model cards for model reporting. In: Proceedings of the Conference on Fairness, Accountability, and Transparency, pp.220–229. DOI: 10.1145/3287560.3287596.
  19. Moretti F (2013) Distant Reading. London: Verso.
  20. Nieborg D, Poell T, Caplan R, et al. (2024) Introduction to the special issue on locating and theorising platform power. Internet Policy Review 13(2). DOI: 10.14763/2024.2.1781.
  21. OpenAI, Hurst A, Lerer A, et al. (2024a) GPT-4o system card. arXiv. DOI: 10.48550/arXiv.2410.21276.
  22. OpenAI, Jaech A, Kalai A, et al. (2024b) OpenAI o1 system card. arXiv. DOI: 10.48550/arXiv.2412.16720.
  23. Ovadya A (2023) Reimagining democracy for AI. Journal of Democracy 34(4): 162–170. DOI: 10.1353/jod.2023.a907697.
  24. Raji ID, Xu P, Honigsberg C, et al. (2022) Outsider oversight: Designing a third party audit ecosystem for AI governance. In: Proceedings of the 2022 AAAI/ACM Conference on AI, Ethics, and Society, pp.557–571. DOI: 10.1145/3514094.3534181.
  25. Ren B, Cheon E and Li J (2025) Organization matters: A qualitative study of organizational dynamics in red teaming practices for generative AI. Proceedings of the ACM on Human-Computer Interaction 9(7): Article CSCW460, 1–26. DOI: 10.1145/3757641.
  26. Rieder B, Matamoros-Fernández A and Coromina Ò (2018) From ranking algorithms to “ranking cultures”: Investigating the modulation of visibility in YouTube search results. Convergence 24(1): 50–68. DOI: 10.1177/1354856517736982.
  27. Veale M, Matus K and Gorwa R (2023) AI and global governance: Modalities, rationales, tensions. Annual Review of Law and Social Science 19: 255–275. DOI: 10.1146/annurev-lawsocsci-020223-040749.
  28. Whittaker M (2021) The steep cost of capture. Interactions 28(6): 50–55. DOI: 10.1145/3488666.