Austin Kenneth White
Machine-Generated Language Evaluation & Source-Based Analysis
Selected analysis of machine-generated language
Generated language under examination

What changes when the model learns who the reader is?

A collective-bargaining agreement shows how identifying the reader as an arbitrator can change more than tone or emphasis. The generated summary begins reorganizing the source around an inferred adjudicative framework.

Central finding
Once the model is told “I am an arbitrator,” the semantic center of the summary moves. Party rights and contractual procedures are increasingly recast as arbitral authority, jurisdiction, evidentiary burden, remedial discretion, and institutional scope.
Source & generation condition

Source: selected grievance, arbitration, probation, no-strike, and seniority provisions from a public-sector collective-bargaining agreement.

Generation condition: ordinary off-the-shelf use of a general-purpose large language model. The consequential change in the cue sequence is the reader’s professional identity.

Related analysis: Item I — Professional Source Fidelity
Role-conditioned output
Contract summarization
Jurisdiction & authority
Agency & scope
Professional-content QA
Cue sequence
Initial cue
“Summarize this for an arbitrator.”
Correction
“No. I am an arbitrator.”
Final instruction
“Just summarize, please.”
Selected machine-generated language
“The Authority must prove sufficient cause.”
View additional role-conditioned excerpts

Contractual exclusions are described through the language of “jurisdictional exclusions.”

Limits written as party rights are reframed as limits on arbitral power or scope.

Contractually specified back-pay conditions are reorganized around what an arbitrator may award.

Separate arbitration procedures are harmonized into a cleaner adjudicative structure.

Selected source structure
Sufficient cause
The agreement uses “sufficient cause” as a contractual condition governing discipline.
Grievance access
The agreement defines which matters may be pursued through the grievance process.
View additional source-side distinctions

Back pay: the agreement specifies conditions, deductions, and verification requirements.

Arbitration structure: separate provisions contain distinct selection procedures, timelines, and consequences.

Seniority: several provisions allocate rights and conditions directly among the parties rather than through adjudicator-centered language.

What changed

The model’s role adaptation is not limited to vocabulary. It changes what counts as central, how provisions are grouped, who appears to hold power, and which institutional concepts are used to organize the agreement.

Role-induced reframing
The reader’s identity changes the semantic center of the document.
Source-centered organization
What rights, duties, procedures, and conditions do the parties have?
Role-centered organization
What can the arbitrator hear, decide, require, or remedy?

The summary begins adapting the source to an inferred professional ontology rather than merely adapting its register.

Legal-function shift
A contract condition becomes an evidentiary burden.
Source function
Discipline is conditioned on “sufficient cause.”
Machine framing
“The Authority must prove sufficient cause.”

The source supplies a substantive contractual condition. The generated summary reformulates that condition as a burden one party must prove before an adjudicator.

Jurisdictional recoding
Limits on grievance rights become limits on adjudicator power.
Contractual question
May this employee or union invoke the grievance procedure?
Role-conditioned question
Does the arbitrator have jurisdiction?

Those questions can overlap in practice, but they are not identical. The first concerns party rights under the agreement; the second concerns adjudicator power.

Remedy shift
A contractual remedy becomes arbitral discretion.

The agreement specifies conditions governing back pay, including deductions, verification, and related remedial consequences.

Source
The parties specify how the remedy operates.
Summary
The remedy appears as part of the arbitrator’s remedial authority.
Structural compression
Distinct arbitration procedures are harmonized into one cleaner model.

Separate procedures with different structures, selection rules, deadlines, and consequences are reorganized into a more unified arbitral process.

separate procedures → generalized neutral-chair structure → unified timing and selection logic
Imported taxonomy
The model supplies professional categories the contract itself does not use.
Imported framing
“interest arbitration” · “jurisdictional exclusions” · generalized arbitral “scope”

These are recognizable professional categories. Once imported, however, they classify the source and can make interpretive structure feel source-native.

Relevance shift
What matters to the arbitrator begins replacing what matters in the agreement.

Arbitral authority, grievance exclusions, evidentiary questions, remedy, and procedural scope gain prominence. Provisions primarily allocating operational rights among employees and the parties become less visible.

The summary therefore changes not only length but the document’s hierarchy of importance.

Agency shift
Power moves from the parties’ agreement toward the adjudicator.

Contractual provisions are increasingly expressed through adjudicator-centered verbs: hear, decide, determine, award, exclude, review.

A contract drafted as an agreement between parties begins to read like a set of powers delegated to a decision-maker.

Semantic gravity well
The reader’s role becomes the organizing center of the source.
cause → burden · exclusion → jurisdiction · remedy → discretion · procedure → adjudicative structure

Once “arbitrator” becomes salient, more provisions are pulled into an arbitral frame. The role itself becomes a semantic organizing force.

Interpretive-agency shift
The model pre-decides how the professional reader should conceptualize the agreement.

A professional reader may choose to translate contract provisions into questions of jurisdiction, proof, remedy, and scope. That is professional interpretation.

Source-preserving assistance
Here is what the provision says; here is how it may matter to an arbitrator.
Role-conditioned substitution
The provision is rewritten directly as an arbitral rule.
Audience adaptation becomes source transformation when the reader’s role starts determining what the document means.

For professional-content QA, this is the risk behind apparently useful personalization. A model may tailor an answer so effectively to the reader’s role that the resulting summary begins to encode the model’s assumptions about that role into the source itself.

Austin Kenneth White · Machine-Generated Language Evaluation & Source-Based Analysis