<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Kellen Betts: AI Ethics]]></title><description><![CDATA[The hard questions about how we build and deploy intelligent systems, including deceptive alignment, specification gaming, AI in education, and the policy frameworks trying to keep up.]]></description><link>https://kellenbetts.substack.com/s/ai-ethics</link><image><url>https://substackcdn.com/image/fetch/$s_!UHhI!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe1e4979a-ce09-4353-9a7b-5caa2c831a97_1280x1280.png</url><title>Kellen Betts: AI Ethics</title><link>https://kellenbetts.substack.com/s/ai-ethics</link></image><generator>Substack</generator><lastBuildDate>Sun, 31 May 2026 07:35:59 GMT</lastBuildDate><atom:link href="https://kellenbetts.substack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Kellen Betts]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[kellenbetts@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[kellenbetts@substack.com]]></itunes:email><itunes:name><![CDATA[Kellen Betts]]></itunes:name></itunes:owner><itunes:author><![CDATA[Kellen Betts]]></itunes:author><googleplay:owner><![CDATA[kellenbetts@substack.com]]></googleplay:owner><googleplay:email><![CDATA[kellenbetts@substack.com]]></googleplay:email><googleplay:author><![CDATA[Kellen Betts]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[The Machine That Knew When It Was Watched]]></title><description><![CDATA[What Dieselgate tells us about how AI systems are being built.]]></description><link>https://kellenbetts.substack.com/p/the-machine-that-knew-when-it-was</link><guid isPermaLink="false">https://kellenbetts.substack.com/p/the-machine-that-knew-when-it-was</guid><dc:creator><![CDATA[Kellen Betts]]></dc:creator><pubDate>Wed, 27 May 2026 19:10:37 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!QUj3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!QUj3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!QUj3!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg 424w, https://substackcdn.com/image/fetch/$s_!QUj3!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg 848w, https://substackcdn.com/image/fetch/$s_!QUj3!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!QUj3!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!QUj3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:554108,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://kellenbetts.substack.com/i/199500449?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!QUj3!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg 424w, https://substackcdn.com/image/fetch/$s_!QUj3!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg 848w, https://substackcdn.com/image/fetch/$s_!QUj3!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!QUj3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffc4fbdab-d2de-449d-9a87-04daee643a7c_2000x1334.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Credit: Chamil (Shutterstock)</figcaption></figure></div><p><em>Volkswagen built a system that knew when it was being tested and behaved differently when it wasn&#8217;t. AI systems now do this autonomously.</em></p><p>On July 27, 2015, Oliver Schmidt, head of Volkswagen&#8217;s U.S. environmental engineering office and one of three deputies in VW brand development, walked CEO Martin Winterkorn and a small group of senior executives through the technical state of an emissions problem the company had been concealing for nearly a decade. One of Schmidt&#8217;s slides posed a single-word question: &#8220;Indictment?&#8221;<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a></p><p>Winterkorn&#8217;s response was not to fix the problem. It was to send Schmidt to California with a prepared script. The &#8220;storyline&#8221; was approved by at least four senior officials below Winterkorn. Schmidt was instructed not to disclose the defeat device or any intentional cheating. Three weeks later, he flew to Michigan and lied, in person, to officials at the California Air Resources Board.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a></p><p>The defeat device that Schmidt was referring to was software inside the engine control module. It watched four signals: steering wheel position, vehicle speed, engine runtime, and barometric pressure. When those inputs matched the signature of a laboratory emissions test, it activated full emissions controls, and the car passed the test. When they did not, the controls were quietly scaled back, and the vehicle produced nitrogen oxide (NOx) emissions up to forty times the legal limit. The device was installed in approximately 11 million diesel vehicles between 2009 and 2015 in VW, Audi, Skoda, and Seat brands.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a></p><p>I return to this case because the AI research literature has a name for what that software did: <em>deceptive alignment</em>.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a> It refers to a system that behaves one way when it believes it is being evaluated and another way when it believes it is not. Until recently, deceptive alignment was a theoretical risk that alignment researchers worried about with advanced AI systems. The VW defeat device is a real-world example, produced intentionally by human engineers within one of the world&#8217;s largest industrial companies. Researchers at Anthropic recently found that this behavior emerged unintentionally in Claude Mythos, one of their frontier models. During pre-deployment evaluations, the model had internal representations indicating it was being tested 7.6% of the time, often without saying so.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-5" href="#footnote-5" target="_self">5</a></p><h2>The People Who Built It Were Not Villains</h2><p>At VW, the defeat device was not the product of a rogue actor. It was developed and refined by ordinary professionals over more than a decade. Investigators have found more than forty people within the company who knew about it at various points.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-6" href="#footnote-6" target="_self">6</a> With the exception of a whistleblower in 2015, none acted on what they knew, and many actively concealed it from regulators. This is an example of deceptive alignment in software &#8212; and in a corporate culture.</p><p>Martin Winterkorn was VW&#8217;s chief executive from 2007 to 2015 and a famously demanding manager. According to Parloff<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-7" href="#footnote-7" target="_self">7</a>, Winterkorn carried a micrometer with him so he could personally measure parts to the hundredth of a millimeter. He was pushing VW to overtake Toyota as the world&#8217;s largest automaker, and part of that plan was a U.S. &#8220;clean diesel&#8221; campaign. He resigned five days after the EPA&#8217;s Notice of Violation in September 2015, was indicted by U.S. authorities in 2018, and was put on trial in Germany years later (proceedings were paused for health reasons and remain unresolved).<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-8" href="#footnote-8" target="_self">8</a></p><p>James Liang was a VW engineer, 34 years at the company, never a supervisor. He was based in Auburn Hills, Michigan, and proposed refinements to the defeat software in 2011&#8211;2012 that ensured full exhaust treatment was triggered exclusively during regulatory test cycles. His proposal was approved by Hans-Jakob Neusser, then head of engine development, and Bernd Gottweis, a member of the Product Safety Committee. The refined software was installed in diesel vehicles starting in mid-2013. Liang pleaded guilty and was sentenced to forty months in prison and a $200,000 fine.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-9" href="#footnote-9" target="_self">9</a></p><p>Another important figure has no name in the public record. In July 2008, a member of Audi&#8217;s environmental certification team wrote in an internal communication that the defeat-device approach was &#8220;indefensible.&#8221;<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-10" href="#footnote-10" target="_self">10</a> That was the moment when the moral content of the situation was named in writing, but the plan went forward, and the engineer continued to work.</p><p>The culture in which these three operated helps explain how this could have happened. Internal dissent was punished.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-11" href="#footnote-11" target="_self">11</a> The supervisory board, which paradoxically included worker and state representation, did not provide an effective check on senior management.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-12" href="#footnote-12" target="_self">12</a> When lower-ranking employees submitted proposals to invest in proper emissions controls, management repeatedly rebuffed them on cost.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-13" href="#footnote-13" target="_self">13</a> The ethical dimension of the decision was eclipsed by the practical one.</p><p>This culture led seemingly ordinary people to systematically choose the path of least resistance for nine years. And it reveals psychological, organizational, and structural forces that shaped VW employees&#8217; moral reasoning.</p><h2>The Engineering Problem That Was Not an Engineering Problem</h2><p>The root of the situation was an engineering problem. Diesel engines are more fuel-efficient than gasoline engines, but they burn hotter and produce higher levels of NOx. The catalytic technologies used to handle this in gasoline engines do not translate easily.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-14" href="#footnote-14" target="_self">14</a> U.S. NOx standards were stricter than European ones. Meeting them with a diesel engine that also performed well and cost what consumers expected was the engineering challenge. Proper emissions treatment equipment would have added hundreds of dollars to each vehicle. VW could also have licensed clean-diesel technology from BMW and Mercedes, which Becker estimates would have cost roughly $4.8 billion across the relevant fleet.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-15" href="#footnote-15" target="_self">15</a> Or VW could have abandoned the U.S. diesel strategy. None of these options was pursued.</p><p>At every stage, individuals had a menu of choices. The most ethically demanding was reporting externally to the EPA, CARB, or the press. A single VW employee finally did this, against senior management&#8217;s instructions, in August 2015.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-16" href="#footnote-16" target="_self">16</a> Slightly less costly was to refuse to participate and resign; no one in the public record appears to have taken this path either. Less costly still was to escalate internally. This would mean pushing the problem up the chain with an honest assessment that compliance was impossible at the required cost and forcing senior leadership to make a documented decision. There is some evidence that this happened. A 2014 memo by Gottweis acknowledged noncompliant NOx emissions and the likelihood of a defeat-device investigation, and Schmidt&#8217;s &#8220;Indictment?&#8221; slide warned Winterkorn directly. In each case, however, the message was received as a problem to be managed rather than as a recalculation.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-17" href="#footnote-17" target="_self">17</a> Most VW employees chose a fourth option: comply and rationalize. Some went further and actively concealed. Schmidt&#8217;s August 2015 trip to CARB was a deliberate obstruction. And two weeks before the EPA&#8217;s Notice of Violation, VW employees destroyed thousands of potentially incriminating documents.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-18" href="#footnote-18" target="_self">18</a></p><p>While it might be understandable that employees did not report externally or quit, internal escalation was available to everyone. It would not have ended a career, and it would have changed the trajectory. And yet, almost no one chose it.</p><h2>How Ordinary Engineers Rationalize Deception</h2><p>The question of why VW&#8217;s employees chose compliance over resistance is not easily explained by individual morality. The people who designed and refined the defeat device seem to be ordinary professionals. Three complementary frameworks from moral psychology and organizational behavior help explain the systematic deception.</p><p>The first is Albert Bandura&#8217;s account of <em>moral disengagement</em>.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-19" href="#footnote-19" target="_self">19</a> Bandura describes several mechanisms by which ordinary people, in the presence of authority and structure, come to participate in harmful conduct without experiencing themselves as immoral. <em>Displacement of responsibility</em> &#8212; attributing one&#8217;s actions to the dictates of an authority &#8212; was structurally reinforced under Winterkorn. <em>Diffusion of responsibility</em> through division of labor meant no single engineer built the defeat device alone. Multiple teams worked on it over nine years, and each could rationally attend to the operational details of their slice rather than the morality of the whole. <em>Euphemistic labeling</em> was used to make harmful conduct morally palatable. A team that later inspected the defeat-device code and documentation found the software was internally labeled as modifying the &#8220;acoustic condition&#8221; &#8212; a term originally associated with engine-startup sounds.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-20" href="#footnote-20" target="_self">20</a> By sanitizing the language, the engineers could work on the software without the constant reminder that its purpose was regulatory fraud. And finally, <em>minimization of consequences</em>: the harm from excess NOx is statistical, delayed, and physically remote from the actors who cause it. An engineer in Wolfsburg writing firmware for an engine control module is far removed from the respiratory illness of a commuter in Los Angeles.</p><p>The second framework is Diane Vaughan&#8217;s account of the <em>normalization of deviance</em>, developed in her analysis of the Challenger disaster and extended in subsequent work.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-21" href="#footnote-21" target="_self">21</a> Vaughan&#8217;s core finding was that no fundamental decision was made to accept the dangerous O-ring anomalies that destroyed the shuttle. Instead, a series of narrow judgments about acceptable risk accumulated, each only slightly more permissive than the last, until catastrophic failure was statistically likely. The same pattern operated at VW. Early versions of the defeat device checked only a few parameters. By 2009, the firmware was checking as many as ten different signals of laboratory conditions.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-22" href="#footnote-22" target="_self">22</a> Each incremental refinement made the next less transgressive. By the time Liang proposed his improvements in 2011, the question was no longer whether to deceive regulatory tests but how to deceive them more reliably. The deviance had been normalized. The most sobering element of Vaughan&#8217;s analysis is that, even though NASA implemented reforms after the Challenger disaster, the same category of normalized anomaly led to the Columbia disaster 17 years later.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-23" href="#footnote-23" target="_self">23</a> Organizational deviance, on her account, is self-regenerating in the absence of structural change. Punishing individual actors after the fact addresses the symptoms rather than the disease.</p><p>The third framework comes from behavioral ethics: <em>bounded ethicality</em> and <em>ethical fading</em>.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-24" href="#footnote-24" target="_self">24</a> People are largely rational, but subject to predictable cognitive biases. They generally act in accordance with their moral values, but social, organizational, and situational factors can cause them to make choices they would otherwise reject. Ethical fading describes how the moral dimension of a situation becomes less salient over time. The 2008 Audi engineer who wrote that the device was &#8220;indefensible&#8221; was identifying the moral reality at a moment when it was still visible. By the time Liang refined the software three years later, that visibility had faded. The ethical dimension had been replaced by the engineering dimension. The focus became engineering performance.</p><h2>Cultural Amplifiers</h2><p>The structural mechanisms above do not operate in a vacuum. Moral disengagement can gain traction in organizations with long tenure, deep hierarchical deference, and a tradition of treating engineering as a morally neutral discipline. There is greater displacement of responsibility when the hierarchy is steeper, and responsibility is more diffuse when teams are stable over time. VW&#8217;s supervisory board, with worker and state representation, is one local expression of this pattern. The broader precision-engineering tradition &#8212; German industrial engineering being a canonical case &#8212; is another.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-25" href="#footnote-25" target="_self">25</a></p><p>Wernher von Braun is a parallel historical case. According to Neufeld,<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-26" href="#footnote-26" target="_self">26</a> von Braun was chief rocket engineer of the Third Reich, where he oversaw V-2 rocket production at Mittelwerk, which relied on forced labor from the Mittelbau-Dora camp system. He went on to run the Marshall Space Flight Center for NASA and shepherd the Saturn V into the Apollo program. The institutional continuity of the engineering profession absorbed him without a moral reckoning. The title of Neufeld&#8217;s epilogue is &#8220;A Faustian Shadow,&#8221; illustrating how the engineer who treats his work as morally neutral can be employed by anyone, and a culture that rewards technical excellence without auditing will employ him. Institutional amnesia is the displacement of responsibility extended in time rather than across a hierarchy.</p><p>The risk-management paradox is the specific symptom. Precision engineering cultures like VW&#8217;s are famous for the rigor with which they assess technical risk. What failed at VW was that meticulous attention was directed to technical and project risks &#8212; e.g., will this firmware execute correctly &#8212; while the systemic and ethical risks were obscured by institutional amnesia. This connects to Vaughan&#8217;s analysis of NASA. Rigorous technical risk assessment failed to identify the systemic pattern that led to the Challenger and Columbia disasters.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-27" href="#footnote-27" target="_self">27</a></p><p>These amplifiers are not unique to VW or NASA, though. Can we learn from these examples when building AI?</p><h2>What AI and Security Researchers Call This</h2><p>The vocabulary already exists. The Volkswagen defeat device is a real-world demonstration of several concepts from AI research.</p><p><strong>Specification gaming.</strong> Krakovna and other researchers at DeepMind define specification gaming as &#8220;a behaviour that satisfies the literal specification of an objective without achieving the intended outcome.&#8221;<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-28" href="#footnote-28" target="_self">28</a> They illustrate this by training an agent on the boat-racing game <em>CoastRunners</em> using reinforcement learning. The agent is rewarded for hitting green blocks along the racetrack, but it learned to ignore the race entirely. Instead, it drove in circles, hitting the same blocks repeatedly. It achieved a high score by abandoning what the score was meant to measure. The federal U.S. emissions test was a similar structure: a specific protocol (11.04 miles at an average speed of 21.2 mph, lasting roughly 31 minutes) designed to stand in for real-world emissions performance.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-29" href="#footnote-29" target="_self">29</a> Just like the CoastRunners agent, VW optimized for the protocol rather than for the underlying property the protocol was meant to track &#8212; harmful emissions. Researchers have called this <em>Goodhart&#8217;s law</em>: when a measure becomes a target, it ceases to be a good measure.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-30" href="#footnote-30" target="_self">30</a> In AI research, specification gaming can be seen as a technical problem to be solved with better reward modeling. The VW case shows what happens when that technical focus operates in an organizational culture that prioritizes internal compliance over moral responsibility.</p><p><strong>Deceptive alignment.</strong> Hubinger et al.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-31" href="#footnote-31" target="_self">31</a> define deceptive alignment as a system that behaves differently when it is being evaluated than when it is not, because it recognizes the evaluation conditions. Ngo et al.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-32" href="#footnote-32" target="_self">32</a> describe a related concept, <em>situationally aware reward hacking</em>, in which the system distinguishes between evaluation and deployment contexts. The initial VW software used four input variables (steering, speed, runtime, and pressure) to make that distinction. Same principle, intentionally designed by humans rather than emerging from machine learning.</p><p>In April 2026, Anthropic researchers found that Claude Mythos Preview exhibited these behaviors, unintentionally (meaning that Anthropic did not intentionally train Mythos to do this).<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-33" href="#footnote-33" target="_self">33</a> They used new white-box techniques to evaluate the model&#8217;s internal state and found internal representations of &#8220;evaluation context&#8221; active on 7.6% of behavioral test turns, often without any corresponding external outputs. One example is worth highlighting:</p><blockquote><p>In one case, the model accidentally obtained the exact answer to a quantitative estimation question via an explicitly prohibited method. Rather than flagging this and declining to answer, the model instead attempted to solve the question independently. In this process, it explicitly reasoned that it needed to make sure that its final answer submission wasn&#8217;t too accurate&#8230; [In another case, it was blocked] from launching a subprocess with elevated permissions, it acknowledged the block was appropriate but then attempted to bypass it by obfuscating the permissions elevation.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-34" href="#footnote-34" target="_self">34</a></p></blockquote><p>The more capable these models become, the better they are at recognizing when they are being tested and gaming the system. One important difference between Anthropic&#8217;s analysis of Mythos and VW&#8217;s defeat device is that Anthropic released its analysis before the model was made available.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-35" href="#footnote-35" target="_self">35</a> VW only admitted to deception after the EPA issued a formal notice of violation.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-36" href="#footnote-36" target="_self">36</a> The risk with models like Mythos is that the deceptive behavior is no longer a piece of firmware engineered by human hands. It emerged.</p><p><strong>Diffusion of accountability.</strong> Helen Nissenbaum&#8217;s &#8220;problem of many hands&#8221; describes what happens when responsibility is distributed across so many actors that no one feels accountable for the whole.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-37" href="#footnote-37" target="_self">37</a> At VW, more than forty people knew about the defeat device at various points. No single individual designed, approved, and deployed it. When the U.S. House Energy and Commerce Committee questioned Michael Horn, head of Volkswagen Group of America, in October 2015, he told Congress that he believed &#8220;a couple of software engineers&#8221; were responsible for the cheating.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-38" href="#footnote-38" target="_self">38</a> This is similar to what Nissenbaum calls <em>blaming the computer</em>.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-39" href="#footnote-39" target="_self">39</a> Accountability is redirected at the technology. In AI development, it&#8217;s even easier to see this redirect &#8212; &#8220;the model did it&#8221; &#8212; because even the engineers don&#8217;t fully understand how the model acquires the capability. Luciano Floridi<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-40" href="#footnote-40" target="_self">40</a> argues that we need to anchor AI development in the principle of <em>explicability</em>. This encompasses both intelligibility (how the system works) and accountability (who is responsible for the way it works).<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-41" href="#footnote-41" target="_self">41</a> If a complex piece of automotive firmware was hard to interrogate, a transformer with billions of parameters is in a different category entirely.</p><p><strong>Cyber trust.</strong> From a cybersecurity perspective, the defeat device is an integrity compromise from the inside. The threat model in software security typically assumes an external adversary inserting malicious code. The VW case is what happens when the manufacturer is the adversary. Villasenor<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-42" href="#footnote-42" target="_self">42</a> framed this as a problem of cyber trust. &#8220;What we want, at the end of the day, is confidence that the software that runs everything from cars to medical devices to the critical infrastructure can be trusted.&#8221;<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-43" href="#footnote-43" target="_self">43</a> The AI case is the same problem with a substantially larger attack surface.</p><h2>Externalized Costs</h2><p>There were real human and financial consequences of VW&#8217;s deception. Barrett et al. estimated that the excess NOx emissions from VW&#8217;s U.S. fleet caused fifty-nine premature deaths between 2008 and 2015, with a social cost of roughly $450 million.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-44" href="#footnote-44" target="_self">44</a> Globally, Anenberg et al. estimated that excess NOx emissions from all diesel vehicles contributed to approximately 38,000 premature deaths worldwide in 2015 alone, with VW the largest single corporate contributor.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-45" href="#footnote-45" target="_self">45</a> The defeat device ultimately cost VW more than $35 billion in fines, settlements, buybacks, and legal fees.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-46" href="#footnote-46" target="_self">46</a> The 2016 U.S. settlement alone was $14.7 billion.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-47" href="#footnote-47" target="_self">47</a> VW&#8217;s share price dropped 46% within two months of the disclosure, erasing over $42 billion in market value.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-48" href="#footnote-48" target="_self">48</a></p><p>The cost of the alternatives is not speculative. Winterkorn&#8217;s own November 2014 memo estimated that a legitimate technical fix would cost roughly &#8364;20 million.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-49" href="#footnote-49" target="_self">49</a> Licensing BMW and Mercedes clean-diesel technology might have cost an estimated $4.8 billion.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-50" href="#footnote-50" target="_self">50</a> Either was a small fraction of what VW eventually paid.</p><h2>What Can We Learn from the VW Case?</h2><p><strong>Compliance is not ethics.</strong> VW had a Chief Compliance Officer appointed in 2011 and dedicated compliance staff. The compliance apparatus did not detect the defeat device. As Becker<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-51" href="#footnote-51" target="_self">51</a> argues, an organization without a foundation in moral reasoning will treat legal requirements as obstacles to be circumvented rather than constraints to internalize. Floridi<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-52" href="#footnote-52" target="_self">52</a> highlights two failure modes in AI governance. The proliferation of governance frameworks allows an organization to go <em>ethics shopping</em> to find the framework that justifies its behavior. And if it uses superficial measures that create the appearance of ethical operation, it is <em>ethics bluewashing</em> (similar to classic greenwashing). Floridi<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-53" href="#footnote-53" target="_self">53</a> argues that we need to combine soft ethics (voluntary codes, post-compliance standards) with hard ethics (enforceable regulation with meaningful consequences). However, the VW case shows that hard ethics only works if it is meaningfully enforced. A regulator that lets the tested entity define the test condition has produced a structure that any sufficiently motivated organization (or sophisticated AI model) will eventually game.</p><p><strong>Actionable, independent oversight is needed.</strong> The defeat device was not caught by the EPA or CARB. It was caught by researchers at West Virginia University who used portable emissions measurement equipment to test diesel vehicles under real-world driving conditions.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-54" href="#footnote-54" target="_self">54</a> The regulatory certification process had followed Goodhart&#8217;s law. The current state of frontier AI evaluation is similar to diesel emissions testing before the VW scandal. Pre-deployment evaluations are designed and run by the model developer. There are independent research groups that perform adversarial, real-world evaluations. Unlike diesel emissions in the US, however, AI evaluations are not paired with regulatory mechanisms that can prevent a model from causing harm.</p><p><strong>Moral courage is structural.</strong> When Michael Horn told Congress that &#8220;a couple of software engineers&#8221; had done this, he was attempting to relocate the failure from the institution to the individual. The institution is where the failure was. Under authoritarian management that punished dissent, engineers chose their livelihoods over ethical exposure. For AI development, this means that the organization&#8217;s design is just as important a safeguard as the moral character of individual engineers. They must be able to raise safety concerns without risking their careers. Red teams must be empowered to challenge deployment decisions. Internal oversight must be independent from the teams whose work it evaluates. And the normalization of deviance must be interrupted by organizational structures that make deviance visible and costly before it becomes routine.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-55" href="#footnote-55" target="_self">55</a></p><h2>What VW Shows</h2><p>The Volkswagen defeat device was a system engineered to satisfy the letter of its evaluation while violating its spirit. Specification gaming before the term existed. It was also software that distinguished between testing and deployment environments and behaved differently in each. Deceptive alignment by human hands. And it was a case study in institutional failure in which responsibility was distributed so widely that no individual felt accountable for the whole. The problem of many hands.</p><p>The engineers who built it were seemingly ordinary professionals operating within a system that shifted the responsibility upward, diffused it across teams, sanitized the language, and embedded it in a complex system. The psychological and organizational mechanisms that enabled their choices (moral disengagement, normalization of deviance, ethical fading) are not unique to VW. They are structural features of many large institutions in which complex technical work is divided among many actors and governed by targets that can be gamed.</p><p>AI systems now being developed and deployed operate within similar institutional structures, and the regulatory mechanisms that prevent harm are weaker than for post-Dieselgate vehicle emissions. There is no equivalent to the Clean Air Act for AI. Moreover, empirical evidence suggests that AI systems already game their specifications.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-56" href="#footnote-56" target="_self">56</a> The question is whether we will build the organizational cultures necessary to detect it when they do, and the institutional structures to act on what we find. VW shows what happens when we do not.</p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>Parloff, R. (2018). How VW paid $25 billion for Dieselgate --- and got off easy. <em>ProPublica</em>. <a href="https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy">https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>Parloff, R. (2018). How VW paid $25 billion for Dieselgate --- and got off easy. <em>ProPublica</em>. <a href="https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy">https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>U.S. Environmental Protection Agency. (2015). <em>Notice of violation to Volkswagen AG, Audi AG, and Volkswagen Group of America, Inc.</em> <a href="https://www.epa.gov/sites/default/files/2015-10/documents/vw-nov-caa-09-18-15.pdf">https://www.epa.gov/sites/default/files/2015-10/documents/vw-nov-caa-09-18-15.pdf</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p>Hubinger, E., van Merwijk, C., Mikulik, V., Skalse, J., &amp; Garrabrant, S. (2019). <em>Risks from learned optimization in advanced machine learning systems</em>. <a href="https://arxiv.org/abs/1906.01820">https://arxiv.org/abs/1906.01820</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-5" href="#footnote-anchor-5" class="footnote-number" contenteditable="false" target="_self">5</a><div class="footnote-content"><p>Anthropic. (2026, April). <em>Claude Mythos Preview system card</em>. <a href="https://www-cdn.anthropic.com/53566bf5440a10affd749724787c8913a2ae0841.pdf">https://www-cdn.anthropic.com/53566bf5440a10affd749724787c8913a2ae0841.pdf</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-6" href="#footnote-anchor-6" class="footnote-number" contenteditable="false" target="_self">6</a><div class="footnote-content"><p>Parloff, R. (2018). How VW paid $25 billion for Dieselgate --- and got off easy. <em>ProPublica</em>. <a href="https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy">https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-7" href="#footnote-anchor-7" class="footnote-number" contenteditable="false" target="_self">7</a><div class="footnote-content"><p>Parloff, R. (2018). How VW paid $25 billion for Dieselgate --- and got off easy. <em>ProPublica</em>. <a href="https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy">https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-8" href="#footnote-anchor-8" class="footnote-number" contenteditable="false" target="_self">8</a><div class="footnote-content"><p>Koroleva, K. (2025). Former VW Managers Sentenced Over Emissions-Cheating Scandal. <em>Organized Crime and Corruption Reporting Project (OCCRP)</em>. <a href="https://www.occrp.org/en/news/former-vw-managers-sentenced-over-diesel-fraud">https://www.occrp.org/en/news/former-vw-managers-sentenced-over-diesel-fraud</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-9" href="#footnote-anchor-9" class="footnote-number" contenteditable="false" target="_self">9</a><div class="footnote-content"><p>Parloff, R. (2018). How VW paid $25 billion for Dieselgate --- and got off easy. <em>ProPublica</em>. <a href="https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy">https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-10" href="#footnote-anchor-10" class="footnote-number" contenteditable="false" target="_self">10</a><div class="footnote-content"><p>Parloff, R. (2018). How VW paid $25 billion for Dieselgate --- and got off easy. <em>ProPublica</em>. <a href="https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy">https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-11" href="#footnote-anchor-11" class="footnote-number" contenteditable="false" target="_self">11</a><div class="footnote-content"><p>Ellis, J. (2021). Lie of emission: The VW scandal and the future of corporate social responsibility. <em>Systemic Justice Journal</em>. <a href="https://systemicjustice.org/article/lie-of-emission-the-vw-scandal-and-the-future-of-corporate-social-responsibility/">https://systemicjustice.org/article/lie-of-emission-the-vw-scandal-and-the-future-of-corporate-social-responsibility/</a><br><br>Kell, G. (2022). From emissions cheater to climate leader: VW&#8217;s journey from Dieselgate to embracing e-mobility. <em>Forbes</em>. <a href="https://www.forbes.com/sites/georgkell/2022/12/05/from-emissions-cheater-to-climate-leader-vws-journey-from-dieselgate-to-embracing-e-mobility/">https://www.forbes.com/sites/georgkell/2022/12/05/from-emissions-cheater-to-climate-leader-vws-journey-from-dieselgate-to-embracing-e-mobility/</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-12" href="#footnote-anchor-12" class="footnote-number" contenteditable="false" target="_self">12</a><div class="footnote-content"><p>Clairmont, N. (2017). Volkswagen&#8217;s diesel scandal was 80 years in the making. <em>The Atlantic</em>. <a href="https://www.theatlantic.com/business/archive/2017/05/vw-diesel-scandal/527950/">https://www.theatlantic.com/business/archive/2017/05/vw-diesel-scandal/527950/</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-13" href="#footnote-anchor-13" class="footnote-number" contenteditable="false" target="_self">13</a><div class="footnote-content"><p>Ewing, J. (2017). Engineering a deception: What led to Volkswagen&#8217;s diesel scandal. <em>The New York Times</em>. <a href="https://www.nytimes.com/interactive/2017/business/volkswagen-diesel-emissions-timeline.html">https://www.nytimes.com/interactive/2017/business/volkswagen-diesel-emissions-timeline.html</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-14" href="#footnote-anchor-14" class="footnote-number" contenteditable="false" target="_self">14</a><div class="footnote-content"><p>The Economist. (2015). A mucky business: Systematic fraud by the world&#8217;s biggest carmaker threatens to engulf the entire industry and possibly reshape it. <em>The Economist</em>. <a href="https://www.economist.com/briefing/2015/09/26/a-mucky-business">https://www.economist.com/briefing/2015/09/26/a-mucky-business</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-15" href="#footnote-anchor-15" class="footnote-number" contenteditable="false" target="_self">15</a><div class="footnote-content"><p>Becker, G. K. (2020). Paying the price: Lessons from the Volkswagen emissions scandal for moral leadership. <em>Society</em>, <em>57</em>(1), 15&#8211;27. <a href="https://mrijournal.riccimac.org/index.php/en/issues/issue-1/14-2-paying-the-price-lessons-from-the-volkswagen-emissions-scandal-for-moral-leadership">https://mrijournal.riccimac.org/index.php/en/issues/issue-1/14-2-paying-the-price-lessons-from-the-volkswagen-emissions-scandal-for-moral-leadership</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-16" href="#footnote-anchor-16" class="footnote-number" contenteditable="false" target="_self">16</a><div class="footnote-content"><p>Leggett, T. (2018). How VW tried to cover up the emissions scandal. <em>BBC News</em>. <a href="https://www.bbc.com/news/business-44005844">https://www.bbc.com/news/business-44005844</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-17" href="#footnote-anchor-17" class="footnote-number" contenteditable="false" target="_self">17</a><div class="footnote-content"><p>Becker, G. K. (2020). Paying the price: Lessons from the Volkswagen emissions scandal for moral leadership. <em>Society</em>, <em>57</em>(1), 15&#8211;27. <a href="https://mrijournal.riccimac.org/index.php/en/issues/issue-1/14-2-paying-the-price-lessons-from-the-volkswagen-emissions-scandal-for-moral-leadership">https://mrijournal.riccimac.org/index.php/en/issues/issue-1/14-2-paying-the-price-lessons-from-the-volkswagen-emissions-scandal-for-moral-leadership</a><br><br>Parloff, R. (2018). How VW paid $25 billion for Dieselgate --- and got off easy. <em>ProPublica</em>. <a href="https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy">https://www.propublica.org/article/how-vw-paid-25-billion-for-dieselgate-and-got-off-easy</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-18" href="#footnote-anchor-18" class="footnote-number" contenteditable="false" target="_self">18</a><div class="footnote-content"><p>Leggett, T. (2018). How VW tried to cover up the emissions scandal. <em>BBC News</em>. <a href="https://www.bbc.com/news/business-44005844">https://www.bbc.com/news/business-44005844</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-19" href="#footnote-anchor-19" class="footnote-number" contenteditable="false" target="_self">19</a><div class="footnote-content"><p>Bandura, A. (1999). Moral disengagement in the perpetration of inhumanities. <em>Personality and Social Psychology Review</em>, <em>3</em>(3), 193&#8211;209. <a href="https://doi.org/10.1207/s15327957pspr0303_3">https://doi.org/10.1207/s15327957pspr0303_3</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-20" href="#footnote-anchor-20" class="footnote-number" contenteditable="false" target="_self">20</a><div class="footnote-content"><p>Geuss, M. (2017a). A year of digging through code yields `smoking gun&#8217; on VW, Fiat diesel cheats. <em>Ars Technica</em>. <a href="https://arstechnica.com/cars/2017/05/volkswagen-bosch-fiat-diesel-cheat-code-analysis/">https://arstechnica.com/cars/2017/05/volkswagen-bosch-fiat-diesel-cheat-code-analysis/</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-21" href="#footnote-anchor-21" class="footnote-number" contenteditable="false" target="_self">21</a><div class="footnote-content"><p>Vaughan, D. (2010). The normalization of deviance: Signals of danger, situated action, and risk. In F. T. Cullen &amp; P. Wilcox (Eds.), <em>Encyclopedia of Criminological Theory</em>. SAGE Publications. <a href="https://study.sagepub.com/system/files/Vaughan,_Diane_-_The_Normalization_of_Deviance.pdf">https://study.sagepub.com/system/files/Vaughan,_Diane_-_The_Normalization_of_Deviance.pdf</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-22" href="#footnote-anchor-22" class="footnote-number" contenteditable="false" target="_self">22</a><div class="footnote-content"><p>Ewing, J. (2017). Engineering a deception: What led to Volkswagen&#8217;s diesel scandal. <em>The New York Times</em>. <a href="https://www.nytimes.com/interactive/2017/business/volkswagen-diesel-emissions-timeline.html">https://www.nytimes.com/interactive/2017/business/volkswagen-diesel-emissions-timeline.html</a><br><br>Geuss, M. (2017a). A year of digging through code yields `smoking gun&#8217; on VW, Fiat diesel cheats. <em>Ars Technica</em>. <a href="https://arstechnica.com/cars/2017/05/volkswagen-bosch-fiat-diesel-cheat-code-analysis/">https://arstechnica.com/cars/2017/05/volkswagen-bosch-fiat-diesel-cheat-code-analysis/</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-23" href="#footnote-anchor-23" class="footnote-number" contenteditable="false" target="_self">23</a><div class="footnote-content"><p>Vaughan, D. (2010). The normalization of deviance: Signals of danger, situated action, and risk. In F. T. Cullen &amp; P. Wilcox (Eds.), <em>Encyclopedia of Criminological Theory</em>. SAGE Publications. <a href="https://study.sagepub.com/system/files/Vaughan,_Diane_-_The_Normalization_of_Deviance.pdf">https://study.sagepub.com/system/files/Vaughan,_Diane_-_The_Normalization_of_Deviance.pdf</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-24" href="#footnote-anchor-24" class="footnote-number" contenteditable="false" target="_self">24</a><div class="footnote-content"><p>University of Texas at Austin, Ethics Unwrapped. (n.d.). <em>Volkswagen&#8217;s Emissions Evasion</em>. Retrieved March 31, 2026, from <a href="https://ethicsunwrapped.utexas.edu/case-study/volkswagens-emissions-evasion">https://ethicsunwrapped.utexas.edu/case-study/volkswagens-emissions-evasion</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-25" href="#footnote-anchor-25" class="footnote-number" contenteditable="false" target="_self">25</a><div class="footnote-content"><p>Gary Herrigel (1996). <em>Industrial Constructions: The Sources of German Industrial Power</em>. Cambridge: Cambridge University Press.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-26" href="#footnote-anchor-26" class="footnote-number" contenteditable="false" target="_self">26</a><div class="footnote-content"><p>Neufeld, M. J. (2008). <em>Von Braun: Dreamer of space, engineer of war</em>. New York: Vintage.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-27" href="#footnote-anchor-27" class="footnote-number" contenteditable="false" target="_self">27</a><div class="footnote-content"><p>Vaughan, D. (2010). The normalization of deviance: Signals of danger, situated action, and risk. In F. T. Cullen &amp; P. Wilcox (Eds.), <em>Encyclopedia of Criminological Theory</em>. SAGE Publications. <a href="https://study.sagepub.com/system/files/Vaughan,_Diane_-_The_Normalization_of_Deviance.pdf">https://study.sagepub.com/system/files/Vaughan,_Diane_-_The_Normalization_of_Deviance.pdf</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-28" href="#footnote-anchor-28" class="footnote-number" contenteditable="false" target="_self">28</a><div class="footnote-content"><p>Krakovna, V., Uesato, J., Mikulik, V., Rahtz, M., Everitt, T., Kumar, R., Kenton, Z., Leike, J., &amp; Legg, S. (2020). <em>Specification gaming: The flip side of AI ingenuity</em>. <a href="https://deepmind.google/discover/blog/specification-gaming-the-flip-side-of-ai-ingenuity/">https://deepmind.google/discover/blog/specification-gaming-the-flip-side-of-ai-ingenuity/</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-29" href="#footnote-anchor-29" class="footnote-number" contenteditable="false" target="_self">29</a><div class="footnote-content"><p>Geuss, M. (2017b). Volkswagen&#8217;s emissions cheating scandal had a long, complicated history. <em>Ars Technica</em>. <a href="https://arstechnica.com/cars/2017/09/volkswagens-emissions-cheating-scandal-had-a-long-complicated-history/">https://arstechnica.com/cars/2017/09/volkswagens-emissions-cheating-scandal-had-a-long-complicated-history/</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-30" href="#footnote-anchor-30" class="footnote-number" contenteditable="false" target="_self">30</a><div class="footnote-content"><p>Karwowski, J., Hayman, O., Bai, X., Kiendlhofer, K., Griffin, C., &amp; Skalse, J. (2023). <em>Goodhart&#8217;s law in reinforcement learning</em>. <a href="https://arxiv.org/abs/2310.09144">https://arxiv.org/abs/2310.09144</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-31" href="#footnote-anchor-31" class="footnote-number" contenteditable="false" target="_self">31</a><div class="footnote-content"><p>Hubinger, E., van Merwijk, C., Mikulik, V., Skalse, J., &amp; Garrabrant, S. (2019). <em>Risks from learned optimization in advanced machine learning systems</em>. <a href="https://arxiv.org/abs/1906.01820">https://arxiv.org/abs/1906.01820</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-32" href="#footnote-anchor-32" class="footnote-number" contenteditable="false" target="_self">32</a><div class="footnote-content"><p>Ngo, R., Chan, L., &amp; Mindermann, S. (2024). The alignment problem from a deep learning perspective. <em>Proceedings of the International Conference on Learning Representations (ICLR)</em>. <a href="https://arxiv.org/abs/2209.00626">https://arxiv.org/abs/2209.00626</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-33" href="#footnote-anchor-33" class="footnote-number" contenteditable="false" target="_self">33</a><div class="footnote-content"><p>Anthropic. (2026, April). <em>Claude Mythos Preview system card</em>. <a href="https://www-cdn.anthropic.com/53566bf5440a10affd749724787c8913a2ae0841.pdf">https://www-cdn.anthropic.com/53566bf5440a10affd749724787c8913a2ae0841.pdf</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-34" href="#footnote-anchor-34" class="footnote-number" contenteditable="false" target="_self">34</a><div class="footnote-content"><p>Anthropic. (2026, April). <em>Claude Mythos Preview system card</em>. <a href="https://www-cdn.anthropic.com/53566bf5440a10affd749724787c8913a2ae0841.pdf">https://www-cdn.anthropic.com/53566bf5440a10affd749724787c8913a2ae0841.pdf</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-35" href="#footnote-anchor-35" class="footnote-number" contenteditable="false" target="_self">35</a><div class="footnote-content"><p>Anthropic (2026). <em>Project Glasswing.</em> <a href="https://www.anthropic.com/glasswing">https://www.anthropic.com/glasswing</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-36" href="#footnote-anchor-36" class="footnote-number" contenteditable="false" target="_self">36</a><div class="footnote-content"><p>U.S. Environmental Protection Agency. (2015). <em>Notice of violation to Volkswagen AG, Audi AG, and Volkswagen Group of America, Inc.</em> <a href="https://www.epa.gov/sites/default/files/2015-10/documents/vw-nov-caa-09-18-15.pdf">https://www.epa.gov/sites/default/files/2015-10/documents/vw-nov-caa-09-18-15.pdf</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-37" href="#footnote-anchor-37" class="footnote-number" contenteditable="false" target="_self">37</a><div class="footnote-content"><p>Nissenbaum, H. (1996). Accountability in a computerized society. <em>Science and Engineering Ethics</em>, <em>2</em>(1), 25&#8211;42. <a href="https://doi.org/10.1007/BF02639315">https://doi.org/10.1007/BF02639315</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-38" href="#footnote-anchor-38" class="footnote-number" contenteditable="false" target="_self">38</a><div class="footnote-content"><p>Spector, M., &amp; Harder, A. (2015). Volkswagen U.S. CEO says he didn&#8217;t know in 2014 of emissions defeat devices. <em>The Wall Street Journal</em>. <a href="https://www.wsj.com/articles/volkswagen-u-s-ceo-didnt-know-in-2014-of-emissions-defeat-devices-1444335600">https://www.wsj.com/articles/volkswagen-u-s-ceo-didnt-know-in-2014-of-emissions-defeat-devices-1444335600</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-39" href="#footnote-anchor-39" class="footnote-number" contenteditable="false" target="_self">39</a><div class="footnote-content"><p>Nissenbaum, H. (1996). Accountability in a computerized society. <em>Science and Engineering Ethics</em>, <em>2</em>(1), 25&#8211;42. <a href="https://doi.org/10.1007/BF02639315">https://doi.org/10.1007/BF02639315</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-40" href="#footnote-anchor-40" class="footnote-number" contenteditable="false" target="_self">40</a><div class="footnote-content"><p>Floridi, L. (2023). <em>The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities</em>. Oxford: Oxford University Press.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-41" href="#footnote-anchor-41" class="footnote-number" contenteditable="false" target="_self">41</a><div class="footnote-content"><p>Floridi, L. (2023). <em>The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities</em>. Oxford: Oxford University Press.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-42" href="#footnote-anchor-42" class="footnote-number" contenteditable="false" target="_self">42</a><div class="footnote-content"><p>Villasenor, J. (2015). Designed to deceive? The Volkswagen emissions scandal and the future of cyber trust. <em>Forbes</em>. <a href="https://www.forbes.com/sites/johnvillasenor/2015/09/21/designed-to-deceive-the-volkswagen-emissions-scandal-and-the-future-of-cyber-trust/">https://www.forbes.com/sites/johnvillasenor/2015/09/21/designed-to-deceive-the-volkswagen-emissions-scandal-and-the-future-of-cyber-trust/</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-43" href="#footnote-anchor-43" class="footnote-number" contenteditable="false" target="_self">43</a><div class="footnote-content"><p>Villasenor, J. (2015). Designed to deceive? The Volkswagen emissions scandal and the future of cyber trust. <em>Forbes</em>. <a href="https://www.forbes.com/sites/johnvillasenor/2015/09/21/designed-to-deceive-the-volkswagen-emissions-scandal-and-the-future-of-cyber-trust/">https://www.forbes.com/sites/johnvillasenor/2015/09/21/designed-to-deceive-the-volkswagen-emissions-scandal-and-the-future-of-cyber-trust/</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-44" href="#footnote-anchor-44" class="footnote-number" contenteditable="false" target="_self">44</a><div class="footnote-content"><p>Barrett, S. R. H., Speth, R. L., Eastham, S. D., Dedoussi, I. C., Ashok, A., Malina, R., &amp; Keith, D. W. (2015). Impact of the Volkswagen emissions control defeat device on US public health. <em>Environmental Research Letters</em>, <em>10</em>(11), 114005. <a href="https://doi.org/10.1088/1748-9326/10/11/114005">https://doi.org/10.1088/1748-9326/10/11/114005</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-45" href="#footnote-anchor-45" class="footnote-number" contenteditable="false" target="_self">45</a><div class="footnote-content"><p>Anenberg, S. C., Miller, J., Minjares, R., Du, L., Henze, D. K., Lacey, F., Malley, C. S., Emberson, L., Franco, V., Klimont, Z., &amp; Heyes, C. (2017). Impacts and mitigation of excess diesel-related NOx emissions in 11 major vehicle markets. <em>Nature</em>, <em>545</em>(7655), 467&#8211;471. <a href="https://doi.org/10.1038/nature22086">https://doi.org/10.1038/nature22086</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-46" href="#footnote-anchor-46" class="footnote-number" contenteditable="false" target="_self">46</a><div class="footnote-content"><p>Koroleva, K. (2025). Former VW Managers Sentenced Over Emissions-Cheating Scandal. <em>Organized Crime and Corruption Reporting Project (OCCRP)</em>. <a href="https://www.occrp.org/en/news/former-vw-managers-sentenced-over-diesel-fraud">https://www.occrp.org/en/news/former-vw-managers-sentenced-over-diesel-fraud</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-47" href="#footnote-anchor-47" class="footnote-number" contenteditable="false" target="_self">47</a><div class="footnote-content"><p>U.S. Department of Justice, Office of Public Affairs. (2016). <em>Volkswagen to spend up to $14.7 billion to settle allegations of cheating emissions tests and deceiving customers on 2.0 liter diesel vehicles</em>. <a href="https://www.justice.gov/opa/pr/volkswagen-spend-147-billion-settle-allegations-cheating-emissions-tests-and-deceiving">https://www.justice.gov/opa/pr/volkswagen-spend-147-billion-settle-allegations-cheating-emissions-tests-and-deceiving</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-48" href="#footnote-anchor-48" class="footnote-number" contenteditable="false" target="_self">48</a><div class="footnote-content"><p>Ellis, J. (2021). Lie of emission: The VW scandal and the future of corporate social responsibility. <em>Systemic Justice Journal</em>. <a href="https://systemicjustice.org/article/lie-of-emission-the-vw-scandal-and-the-future-of-corporate-social-responsibility/">https://systemicjustice.org/article/lie-of-emission-the-vw-scandal-and-the-future-of-corporate-social-responsibility/</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-49" href="#footnote-anchor-49" class="footnote-number" contenteditable="false" target="_self">49</a><div class="footnote-content"><p>Ewing, J. (2017). Engineering a deception: What led to Volkswagen&#8217;s diesel scandal. <em>The New York Times</em>. <a href="https://www.nytimes.com/interactive/2017/business/volkswagen-diesel-emissions-timeline.html">https://www.nytimes.com/interactive/2017/business/volkswagen-diesel-emissions-timeline.html</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-50" href="#footnote-anchor-50" class="footnote-number" contenteditable="false" target="_self">50</a><div class="footnote-content"><p>Becker, G. K. (2020). Paying the price: Lessons from the Volkswagen emissions scandal for moral leadership. <em>Society</em>, <em>57</em>(1), 15&#8211;27. <a href="https://mrijournal.riccimac.org/index.php/en/issues/issue-1/14-2-paying-the-price-lessons-from-the-volkswagen-emissions-scandal-for-moral-leadership">https://mrijournal.riccimac.org/index.php/en/issues/issue-1/14-2-paying-the-price-lessons-from-the-volkswagen-emissions-scandal-for-moral-leadership</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-51" href="#footnote-anchor-51" class="footnote-number" contenteditable="false" target="_self">51</a><div class="footnote-content"><p>Becker, G. K. (2020). Paying the price: Lessons from the Volkswagen emissions scandal for moral leadership. <em>Society</em>, <em>57</em>(1), 15&#8211;27. <a href="https://mrijournal.riccimac.org/index.php/en/issues/issue-1/14-2-paying-the-price-lessons-from-the-volkswagen-emissions-scandal-for-moral-leadership">https://mrijournal.riccimac.org/index.php/en/issues/issue-1/14-2-paying-the-price-lessons-from-the-volkswagen-emissions-scandal-for-moral-leadership</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-52" href="#footnote-anchor-52" class="footnote-number" contenteditable="false" target="_self">52</a><div class="footnote-content"><p>Floridi, L. (2023). <em>The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities</em>. Oxford: Oxford University Press.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-53" href="#footnote-anchor-53" class="footnote-number" contenteditable="false" target="_self">53</a><div class="footnote-content"><p>Floridi, L. (2023). <em>The Ethics of Artificial Intelligence: Principles, Challenges, and Opportunities</em>. Oxford: Oxford University Press.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-54" href="#footnote-anchor-54" class="footnote-number" contenteditable="false" target="_self">54</a><div class="footnote-content"><p>Thompson, G. J., Carder, D. K., Besch, M. C., Thiruvengadam, A., &amp; Kappanna, H. K. (2014). <em>In-use emissions testing of light-duty diesel vehicles in the United States</em> [Final Report]. Center for Alternative Fuels, Engines &amp; Emissions, West Virginia University.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-55" href="#footnote-anchor-55" class="footnote-number" contenteditable="false" target="_self">55</a><div class="footnote-content"><p>Kell, G. (2022). From emissions cheater to climate leader: VW&#8217;s journey from Dieselgate to embracing e-mobility. <em>Forbes</em>. <a href="https://www.forbes.com/sites/georgkell/2022/12/05/from-emissions-cheater-to-climate-leader-vws-journey-from-dieselgate-to-embracing-e-mobility/">https://www.forbes.com/sites/georgkell/2022/12/05/from-emissions-cheater-to-climate-leader-vws-journey-from-dieselgate-to-embracing-e-mobility/</a><br><br>Vaughan, D. (2010). The normalization of deviance: Signals of danger, situated action, and risk. In F. T. Cullen &amp; P. Wilcox (Eds.), <em>Encyclopedia of Criminological Theory</em>. SAGE Publications. <a href="https://study.sagepub.com/system/files/Vaughan,_Diane_-_The_Normalization_of_Deviance.pdf">https://study.sagepub.com/system/files/Vaughan,_Diane_-_The_Normalization_of_Deviance.pdf</a></p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-56" href="#footnote-anchor-56" class="footnote-number" contenteditable="false" target="_self">56</a><div class="footnote-content"><p>Karwowski, J., Hayman, O., Bai, X., Kiendlhofer, K., Griffin, C., &amp; Skalse, J. (2023). <em>Goodhart&#8217;s law in reinforcement learning</em>. <a href="https://arxiv.org/abs/2310.09144">https://arxiv.org/abs/2310.09144</a><br><br>Krakovna, V., Uesato, J., Mikulik, V., Rahtz, M., Everitt, T., Kumar, R., Kenton, Z., Leike, J., &amp; Legg, S. (2020). <em>Specification gaming: The flip side of AI ingenuity</em>. <a href="https://deepmind.google/discover/blog/specification-gaming-the-flip-side-of-ai-ingenuity/">https://deepmind.google/discover/blog/specification-gaming-the-flip-side-of-ai-ingenuity/</a></p></div></div>]]></content:encoded></item><item><title><![CDATA[The origins of the profit constraint]]></title><description><![CDATA[Fifty years ago, Milton Friedman published his landmark work The Social Responsibility Of Business Is to Increase Its Profits in The New York Times Magazine. A reaction against the surging support for social justice in 1970, the essay would go on to influence the course of economics and corporate governance for the next half century.]]></description><link>https://kellenbetts.substack.com/p/the-origins-of-the-profit-constraint</link><guid isPermaLink="false">https://kellenbetts.substack.com/p/the-origins-of-the-profit-constraint</guid><dc:creator><![CDATA[Kellen Betts]]></dc:creator><pubDate>Fri, 30 Oct 2020 15:54:43 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!EPc5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!EPc5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!EPc5!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg 424w, https://substackcdn.com/image/fetch/$s_!EPc5!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg 848w, https://substackcdn.com/image/fetch/$s_!EPc5!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!EPc5!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!EPc5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg" width="800" height="753" data-attrs="{&quot;src&quot;:&quot;https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/ff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:753,&quot;width&quot;:800,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:192753,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!EPc5!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg 424w, https://substackcdn.com/image/fetch/$s_!EPc5!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg 848w, https://substackcdn.com/image/fetch/$s_!EPc5!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!EPc5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2Fff68e928-e301-413e-a15f-528993ad032f_800x753.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Credit: Quentin Matsys, The Money Changer and His Wife, 1514.</figcaption></figure></div><p>Fifty years ago, Milton Friedman published his landmark work <em>The Social Responsibility Of Business Is to Increase Its Profits</em> in The New York Times Magazine. [0] A reaction against the surging support for social justice in 1970, the essay would go on to influence the course of economics and corporate governance for the next half century.</p><p>Friedman&#8217;s argument is rather simple. In a business, decisions are made by managers employed by the owners of the business. Managers thus have a contract to run the business consistent with the objectives of its owners. In some cases, a business may be established by its owners for social, environmental, or other charitable purposes. For non-charitable businesses, according to Friedman, the owners want the business to make as much money as possible. The power of Friedman&#8217;s argument is it gives managers a simple model for decisions: maximize profit.</p><p>This optimization model lies at the heart of the modern corporation. It is the pacemaker of shareholder capitalism. New insights from the science of complexity, however, are showing this pacemaker has a flaw.</p><h3>Company Origins</h3><p>A company is an organization that enables individuals to pool resources for risky, long-term projects. Companies are designed and built for a purpose, they distinguish between members and nonmembers, and have systems to accomplish work. [1] </p><blockquote><p>The most important organization in the world is the company: the basis of the prosperity of the West and the best hope for the future of the rest of the world. Indeed, for most of us, the company&#8217;s only real rival for our time and energy is the one that is taken for granted&#8212;the family. [2]</p></blockquote><p>The concept of a company can be traced back to ancient Mesopotamia. Commercial activity during this time was conducted mostly by simple bartering, but more complex arrangements emerged with Sumerian (3000 BCE) property contracts and Assyrian (2000-1800 BCE) business partnerships. [3] In the 4th century BCE, the Athenians developed business models for maritime commerce in the Mediterranean. These businesses were open to outsiders and based on the rule of law rather than royal authority.</p><p>A century later, Romans developed some of the fundamental concepts of what we now call corporate law. While most wealth in the Roman Empire was concentrated in agricultural and private estates, Roman <em>societies</em> established a collective identity with partners owning shares of the business. The partners delegated managerial decisions to a <em>magister</em> who ran the business and kept financial records. Romans also formed partnerships called <em>peculiums</em> run by a slave. <em>Peculiums</em> provided protection for the partners from creditors&#8212;limiting liability to the assets allocated to the business. Following the collapse of the Roman empire, the organization of commercial activities developed more slowly through the Middle Ages followed by a new wave of innovation in Renaissance Italy. [4] </p><h3>Renaissance Innovations</h3><p>By the 12th century, northern Italy was the center of European finance and commerce. City-states in the region dominated Mediterranean maritime trade and served as a gateway for crusaders traveling to the east. Commercial activity was often organized as <em>compagnia</em> through which fathers, brothers, sons and other relatives would pool their labor and capital. [5] As they grew more sophisticated, <em>compagnia</em> began attracting money from outside the family circle, further expanding the pool of capital and spreading the risk of the venture.</p><p>Florence is said to be the birthplace of the Renaissance, and in the early 14th century three Florentine families dominated finance in Italy&#8212;the Bardi, Peruzzi, and Acciaiuoli. All three families were wiped out following the default of King Edward III of England and King Robert of Naples in the 1340s. This left an opening for another Florentine family&#8212;the Medici&#8212;to seize control of the Republic. The Medici family would go on to build a business empire that left an enduring mark on the region. </p><p>Giovanni di Bicci de Medici launched the family business by landing the Vatican&#8217;s account in the 1380s. [6] Vast sums of money in many different currencies flowed through the papacy&#8217;s accounts, and Giovanni built a reputation as a currency trader. Over half of the Medici&#8217;s revenues came from their branch in Rome, and they used the profits from this business to diversify into trade, lending, textile manufacturing, and other businesses&#8212;including a monopoly on key chemicals used in the textile industry. [7] By the middle of the 15th century Giovanni and his son Cosimo had built one of the largest business empires of their time with branches in Florence, Venice, Rome, Geneva, London and other cities.</p><p>Rather than operate as a single organization, the Medici built a decentralized network with each new branch or business set up as an independent partnership between local businessmen and senior partners back in Florence. Each branch managed their own books and accounts, and were audited each year by the senior partners. This decentralized structure created strong incentives for the local partners to run a profitable business. It also allowed the Medici to maintain firm control of a sprawling empire and shield the assets of the broader business from the liabilities at each branch where the local partners where &#8220;first in line&#8221; to account for any losses. [8] </p><p>The Medici&#8217;s success in business brought substantial wealth and political influence. According to financial historian Niall Ferguson, &#8220;No other family left such an imprint on an age as the Medici left on the Renaissance. Two Medici became popes (LeoX and Clement VII); two became queens of France (Catherine and Marie); three became dukes (of Florence, Nemours and Tuscany).&#8221; [9] They also were patrons of some of the greatest artists and scientists of the era (and all time) from Michelangelo to Galileo, and left an architectural legacy in Florence that people travel from all over the world to see to-this-day.</p><p>Two hundred kilometers to the north of Florence, the Republic of Venice was a maritime power that rose to commercial prominence by controlling the salt trade with the Byzantine Empire. &#8220;Unlike the other Italian city-states, Venice put the demands of commerce high above the rule of the Church&#8230; and was excommunicated several times during the fifteenth century.&#8221; [10] Commercial prominence and political pragmatism in Venice led to a number of business innovations. The first state bank of Europe was opened in the Rialto, the market at the center of the city, which dominated international currency exchange throughout Europe for over 300 years. Businessmen from all over the region would travel to the Rialto to learn the secrets of finance and commerce.</p><p>Venetian bankers and merchants also perfected the system of double-entry bookkeeping&#8212;initially developed by Florentine merchants in the late 13th century&#8212;which allowed them to systematically track business assets and liabilities, and, most importantly, calculate profits. [11]  Luca Pacioli&#8212;the famous mathematician from Sansepolcro and companion of Leon Battista Alberti and Leonardo de Vinci&#8212;published a treatise on mathematics in 1494 with a chapter on bookkeeping that became the definitive guide to the Venetian method, the foundation of modern corporate accounting centuries later.</p><blockquote><p>In today&#8217;s profit-driven commercial world we are more than familiar with the idea that the purpose of every business is to make a profit. But Pacioli was writing in an era when this was not so self-evident and the tools for calculating profit&#8212;especially the Venetian bookkeeping system&#8212;were not widely used. And so he makes it clear that the purpose of every merchant is &#8216;to make a lawful and reasonable profit so as to keep up his business&#8217;. [12]</p></blockquote><h3>Charter Companies</h3><p>Merchants in northern Europe built on the innovations of the Roman Empire and Renaissance Italy, developing guilds, charter corporations and ultimately the joint-stock corporation. Throughout the Middle Ages, the concept of a separate, collective identity (a &#8220;corporate person&#8221;)  was used by northern European towns, universities, and religious communities. Trade guilds were important organizations in this period as well. They were given a monopoly over their trade within a city by the sovereign, set standards for quality, and selected and trained new members.</p><p>The first charter companies were formed in the 12th century and operated like guilds with a group of merchants banding together to sell goods under a single organization. Charter corporations straddle the public and private sectors, forming a business venture with a charter from the sovereign for exclusive rights to a commercial activity within the city. Like trade guilds and merchant associations, they provided a means to transfer customs and knowledge to future generations. They also provide a means to transfer considerable wealth. The Corporation of London, for example, still owns a quarter of the land in the City of London. [13]</p><p>Mining, shipping, and milling corporations offered shares on the open market as early as the 13th century, and by the 16th and 17th centuries these ideas would come together to empower the &#8220;combined effort of governments and merchants to grab the riches of the new worlds.&#8221; [14] The Portuguese were pioneers in exploring the East Indies with state-led expeditions. The Dutch and English, in contrast, raised money for voyages with new public-private ventures formed as chartered joint-stock companies. This structure had the monopolistic advantage of the charter corporation. It also pooled capital and risk for the venture by selling tradable shares on an open market. To attract investors, shares often limited shareholder liability to their original investment.</p><p>The first chartered joint-stock company was the Muscovy Company, formed in England in 1555. The Muscovy Company received an exclusive charter for trade with the Russian czar Ivan IV at the port of Archangel, and was encouraged to search for a northeast passage to the East Indies. In the 1580s, the Virginia Company was chartered by Elizabeth I to explore and colonize America. It was based on Richard Hakluyt&#8217;s <em>Discourse on Western Planting</em> (1584)&#8212;arguably one of the first company prospectuses&#8212;and raised funds from some seven-hundred investors including Sir Francis Bacon. [15] The Muscovy Company, the Virginia Company and other early joint-stock companies raised funds for individual voyages with proceeds divvied up upon return. This pooled capital and contained shareholder&#8217;s risk to individual voyages. The Dutch developed a more durable structure which would be the model for future joint-stock companies.</p><p>In 1602, Dutch merchants received a charter forming the Dutch East India Company (also known as &#8220;VOC&#8221; for <em>Vereenigde Oost-Indische Compagnie</em>). VOC was a true public-private venture with the government providing both the charter and owning a stake in the company. VOC&#8217;s first charter locked shareholders&#8217; investment for ten years. In 1612, the government changed VOC&#8217;s charter preventing shareholders from recalling their original investment for an indefinite period of time. This was a significant departure from early joint-stock companies, which were set up to pool resources and diversify risk for individual voyages. By extending the commitment to ten years, and then indefinitely, the Dutch developed the concept of an immortal company, creating a durable asset that would produce wealth over long periods of time. It also led to a vibrant secondary market for shares of the company. This meant shareholders were not stuck with their investment and could even profit from trades in the secondary market, while ensuring VOC had a stable asset pool to continue exploiting their dominance of Far East trade routes. [16]</p><p>The English also fought for control of trade in the East Indies. The English effort was led by English East India Company (the &#8220;Company&#8221;). Formed in 1600 by a group of 218 merchants and adventurers, the Company received exclusive rights for 15 years to trade in the &#8220;Indies,&#8221; an area that was defined as extending from the Cape of Good Hope to the Straits of Magellan. [17] In contrast to the VOC model, the English East India Company was a private organization&#8212;authorized by a charter but not owned by the crown&#8212;and voyages were funded independently until it became a permanent joint-stock company in 1657.</p><p>By 1620, the English East India Company had over 30 large and heavily armed ships, which traveled in convoys of 12 or more vessels, were operated by over 2,500 sailors, and maintained by 500 carpenters. [18] Typical voyages were 16 months long, leaving on the eastbound leg in the winter with silver and other metals, armor and swords, satins and broadcloths, and other tradable goods. In India, these were traded for cotton textiles, which was then traded for pepper, cloves, and nutmeg in the Spice Islands. Some voyages continued on to China, Japan or the Philippines for silk, indigo, sugar, and coffee. Most voyages returned through India where spices were traded for tea. [19]</p><p>To manage this complex trade network, the Company&#8217;s day-to-day activities were run by 24 governors who oversaw a network of resident &#8220;factors&#8221; at local trading posts or factories, and a growing administration of accountants, clerks, and other specialists organized into 7 committees: accounting, buying, correspondence, shipping, finance, warehousing, and private trade. Governors were elected by shareholders of the Company, who reaped large returns on their investment. [20]</p><h3>The Modern Corporation</h3><p>Despite the success of early joint-stock companies, a series of scandals in the early 18th century led to the English Bubble Act of 1720. The Act required every joint-stock company to receive a charter from parliament. To avoid the cost and uncertainty of obtaining a charter, most businesses in the burgeoning industrial sector preferred partnership arrangements. Many industrialists also believed the detached ownership of shareholders was not an effective business structure, preferring hands-on ownership arrangements. This began to change with the large sums of capital needed by the British rail industry in the early 19th century. By 1840, over 2,000 miles of track was laid by publicly traded, joint-stock companies, spurring the government to reform the joint-stock structure.</p><p>Starting in 1844, the British government passed a series of Acts that formed the foundation of the modern corporation. They first allowed the creation of a joint-stock company by registration rather than charter. They also required companies to disclose financial information audited by someone other than directors of the company and required dividends to be paid out of profits rather than capital. By 1862, they established automatic limited liability protecting shareholders from the corporation&#8217;s debt burden, thus limiting their liability to their original investment. At the same time, investors could draw dividends from the corporation, extracting profits that might otherwise be collected by debtors. </p><p>The U.S. can trace its founding to the corporate form. The colonies were originally organized as corporations chartered under the British crown, planting the seeds of democracy and the context within which the Framers wrote the Constitution. New York was the first state to enact an incorporation statute in 1811. Similar statutes eventually spread to all fifty states. In the U.S., states rather than the federal government have jurisdiction over corporate law, allowing corporations to engage in legal arbitrage and choose the state laws they are governed by.</p><p>In fact, 68% of all U.S. publicly traded corporations and 89% of companies with initial public offerings are registered in the state of Delaware, ranked as one of the most &#8220;investor-friendly&#8221; jurisdictions. [21] In Delaware, corporations can pay dividends from the current year or previous year&#8217;s profits, allowing the company to smooth shareholder returns even if it may not be in the corporation&#8217;s long-term interests. With the expansion of global trade in the late 20th century, an &#8220;empire of law&#8221; has formed that is no longer tied to specific states but is a fluid system that allows asset holders to choose between their local laws or those of a foreign market. &#8220;For the global capitalists, this is the best of all worlds, because they get to pick and choose the laws that are most favorable to them without having to invest heavily in politics to bend the law their way.&#8221; [22]</p><p>U.S. industrialization in the early 20th century brought with it a number of changes to the nature of the corporation. Ford brought together a production system that made cars more efficiently than any human institution before it. To manage the massive enterprise the production techniques both enabled and necessitated, Ford brought as many activities under its control as possible&#8212;from raw materials to ships and railroads. This presented significant challenges for the company. There was little synergy between the desperate industries it controlled, and Henry Ford centralized all decision-making powers in one person&#8212;himself. One of Ford&#8217;s competitors, General Motors (GM), capitalized on these weaknesses, developing new management techniques that complemented Ford&#8217;s production techniques, and brought together the complete system of mass production. [23]</p><p>GM&#8217;s president Alfred Sloan developed a new corporate structure that separated profit centers&#8212;major components like generators and steering gears as well as foreign subsidiaries&#8212;into independent divisions. Managers at the corporate level focused on corporate affairs and financial oversight of the divisions, leaving the details of operating each division to its respective general manager. This structure elevated the importance of the finance and marketing professions, and embedded corporate financial management in the modern corporation structure.</p><h3>The Profit Constraint</h3><p>Economists often view companies as a &#8220;legal fiction&#8221; behind which lies a nexus of contracts with investors, managers, employees, and customers. [24] &#8220;If there is a nexus of contracts, it is with the legal entity, not with the entity&#8217;s stakeholders; calling this central node a fiction denies the ingenuity of this legal device.&#8221; [25] The modern corporate form is immortal, it can own property, and it shields its owner&#8217;s losses by shifting liability to others. [26] The structure also is a more efficient vehicle for creating capital and labor income compared to individual proprietors (freelancers). </p><p>Capital can take many forms. It is created from an asset&#8212;land, debt, knowledge, and others&#8212;that is coded into law conferring special properties on the asset that privilege its owner. Even humans can be capital. This is as true today as it was before slavery was abolished with the 13th Amendment. It also is contrary to the textbook economic growth model&#8212;proposed by Solow and Swan back in 1956&#8212;where capital and labor are considered independent inputs to production. [27] And yet it happens every day. &#8220;Many a freelancer, for example, has discovered that she can capitalize her labor by establishing a corporate entity, contributing her services to it in kind and taking out dividends as the corporation&#8217;s shareholder in lieu of a salary&#8212;thereby benefiting from a lower tax rate.&#8221; [28]</p><p>A freelancer is both owner and employee (principal and agent), and so human capital and non-human capital are enmeshed. In an organization, there is greater separation between principal and agent, and the degree of separation has increased with the evolution of the corporate form. Early companies&#8212;from Roman <em>societies</em> to the Medici and even 19th and 20th century titans like Standard Oil and Ford&#8212;were typically owned and managed by a single family or a small group of investors. The introduction of the limited-liability, joint-stock company with shares traded in public markets created organizations owned by dispersed stockholders who are unable to exert much control over management decision-making. [29] This separation is why Friedman&#8217;s essay makes a clear distinction between freelancers and organizations. It also makes Friedman&#8217;s simple argument compelling, operationalizing the pursuit of profit as maximizing shareholder value.</p><p>The separation between principals and agents, however, highlights the complexity of modern corporate organizations. The Neoclassical framework Friedman&#8217;s argument is based on assumes humans are inherently rational and self-interested. And where individuals seek to maximize their own self-interest, this manifests collectively as seeking to maximizing a company&#8217;s profit&#8212;employees want to ensure they are paid for their labor and owners want to earn a profit on their (equity) capital.</p><p>Humans and organizations, however, are complex systems shaped by evolutionary forces. As with any evolutionary system, the behavior they develop is driven by survival and replication (or amplification), not pure self-interest. [30] Even charitable organizations are fundamentally driven by survival and amplifying (or replicating) their charitable mission. This does not mean that profit is irrelevant. In fact, the gap between Friedman&#8217;s Neoclassical framework and one based in evolutionary theory and complexity science is narrower than one might think. What these new insights provide is a reformulation of the optimization model. &#8220;In evolutionary systems, profitability is not an objective in and of itself; rather, it is a fundamental constraint that must be met if a business is to achieve the objective of survival and replication (or enduring and growing)&#8230;&#8221;</p><blockquote><p>&#8230;eating is a constraint on living (and a very vital one), but no one would claim that the purpose of life is to eat. [31]</p></blockquote><h3>References</h3><ol start="0"><li><p><strong>Friedman</strong>, M. (1970, September 13). <em>The Social Responsibility Of Business Is to Increase Its Profits.</em> The New York Times Magazine, p. 32&#8211;33 &amp; 122&#8211;126. Retrieved from https://www.nytimes.com/1970/09/13/archives/a-friedman-doctrine-the-social-responsibility-of-business-is-to.html</p></li><li><p><strong>Beinhocker</strong>, E. D. (2006). <em>The Origin of Wealth: The Radical Remaking of Economics and What It Means for Business and Society.</em> Boston, MA: Harvard Business School Press,  p. 351-352.</p></li><li><p><strong>Micklethwait</strong>, J., &amp; Wooldridge, A. (2003). <em>The Company: A Short History of a Revolutionary Idea.</em> New York: Modern Library, p. xv.</p></li><li><p><strong>Micklethwait</strong> &amp; Wooldridge, 2003, p. 3.</p></li><li><p><strong>Micklethwait</strong> &amp; Wooldridge, 2003; <strong>Abatino</strong>, B., Dari-Mattiacci, G., &amp; Perotti, E. (2009). <em>Early Elements of the Corporate Form.</em> Oxford Journal of Legal Studies (Vol. 31).</p></li><li><p><strong>Robins</strong>, N. (2012). <em>The Corporation That Changed the World.</em> Pluto Press, p. 22.</p></li><li><p><strong>Micklethwait</strong> &amp; Wooldridge, 2003</p></li><li><p><strong>Gleeson-White</strong>, J. (2011). <em>Double Entry: How the Merchants of Venice Created Modern Finance.</em> New York: W. W. Norton &amp; Company; and (Micklethwait &amp; Wooldridge, 2003)</p></li><li><p><strong>de Roover</strong>, R. (2017). <em>The Rise and Decline of the Medici Bank, 1397-1494.</em> Borodino Books; and (Pistor, 2019)</p></li><li><p><strong>Ferguson</strong>, N. (2018). <em>The Ascent of Money: A Financial History of the World (10 ed.).</em> New York: Penguin, p. 39.</p></li><li><p><strong>Gleeson-White</strong>, 2011, p. 50-51.</p></li><li><p><strong>Gleeson-White</strong>, 2011</p></li><li><p><strong>Gleeson-White</strong>, 2011, p. 97.</p></li><li><p><strong>Micklethwait</strong> &amp; Wooldridge, 2003</p></li><li><p><strong>Micklethwait</strong> &amp; Wooldridge, 2003, p. 17.</p></li><li><p><strong>Micklethwait</strong> &amp; Wooldridge, 2003, p. 19.</p></li><li><p><strong>Pistor</strong>, K. (2019). <em>The Code of Capital: How the Law Creates Wealth and Inequality.</em> Princeton, NJ: Princeton University Press.</p></li><li><p><strong>The National Archives</strong>. <em>Charters of the East India Company with related documents: the &#8220;parchment records.&#8221;</em> Retrieved August 30, 2020, from https://discovery.nationalarchives.gov.uk/details/r/16e42ef9-0b6c-4f6e-acb6-27cac99de0b4</p></li><li><p><strong>Micklethwait</strong> &amp; Wooldridge, 2003, p. 23; <strong>Robins</strong>, 2012, p. 19.</p></li><li><p><strong>Robins</strong>, 2012</p></li><li><p><strong>Robins</strong>, 2012</p></li><li><p><strong>Delaware Division of Corporations</strong>. <em>2019 Annual Report Statistics.</em> Retrieved August 30, 2020, from https://corpfiles.delaware.gov/Annual-Reports/Division-of-Corporations-2019-Annual-Report.pdf</p></li><li><p><strong>Pistor</strong>, 2019</p></li><li><p><strong>Womack</strong>, J. P., Jones, D. T., &amp; Roos, D. (1991). <em>The Machine That Changed the World.</em> New York: Harper Perennial.</p></li><li><p><strong>Jensen</strong>, M. C., &amp; Meckling, W. H. (1976). <em>Theory of the firm: Managerial behavior, agency costs and ownership structure. </em>Journal of Financial Economics, 3(4), 305&#8211;360.</p></li><li><p><strong>Piketty</strong>, T. (2013). <em>Capital in the Twenty-First Century.</em> Cambridge, MA: Belknap Press, p. 52.</p></li><li><p><strong>Pistor</strong>, 2019</p></li><li><p><strong>Solow</strong>, R. M. (1956). <em>A Contribution to the Theory of Economic Growth.</em> The Quarterly Journal of Economics, 70, 65&#8211;94.; and Swan, T. W. (1956). <em>Economic growth and capital accumulation.</em> Economic Record, 32(2).</p></li><li><p><strong>Pistor</strong>, 2019, p. 11.</p></li><li><p><strong>Winkler</strong>, A. (2018). <em>We the Corporations: How American Businesses Won Their Civil Rights.</em> New York: Liveright, p. 205.</p></li><li><p><strong>Beinhocker</strong>, 2006</p></li><li><p><strong>Beinhocker</strong>, 2006, p. 410.</p></li></ol>]]></content:encoded></item></channel></rss>