{"paper_id":"2310.15082","title":"Cognitive Energy Cost of Informed Decisions","authors":["Michele Vodret"],"paper_date":"2023-10-23","paper_type":"theoretical","paper_url":"https://arxiv.org/pdf/2310.15082v1","page_url":"https://thequant.space/flowcharts/cognitive-energy-cost-of-informed-decisions/","scores":{"empirical_rigor":3,"math_complexity":8.5,"quadrant":"Lab Rats"},"proposes":{"status":"available","statement":"The paper proposes a thermodynamically consistent measure of cognitive energy cost based on Landauer's principle and applies it to a two‑armed bandit decision‑making model with exploitation, finite memory, and concurrent allocation to both arms.","quote":"Using Landauer's principle, which posits that time-irreversible information processing consumes energy, we establish a thermodynamically consistent measure of cognitive energy cost associated with belief dynamics. We utilize this concept to analyze a two-armed bandit game, a standard decision-making framework under uncertainty, considering exploitation, finite memory, and concurrent allocation to both game options","summary":"Time irreversibility in neuronal dynamics has recently been demonstrated to correlate with various indicators of cognitive effort in living systems. Using Landauer’s principle, which posits that time-irreversible information processing consumes energy, we establish a thermodynamically consistent…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The decision maker invests a single unit of endowment each period between two arms, with investment fraction a_t ∈ [0,1].","type":"model","stated":"explicit","quote":"e scenario where, at every time step t, a decision maker has to invest a single unit of endowment between two ‘arms’ of a slot machine, denoted as A and B. at ∈[0, 1] signifies the investment fraction at time step t on bandit A, while 1 −at does so for bandit B. The rewards yielded by the arms at each time step are RA t at and RB t (1 −at), respectively.","support":"full"},{"assumption":"Rewards from each arm are drawn from time‑independent Gaussian distributions with unknown means and variances.","type":"data","stated":"explicit","quote":"Both RA t and RB t are drawn by time-independent Gaussian distributions, chosen arbitrarily such that the support is mostly in the interval [0, 1]. We indicate the mean and variance of RA t respectively as ⟨RA⟩and σ2 A, with analogous notation for RB t ; these pieces of information are unknown to the decision maker.","support":"full"},{"assumption":"The investment fraction a_t is treated as a deterministic continuous variable rather than a Bernoulli random variable.","type":"model","stated":"explicit","quote":"First, we consider at to be a deterministic variable, while customarily it is distributed accordingly to a Bernoulli distribution; this is not a crucial characteris-tic of the model and, since it introduces a third source of noise, we neglect fluctuations of this variable. In doing so, we let at vary continuously, incorporating a notion of confidence [30] in the model.","support":"full"},{"assumption":"The forgetting Q‑learning model is modified by using Gaussian rewards instead of Bernoulli rewards.","type":"model","stated":"explicit","quote":"3 Second, using Gaussian rewards (RA t and RB t ) diverges from typical cognitive neuroscience models, where these are drawn from Bernoulli distributions [17, 18]. This choice might be favored as it allows point estimates in the update equation to capture all noise statistics.","support":"full"},{"assumption":"For passive learning (Γ = 0) the belief dynamics reduce to two independent first‑order AR processes that are not time‑reversible in the long run.","type":"model","stated":"explicit","quote":"How-ever, we posit that Gaussian noise is more appropriate for the following reason: in passive learning scenarios (Γ = 0), where the investment is split equally on both arms (at = 1/2), the belief dynamics given by Eqs. (2) re-sult in two independent first-order Auto-Regressive (AR) processes. These are not time-reversible in the long run [31] if Bernoulli rewards are considered.","support":"full"},{"assumption":"The noise variance η is set much smaller than the reward variances (σ^2_η ≪ σ^2_A, σ^2_B).","type":"statistical","stated":"explicit","quote":"I set the variances of ηA t and ηB t so that var[ηA] = var(ηB) = σ2 η ≪σ2 A, σ2 B. The derivation of the Fokker-Planck equation (see Sec. IV) leads to: Ft = β \u0014 −ˆRA t + at⟨RA⟩ −ˆRB t + (1 −at)⟨RB⟩ \u0015 (B.2) and Dt = (β/2)2 \u0014σ2 Aa2 t + σ2 η, 0 0, σ2 B(1 −at)2 + σ2 η \u0015 (B.3) These are the expressions of F and D we use to quantify the irreversibility rate from Monte Carlo simulations by means of Eq. (13) in Fig. 5.","support":"full"}]},"datasets":{"status":"none_found","items":[],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"none"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"none","findings":[{"finding":"Numerical computation shows a strong correlation between elevated but optimized cognitive energy cost and optimal decision‑making outcomes in the steady‑state belief dynamics.","kind":"theoretical","quote":"Finally, we numerically compute the time irreversibility of belief dynamics in the steady state, revealing a strong correlation between elevated - yet optimized - cognitive energy cost and optimal decision-making outcomes.","support":"full"},{"finding":"Risk‑aversion emerges as an effective thermophoresis phenomenon in the belief dynamics, consistent with Fokker‑Planck analysis.","kind":"theoretical","quote":"C. Emergent risk-aversion as termophoresis At first glance, the use of point estimates in the up-date equation for the beliefs given by Eqs. (2) appears overly simplistic, especially when considering its lack of direct reference to well-documented human behavioral tendencies, such as risk aversion. However, early numerical analysis on related models revealed that the use of point estimates in the update equation of","support":"full"},{"finding":"The irreversibility rate peaks at intermediate exploitation levels (moderate Γ), indicating maximal cognitive energy dissipation when decisions are neither fully passive nor fully trapped.","kind":"statistical","quote":"Displayed metrics include (from top to bottom) average difference in beliefs, average earned reward minus the one related to Γ = 0, and irreversibility rate. Irreversibility rate: each point corresponds to the aver-age irreversibility rate across the trajectories.","support":"full"},{"finding":"For large Γ the belief dynamics become effectively one‑dimensional and recover time‑reversibility, reducing the irreversibility rate.","kind":"theoretical","quote":"The belief dynamics for large Γs is therefore analogous to a single first-order auto-regressive process with Gaussian noise, recovering time reversibility in the steady state. Refer to the panel a) in Fig. 2 for an indicative example of belief dynamics ˆRt = ( ˆRA t , ˆRB t ) in these three regions.","support":"full"}],"reported_performance":null,"out_of_sample":{"method":"none","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":11,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":2,"extracted_at":"2026-11-14T20:00:42Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}