{"paper_id":"2611.22730","title":"Covariate-Indexed Inclusion Probabilities on Unbalanced Panels","authors":["Paul Schneider"],"paper_date":"2026-11-17","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2611.22730","page_url":"https://thequant.space/flowcharts/covariate-indexed-inclusion-probabilities-on-unbalanced-panels/","scores":{"empirical_rigor":7,"math_complexity":8.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes two convex models for estimating conditional marginal inclusion probabilities that are non‑negative by construction and remain valid under arbitrary dependence between items.","quote":"We propose two convex models whose fitted probabilities are nonnegative by construction and remain valid whatever the dependence between items, for which we establish consistency, finite-sample bounds and limit distributions for serially dependent panels.","summary":"We estimate the probability that an item with given covariates belongs to a set when the cross-section changes over time and items and periods are dependent. We propose two convex models whose fitted probabilities are nonnegative by construction and remain valid whatever the dependence between…","strategy":"rank-angle dictionary log-link fit"},"assumptions":{"status":"available","items":[{"assumption":"The panel process {ξ_t} is strictly stationary with marginal law P.","type":"statistical","stated":"explicit","quote":"Throughout, 7 {ξt}t≥0 is strictly stationary with marginal law P, and all population objects refer to this marginal.","support":"full"},{"assumption":"The panel process {ξ_t} is ergodic.","type":"statistical","stated":"explicit","quote":"Let {ξt}t≥0 be strictly stationary and ergodic.","support":"full"},{"assumption":"Geometric strong mixing (or i.i.d.) is assumed for finite‑sample concentration results.","type":"statistical","stated":"explicit","quote":"We give almost-sure consistency of any empirical minimizer over the cone, with existence derived rather than assumed, finite-sample concentration under i.i.d. sampling and under geometric strong mixing, and a mean-squared-error bound at the parametric rate on the event of localization (Theorem 4.1).","support":"full"},{"assumption":"Positive margins of the inclusion probabilities are required (the joint law of S_{t+1} has positive margins).","type":"model","stated":"explicit","quote":"The theory concerns the margins (1) alone, and the identification result (Proposition 3.1) holds for any joint law with positive margins.","support":"full"},{"assumption":"The covariate dictionary satisfies condition (P1) (boundedness) and the data satisfy the integrability hypothesis of Lemma A.3 on an open convex set containing the true parameter.","type":"statistical","stated":"explicit","quote":"Part (i) assumes the integrability hypothesis of Lemma A.3 on an open convex set O containing a point U Po ⋆ ∈Sm +. The covariate vector zt,i collects the 121 of their 153 characteristics that are missing in less than 30 percent of the name-months, rank-transformed to (−1, 1) within month, so d = 121 and the dictionary is bounded, condition (P1).","support":"full"},{"assumption":"Missing covariate entries are handled via the masked dictionary construction, assuming the weights estimate the conditional law.","type":"data","stated":"explicit","quote":"The masked dictionary ϕ(z) := Nref X i=1 wi(z) e(zo, xi,¯o) (7) keeps the observed coordinates at their values and averages the basis over completions of the missing ones. Appendix C.5 gives the construction, its properties and the conditions under which the weights estimate the conditional law.","support":"full"}]},"datasets":{"status":"available","items":[{"name":"US common‑stock universe (CRSP)","provider":"CRSP","kind":"market-prices","access":"public","period":"January 1963 to November 2024","universe":"NYSE, AMEX and NASDAQ stocks","quote":"7.1 Data, event, and design The panel is the US common-stock universe of Jensen et al. (2023), CRSP common stock on NYSE, AMEX and NASDAQ from January 1963 to November 2024.","support":"full","known_id":"crsp"},{"name":"121 characteristics from Jensen et al. (2023)","provider":null,"kind":"fundamentals","access":"public","period":null,"universe":null,"quote":"The covariate vector zt,i collects the 121 of their 153 characteristics that are missing in less than 30 percent of the name-months, rank-transformed to (−1, 1) within month, so d = 121 and the dictionary is bounded, condition (P1).","support":"full"}],"known":[],"sample":{"start":"1963-01","end":"2024-11","market":"US common stocks","asset_class":"equities","frequency":"monthly"},"data_resolution":"weekly-monthly"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"The rare‑event model predicts monthly US stock failures better than the ordinary logit and the classical failure logit.","kind":"predictive-accuracy","quote":"On monthly US stock failures, the rare-event model predicts better than the ordinary logit and the classical failure logit.","support":"full"},{"finding":"Half the disagreement between the two link‑specific fits provides a lower bound on the larger of their probability‑scale errors and on the larger dictionary gap, without knowledge of the true margins.","kind":"theoretical","quote":"One suits events of moderate or high probability, the other rare events, and half the disagreement between their fits estimates a lower bound on the misspecification error of the worse fit, without knowledge of the true probabilities. Half the disagreement between the two links bounds the larger of their errors on the probability scale from below, and through it the larger of the two dictionary gaps, with a standard","support":"full"},{"finding":"In simulations, the composition part of the error accounts for 84 % to 99 % of the squared RMSE floor, and cannot be removed by any dictionary.","kind":"statistical","quote":"The composition part, the root mean square of pt,i −¯p(zt,i), is 0.0186 whatever the dictionary. The dictionary part, that of ¯p−ℓPo ⋆, falls from 0.0081 at m = 4 to 0.0015 at m = 8.","support":"partial"},{"finding":"On monthly failures of US common stocks, the log‑link fit in a rank‑angle dictionary improves log‑score by about a tenth of the gain of the ordinary logit over the unconditional rate and outperforms the failure logit of Campbell et al. (2008).","kind":"performance","quote":"On monthly failures of US common stocks the log-link fit in a rank-angle dictionary predicts better in log score and in ranking than the ordinary logit on 121 characteristics and the failure logit of Campbell et al. (2008), in log score by about a tenth of the logit’s gain over the unconditional rate and significantly in every subsample, and it stays close to the diagonal of the reliability curve in relative terms,","support":"full"},{"finding":"The identity‑link fit has larger calibration RMSE than the logistic competitors, especially from the third decile upward.","kind":"performance","quote":"although the logistic competitors have the smaller calibration RMSE.","support":"full"}],"reported_performance":{"strategy":"rank-angle dictionary log-link fit","sharpe":null,"sharpe_benchmark":null,"annual_return_pct":null,"total_return_pct":null,"max_drawdown_pct":null},"out_of_sample":{"method":"walk-forward","headline_out_of_sample":true}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":16,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":3,"extracted_at":"2026-11-18T11:39:11Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}