{"paper_id":"2409.16333","title":"Predicting Distance matrix with large language models","authors":["Jiaxing Yang"],"paper_date":"2024-09-24","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2409.16333v1","page_url":"https://thequant.space/flowcharts/predicting-distance-matrix-with-large-language-models/","scores":{"empirical_rigor":3,"math_complexity":7,"quadrant":"Lab Rats"},"proposes":{"status":"available","statement":"The paper proposes a framework that uses a large pre‑trained RNA language model together with a downstream transformer to predict RNA distance matrices from primary sequence alone.","quote":"we demonstrate that using only primary sequence information, we can accurately infer the distances between RNA bases by utilizing a large pre-trained RNA language model coupled with a well-trained downstream transformer.","summary":"Structural prediction has long been considered critical in RNA research, especially following the success of AlphaFold2 in protein studies, which has drawn significant attention to the field. While recent advances in machine learning and data accumulation have effectively addressed many biological…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The distance training dataset contains more than 1,000 examples, requiring careful training strategies.","type":"data","stated":"explicit","quote":"As the size of our distance training dataset stays beyond 1k, it requires more carefully designed training strategies to tackle the problem."},{"assumption":"Pre‑training and self‑training on comparable sized unlabeled data improve model accuracy.","type":"model","stated":"explicit","quote":"Suggested by [21], pre-training and self-training on a comparable size with small labeled datasets almost always improve model accuracy."},{"assumption":"Only sequential (primary sequence) information is sufficient for accurate distance prediction.","type":"model","stated":"implied","quote":"both our vanilla DiT and DiT-PS only take sequential information into account and still exceeds the performance of convolutional-based Unet++ trained with given secondary structures and sequences."}]},"datasets":{"status":"available","items":[{"name":"Pre‑training dataset","provider":null,"kind":"synthetic","access":"unknown","period":null,"universe":null,"quote":"our training strategy involves pre-training DiT on 2k sequences, tuning on a 1k distance/sequence dataset, and self-training combined with remaining 1k sequences"},{"name":"TE100 test dataset","provider":null,"kind":"benchmark","access":"unknown","period":null,"universe":null,"quote":"TE100 stands for a size 100 test dataset which contains TE80 used in [27] and removed redundancy of sequence similarity from our training dataset."},{"name":"TE80 test dataset","provider":null,"kind":"benchmark","access":"unknown","period":null,"universe":null,"quote":"Table 2: Evaluation on RNAcontact’s TE80 test dataset, we compared on their defined Long-Range Top Precision"}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"none"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"The DiT‑PS model achieves state‑of‑the‑art performance on the TE100 distance regression task across all five evaluation metrics.","kind":"predictive-accuracy","quote":"Our distance transformer with full training stages DiT-PS reaches SOTA in all five evaluation metrics."},{"finding":"When converted to contact predictions, DiT‑PS attains comparable results to RNAcontact and the best Top‑L precision.","kind":"performance","quote":"We achieved comparable performance even downgraded to contact prediction task and obtained the best Top L precision."},{"finding":"Larger transformer variants (DiT‑L, DiT‑H) do not scale well on the small 1k distance dataset and hurt performance.","kind":"negative","quote":"we discovered that as transformer based model requires massive amount of data, DiT-L and DiT-H don’t scale well in our small distance 1k problem."}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":10,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:01:27Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}