Blog - llm

QuCo-RAG: deciding when to retrieve by asking the pre-training corpus
Paper notes

Paper notes on QuCo-RAG — using entity frequency and co-occurrence in a 4T-token corpus as a retrieval trigger, instead of the model's own unreliable uncertainty.

rag paper-notes llm uncertainty

UltraData: OpenBMB's tiered data stack, from raw web to deep-thinking SFT
Dataset notes

Notes on OpenBMB's UltraData collection — an L0–L4 data pyramid (Ultra-FineWeb, UltraData-Math, UltraData-SFT) battle-tested on MiniCPM5-1B and released open.

datasets pretraining open-source llm

QuCo-RAG: deciding when to retrieve by asking the pre-training corpus Paper notes

UltraData: OpenBMB's tiered data stack, from raw web to deep-thinking SFT Dataset notes

QuCo-RAG: deciding when to retrieve by asking the pre-training corpus
Paper notes

UltraData: OpenBMB's tiered data stack, from raw web to deep-thinking SFT
Dataset notes