On-Device Deep Research at 4B: Exposure Bounds Faithfulness, Retrieval Bounds Coverage

On-device research agents search a corpus, read sources, and write a cited brief on a personal laptop.

Whether their citations are faithful, and at what cost, is unmeasured for a deployable small model.

This study fixes one 4B generator on a 24 GB laptop and asks what makes its citations faithful.

It separates two quantities usually reported as one number.

Cited claim faithfulness asks whether the cited source supports the claim.

Trustworthy coverage asks whether the agent also cites the right sources.

The study crosses how much of each source the generator sees, 400 against 1500 characters, with the quality of the sources supplied, gold papers against retrieved papers.

Two levers fall out, and they act on different outcomes.

Exposure sets faithfulness.

More of each source lifts faithfulness from 0.45 to 0.58 on retrieved sources and from 0.37 to 0.58 on gold sources, and the two settings converge, so faithfulness is bound by exposure, not by whether the source is correct.

The exposure lift is robust to a second, independent judge; the exact convergence is tight under the primary judge and only approximate under the second.

Retrieval sets coverage.

Trustworthy coverage stays near 0.22 on retrieved sources at any exposure, because recall is held near 0.40, so exposure cannot fix which sources are cited.

The extra exposure costs about 235 output tokens.

The practical recipe is to raise per source exposure first, cheaply, and then treat retrieval recall as the only remaining lever.