Counts of research software use allocate credit, and the available ones are cheap to produce: a download is one fetch of a file. I propose validated use, a package loaded in replication code deposited at a journal that checks it, as a costly signal, and measure it in 13,245 deposits from 75 economics and political science journal collections, which load 4,565 R, Python and Stata packages. Among packages the corpus uses, validated use and downloads agree loosely, and least where automatic installation is commonest: the rank correlation is 0.61 for Stata, 0.53 for R and 0.36 for Python. Downloads track a package's position in the dependency graph more closely than its use. The most used software prepares exhibits: estout is in 43% of Stata deposits. Stata appears in 1.4 times as many deposits as R and is missing from studies of research software because its packages are scattered across SSC, two journals' archives and authors' sites with no index across them. I build that index, 10,147 commands in 5,581 packages, and release it with the mention-level data.
Cite: Gaurav Sood. "Downloads Are Cheap: Validated Use as a Measure of Research Software." https://gsood.com/research/downloads-are-cheap-validated-use-as-a-measure-of-research-software/
BibTeX:
@misc{sooddownloads,
author = {Gaurav Sood},
title = {{Downloads Are Cheap: Validated Use as a Measure of Research Software}},
note = {Working paper},
url = {https://gsood.com/research/downloads-are-cheap-validated-use-as-a-measure-of-research-software/}
}