Skip to main content

Table 13 Performance of deduplication tools in the SRSR dataset

From: The Automated Systematic Search Deduplicator (ASySD): a rapid, open-source, interoperable tool to remove duplicate citations in biomedical systematic reviews

 

TP

TN

FN

FP

Sensitivity (SE)

Specificity (SE)

Precision

F1

Time

Human

16,653

36,021

202

125

0.988 (0.001)

0.997 (0)

0.993

0.990

 ~ 9 h

EndNote

12,784

36,100

4071

46

0.758 (0.003)

0.999 (0)

0.996

0.861

 < 1 h

SRA-DM

11,943

34,275

4912

1871

0.709 (0.003)

0.948 (0.001)

0.865

0.779

 < 24 h

ASySD

16,529

36,111

326

35

0.981 (0.001)

0.999 (0)

0.998

0.989

 < 1 h

  1. TP True positives, TN True negatives, FN False negatives, FP False positives, SE Standard error