Over the past decade, several global maps of above-ground biomass (AGB) have been produced, but they exhibit significant differences that reduce their value for climate and carbon cycle modelling, and also for national estimates of forest carbon stocks and their changes. The number of such maps is anticipated to increase because of new satellite missions dedicated to measuring AGB. Objective and consistent methods to estimate the accuracy and uncertainty of AGB maps are therefore urgently needed. This paper develops and demonstrates a framework aimed at achieving this. The framework provides a means to compare AGB maps with AGB estimates from a global collection of National Forest Inventories and research plots that accounts for the uncertainty of plot AGB errors. This uncertainty depends strongly on plot size, and is dominated by the combined errors from tree measurements and allometric models (inter-quartile range of their standard deviation (SD) = 30–151 Mg ha-1). Estimates of sampling errors are also important, especially in the most common case where plots are smaller than map pixels (SD = 16–44 Mg ha-1). Plot uncertainty estimates are used to calculate the minimum-variance linear unbiased estimates of the mean forest AGB when averaged to 0.1°. These are used to assess four AGB maps: Baccini (2000), GEOCARBON (2008), GlobBiomass (2010) and CCI Biomass (2017). Map bias, estimated using the differences between the plot and 0.1° map averages, is modelled using random forest regression driven by variables shown to affect the map estimates. The bias model is particularly sensitive to the map estimate of AGB and tree cover, and exhibits strong regional biases. Variograms indicate that AGB map errors have map-specific spatial correlation up to a range of 50–104 km, which increases the variance of spatially aggregated AGB map estimates compared to when pixel errors are independent. After bias adjustment, total pantropical AGB and its associated SD are derived for the f