CMAT CMIP3 Repository

Scoring is based on mean of the pattern correlations for the annual mean, seasonal contrast, and ENSO teleconnections.

NetCDF files with data of plotted fields can be found in case directories in this compressed tarfile (10 GB).

Created: Jan 22, 2020 @ 12:23:27

CMIP3 Archive

Case ID	Benchmark Case	Notes	Flags	Improvements	Degradations
bccr_bcm2_0 0.71: 0.71; 0.73; 0.70 A; B; B	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ NHM-SHM hfls too small.	hfls PCor-ENSO, hur925 PCor-AC, hur925 PCor-ENSO, psl PCor-AC,	rsnt PCor-ENSO, see also swcftoa, ALBDS rlut PCor-ENSO, see also lwcftoa, tas, TMQ pr PCor-ENSO, ep PCor-ENSO, hur500 PCor-AM,
cccma_cgcm3_1 0.73: 0.74; 0.75; 0.71 A; B; A	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too small. see also swcftoa, ALBDS NHM-SHM rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ OM-LM lwcftoa too small.	fs PCor-ENSO, pr PCor-AM, ep PCor-AM, hur925 PCor-AC, hur925 PCor-ENSO, psl PCor-AC,	rlut PCor-ENSO, see also lwcftoa, tas, TMQ zg500 PCor-AC, wap500 PCor-AM, psl PCor-ENSO, hur500 PCor-ENSO,
cccma_cgcm3_1_t63 0.76: 0.76; 0.77; 0.74 A; B; B	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too small. see also swcftoa, ALBDS NHM-SHM rlut too small. see also lwcftoa, tas, TMQ	fs PCor-ENSO, pr PCor-AM, hfls PCor-ENSO, ep PCor-AM, hur925 PCor-AC, hur925 PCor-ENSO, psl PCor-AC,	zg500 PCor-AC,
cnrm_cm3 0.73: 0.74; 0.72; 0.73 A; B; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ Global Mean swcftoa too small. see also ALBDS OM-LM swcftoa too large. see also ALBDS Global Mean lwcftoa too large. NHM-SHM lwcftoa too small. OM-LM lwcftoa too small. Global Mean hfls too large.	fs PCor-ENSO, hfls PCor-ENSO, hur925 PCor-AC,	rlut PCor-ENSO, see also lwcftoa, tas, TMQ lwcftoa PCor-AM, lwcftoa PCor-ENSO, wap500 PCor-AM, psl PCor-AM,
csiro_mk3_0 0.72: 0.74; 0.69; 0.73 A; A; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ OM-LM swcftoa too large. see also ALBDS Global Mean lwcftoa too large. NHM-SHM lwcftoa too small. OM-LM lwcftoa too small.	zg500 PCor-ENSO, hur925 PCor-ENSO,	swcftoa PCor-AM, see also ALBDS lwcftoa PCor-AC, ep PCor-ENSO, zg500 PCor-AM, zg500 PCor-AC,
csiro_mk3_5 0.75: 0.76; 0.73; 0.74 A; A; A	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS NHM-SHM rlut too large. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ Global Mean lwcftoa too large. NHM-SHM lwcftoa too small. OM-LM lwcftoa too small.	rsnt PCor-ENSO, see also swcftoa, ALBDS lwcftoa PCor-ENSO, pr PCor-AM, pr PCor-ENSO, ep PCor-AM, zg500 PCor-ENSO, hur925 PCor-ENSO,	zg500 PCor-AC,
gfdl_cm2_0 0.78: 0.80; 0.75; 0.81 A; A; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ NHM-SHM rlut too small. see also lwcftoa, tas, TMQ Global Mean swcftoa too small. see also ALBDS	rsnt PCor-ENSO, see also swcftoa, ALBDS swcftoa PCor-ENSO, see also ALBDS fs PCor-ENSO, pr PCor-AM, pr PCor-AC, hfls PCor-ENSO, ep PCor-AM, zg500 PCor-ENSO, hur925 PCor-ENSO, wap500 PCor-AM, wap500 PCor-AC, psl PCor-AC,
gfdl_cm2_1 0.76: 0.76; 0.72; 0.80 A; A; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ NHM-SHM rlut too small. see also lwcftoa, tas, TMQ	pr PCor-AM, pr PCor-AC, pr PCor-ENSO, zg500 PCor-ENSO, hur925 PCor-ENSO, psl PCor-AC,
giss_aom 0.59: 0.65; 0.63; 0.49 A; A; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ		rsnt PCor-ENSO, see also swcftoa, ALBDS rlut PCor-ENSO, see also lwcftoa, tas, TMQ fs PCor-AM, pr PCor-AC, prw PCor-ENSO, hfls PCor-AM, hfls PCor-AC, hfls PCor-ENSO, ep PCor-AM, ep PCor-AC, ep PCor-ENSO, rtfs PCor-AM, rtfs PCor-AC, rtfs PCor-ENSO, zg500 PCor-AM, zg500 PCor-AC, zg500 PCor-ENSO, wap500 PCor-AM, wap500 PCor-AC, wap500 PCor-ENSO, psl PCor-AM, psl PCor-AC, psl PCor-ENSO,
giss_model_e_h 0.47: 0.57; 0.55; 0.28 N/A; N/A; N/A	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS NHM-SHM rlut too small. see also lwcftoa, tas, TMQ OM-LM swcftoa too large. see also ALBDS NHM-SHM hfls too small.		rsnt PCor-ENSO, see also swcftoa, ALBDS rlut PCor-ENSO, see also lwcftoa, tas, TMQ swcftoa PCor-AM, see also ALBDS swcftoa PCor-ENSO, see also ALBDS lwcftoa PCor-AM, lwcftoa PCor-AC, lwcftoa PCor-ENSO, pr PCor-AM, pr PCor-AC, pr PCor-ENSO, prw PCor-ENSO, hfls PCor-AC, ep PCor-AM, ep PCor-AC, ep PCor-ENSO, zg500 PCor-AM, zg500 PCor-AC, zg500 PCor-ENSO, hur925 PCor-ENSO, wap500 PCor-AM, wap500 PCor-AC, wap500 PCor-ENSO, psl PCor-AM, psl PCor-ENSO, hur500 PCor-AM, hur500 PCor-AC, hur500 PCor-ENSO,
giss_model_e_r 0.61: 0.70; 0.60; 0.53 A; A; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS NHM-SHM rlut too small. see also lwcftoa, tas, TMQ OM-LM swcftoa too large. see also ALBDS NHM-SHM hfls too small.		rlut PCor-ENSO, see also lwcftoa, tas, TMQ swcftoa PCor-AM, see also ALBDS swcftoa PCor-AC, see also ALBDS swcftoa PCor-ENSO, see also ALBDS lwcftoa PCor-AM, lwcftoa PCor-AC, lwcftoa PCor-ENSO, prw PCor-ENSO, hfls PCor-AC, hfls PCor-ENSO, ep PCor-AM, ep PCor-AC, zg500 PCor-AM, zg500 PCor-AC, zg500 PCor-ENSO, hur925 PCor-ENSO, wap500 PCor-AM, wap500 PCor-AC, wap500 PCor-ENSO, psl PCor-AM, psl PCor-ENSO, hur500 PCor-AM, hur500 PCor-AC, hur500 PCor-ENSO,
iap_fgoals1_0_g 0.70: 0.72; 0.68; 0.69 A; B; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too large. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ NHM-SHM rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ NHM-SHM lwcftoa too small. NHM-SHM hfls too small.	fs PCor-ENSO, hfls PCor-ENSO, hur925 PCor-ENSO, psl PCor-ENSO,	swcftoa PCor-AM, see also ALBDS lwcftoa PCor-AC, fs PCor-AM, pr PCor-AC, ep PCor-AM, ep PCor-AC, rtfs PCor-AC, zg500 PCor-AM, zg500 PCor-AC, wap500 PCor-AM, wap500 PCor-AC, hur500 PCor-AC,
ingv_echam4 0.74: 0.73; 0.74; 0.75 A; A; B	ncar_ccsm3_0	cmip3	Global Mean rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ	hfls PCor-ENSO, hur925 PCor-AC, hur925 PCor-ENSO, psl PCor-AC,	pr PCor-ENSO, ep PCor-ENSO, wap500 PCor-ENSO, hur500 PCor-ENSO,
mpi_echam5 0.76: 0.77; 0.76; 0.74 A; A; B	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ NHM-SHM rlut too small. see also lwcftoa, tas, TMQ Global Mean swcftoa too small. see also ALBDS	swcftoa PCor-AM, see also ALBDS hfls PCor-ENSO, hur925 PCor-AC, wap500 PCor-AC, psl PCor-AC,
inmcm3_0 0.61: 0.59; 0.60; 0.63 N/A; N/A; N/A	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ NHM-SHM rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ	hur925 PCor-AC,	rsnt PCor-ENSO, see also swcftoa, ALBDS rlut PCor-AM, see also lwcftoa, tas, TMQ rlut PCor-ENSO, see also lwcftoa, tas, TMQ swcftoa PCor-ENSO, see also ALBDS lwcftoa PCor-AM, lwcftoa PCor-AC, lwcftoa PCor-ENSO, fs PCor-AM, pr PCor-AM, pr PCor-AC, pr PCor-ENSO, prw PCor-ENSO, ep PCor-AM, ep PCor-AC, ep PCor-ENSO, rtfs PCor-AC, rtfs PCor-ENSO, zg500 PCor-ENSO, hur925 PCor-ENSO, wap500 PCor-AM, wap500 PCor-AC, psl PCor-ENSO, hur500 PCor-AM, hur500 PCor-AC, hur500 PCor-ENSO,
ipsl_cm4 0.67: 0.67; 0.67; 0.67 A; A; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ NHM-SHM rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ Global Mean swcftoa too small. see also ALBDS OM-LM swcftoa too large. see also ALBDS	fs PCor-ENSO, hfls PCor-ENSO,	rlut PCor-AC, see also lwcftoa, tas, TMQ lwcftoa PCor-AC, fs PCor-AM, fs PCor-AC, pr PCor-AC, rtfs PCor-AM, rtfs PCor-AC, zg500 PCor-AM, zg500 PCor-AC, wap500 PCor-AM, wap500 PCor-AC, psl PCor-AM,
miroc3_2_hires 0.70: 0.69; 0.67; 0.73 B; B; B	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS NHM-SHM swcftoa too large. see also ALBDS OM-LM swcftoa too large. see also ALBDS	pr PCor-AM, hfls PCor-AC, ep PCor-AM, wap500 PCor-AM, wap500 PCor-AC, psl PCor-AC,	rsnt PCor-ENSO, see also swcftoa, ALBDS rlut PCor-ENSO, see also lwcftoa, tas, TMQ swcftoa PCor-ENSO, see also ALBDS lwcftoa PCor-ENSO, prw PCor-ENSO, ep PCor-ENSO, rtfs PCor-ENSO, wap500 PCor-ENSO, psl PCor-ENSO, hur500 PCor-ENSO,
miroc3_2_medres 0.71: 0.71; 0.69; 0.73 A; A; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ Global Mean swcftoa too small. see also ALBDS NHM-SHM swcftoa too large. see also ALBDS OM-LM swcftoa too large. see also ALBDS	pr PCor-AM, pr PCor-ENSO, psl PCor-AC,	rsnt PCor-ENSO, see also swcftoa, ALBDS swcftoa PCor-AM, see also ALBDS swcftoa PCor-ENSO, see also ALBDS psl PCor-ENSO,
miub_echo_g 0.75: 0.79; 0.75; 0.70 A; A; A	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ NHM-SHM rlut too small. see also lwcftoa, tas, TMQ	rsnt PCor-ENSO, see also swcftoa, ALBDS swcftoa PCor-ENSO, see also ALBDS fs PCor-ENSO, pr PCor-AM, pr PCor-ENSO, hfls PCor-ENSO, ep PCor-AM, ep PCor-ENSO, rtfs PCor-ENSO, psl PCor-AC,	lwcftoa PCor-AC, fs PCor-AM,
mri_cgcm2_3_2a 0.76: 0.76; 0.74; 0.76 A; B; A	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ NHM-SHM rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ OM-LM swcftoa too large. see also ALBDS Global Mean lwcftoa too small.	rsnt PCor-ENSO, see also swcftoa, ALBDS fs PCor-ENSO, pr PCor-AM, pr PCor-ENSO, hfls PCor-ENSO, ep PCor-AM, ep PCor-ENSO, rtfs PCor-ENSO, zg500 PCor-ENSO, hur925 PCor-ENSO, wap500 PCor-AM, wap500 PCor-ENSO, psl PCor-AC,	lwcftoa PCor-AC, hur500 PCor-AM, hur500 PCor-AC,
ncar_ccsm3_0 0.73: 0.76; 0.68; 0.75 A; B; A	ncar_ccsm3_0	cmip3	Global Mean rsnt too small. see also swcftoa, ALBDS NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS Global Mean rlut too small. see also lwcftoa, tas, TMQ OM-LM rlut too large. see also lwcftoa, tas, TMQ Global Mean swcftoa too small. see also ALBDS
ncar_pcm1 0.62: 0.70; 0.63; 0.52 A; A; A	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too small. see also swcftoa, ALBDS Global Mean swcftoa too small. see also ALBDS Global Mean hfls too large.		rlut PCor-AC, see also lwcftoa, tas, TMQ swcftoa PCor-AM, see also ALBDS lwcftoa PCor-AM, lwcftoa PCor-AC, pr PCor-AM, pr PCor-AC, hfls PCor-AC, ep PCor-AM, ep PCor-AC, zg500 PCor-AM, zg500 PCor-AC, hur925 PCor-AM, wap500 PCor-AM, wap500 PCor-AC, hur500 PCor-AM, hur500 PCor-AC, hur500 PCor-ENSO,
ukmo_hadcm3 0.74: 0.73; 0.75; 0.74 A; B; A	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS Global Mean lwcftoa too small. NHM-SHM hfls too small.	pr PCor-AM, pr PCor-AC, hfls PCor-ENSO, hur925 PCor-AC, psl PCor-AC,	rlut PCor-ENSO, see also lwcftoa, tas, TMQ lwcftoa PCor-ENSO, fs PCor-AM,
ukmo_hadgem1 0.69: 0.69; 0.67; 0.70 A; A; A	ncar_ccsm3_0	cmip3	NHM-SHM rsnt too small. see also swcftoa, ALBDS OM-LM rsnt too large. see also swcftoa, ALBDS OM-LM rlut too large. see also lwcftoa, tas, TMQ OM-LM swcftoa too large. see also ALBDS Global Mean hfls too large. NHM-SHM hfls too small.	swcftoa PCor-AM, see also ALBDS pr PCor-AM, ep PCor-AC, zg500 PCor-AM, wap500 PCor-AC, psl PCor-AC,	rsnt PCor-ENSO, see also swcftoa, ALBDS rlut PCor-ENSO, see also lwcftoa, tas, TMQ swcftoa PCor-ENSO, see also ALBDS lwcftoa PCor-ENSO, pr PCor-ENSO, ep PCor-ENSO, rtfs PCor-ENSO, wap500 PCor-ENSO, psl PCor-ENSO, hur500 PCor-ENSO,

Name	Avg. Score	High Score	Data
CMIP3	0.68 +/-0.07	GFDL-CM2.1	~20MB
CMIP5	0.74+/-0.05	CESM1, CNRM-CM5	~20MB
CMIP6	0.78+/-0.05	CESM2	~20MB

Name	Avg. Score & 1-Sigma Range
IPSL LENS	0.71 +/- 0.007
CESM1 LENS	0.80+/-0.011