The article identifies measurable attributes to find the consistency in pitch ratings which are otherwise subjective decisions made by referees for international test match cricket. To do so, the article uses statistics related to test matches, one-days and T20s played among all test playing nations between March 2017 and March 2019 (53 tests, 142 T20s and 172 one-day matches: the next two seasons ending May 2020/2021 were hit by COVID-19 and hence excluded). To measure the consistency of pitch ratings (very good, good, above average, average, below average and poor), measurable attributes like runs/day, wickets/day, runs/over, runs/wicket and overs/wicket were identified. To rank pitch ratings using these attributes, the multi-criteria decision-making technique—PROMETHEE II was used. We found that the referee pitch ratings are largely consistent and the attributes developed can be utilized to further analyse future judgements regarding pitch ratings. Further, six-pitch ratings can be clustered into two distinct groups that are significantly different from each other. The article is among the first to analyse sports pitch ratings by using team performance-based statistics. This study paves the way for similar studies and development of newer statistical flow-based attributes.