A picture is worth a thousand words.
Summary: different models/folds have different prediction style (slope and intercept). If they are mised, the total r would be lower.
References
Comparing intraclass correlation to Pearson correlation coefficient (with R)