We present an equation-free computational approach to the study of the coarse-grained dynamics of finite assemblies of nonidentical coupled oscillators at and near full synchronization. We use coarse-grained observables which account for the (rapidly developing) correlations between phase angles and natural frequencies. Exploiting short bursts of appropriately initialized detailed simulations, we circumvent the derivation of closures for the long-term dynamics of the assembly statistics.