We consider inference for functions of the marginal covariance matrix under a class of stationary vector time series models, referred to as time-orthogonal principal components models. The main application which motivated this work involves the estimation of configurational entropy from molecular dynamics simulations in computational chemistry, where current methods of entropy estimation involve calculations based on the sample covariance matrix. The theoretical results we obtain provide a basis for approximate inference procedures, including confidence interval calculations for scalar quantities of interest; these results are applied to the molecular dynamics application, and some further applications are discussed briefly.