We consider cocycles with negative Lyapunov exponents defined over a hyperbolic dynamical system. It is well known that such systems possess invariant graphs and that under spectral assumptions these graphs have some degree of Hölder regularity. When the invariant graph has a slightly higher Hölder exponent than the a priori lower bound on an open set (even on just a set of positive measure for certain systems), we show that the graph must be Lipschitz or (in the Anosov case) as smooth as the cocycle.