It is normal to sometimes get NaN for RMSLE scores. Since log cannot be negative, when a prediction value is negative, RMSLE will be shown as NaN.