The past tense of stay out late is stayed out late.

The third-person singular simple present indicative form of stay out late is stays out late.

The present participle of stay out late is staying out late.

The past participle of stay out late is stayed out late.