The noun cheer can be countable or uncountable.
In more general, commonly used, contexts, the plural form will also be cheer.
However, in more specific contexts, the plural form can also be cheers e.g. in reference to various types of cheers or a collection of cheers.