Dear Julian,
according to our understanding, a Member State's competent authority is entitled to issue certificates in the official language of that Member State, being an official language of the EU. An applicant who wishes or needs to present such a document to the competent authority of another Member State would be responsible for providing a certified translation, if necessary.
We hope this helps.
Best regards
Christian