I’ve found out that it’s a problem with the font weight. The workaround I’m using now is to wrap the emoji(s) in a span that resets the font weight like this:
# <span style="font-weight: normal">📜</span> Readme
This way the emoji will still be shown after exporting to pdf.