I found what was causing it. Smart quotes requires you to use spellcheck on. I think this applies to every program, not just Obsidian.
If spellcheck is on, you can use Edit–>Substitutions to
- disable (or enable) smart quotes
- customize smart quotes format so that you can override the system setting for smart quotes