lee/pandoc
1
0 Fork 0
mirror of https://github.com/jgm/pandoc.git synced 2026-11-15 10:20:11 +00:00
Code Issues Packages Projects Releases Wiki Activity

CommonMark reader: Handle ascii_identifiers extension (#4733)

Browse Source 
Non-ascii characters were not stripped from identifiers even if the
`ascii_identifiers` extension was enabled (which is is by default for
gfm).

Closes #4742
This commit is contained in:
Anders Waldenborg authored and John MacFarlane committed 2018-06-29 10:41:26 +02:00
1 parent bb5a2464d5
commit 904924d172
2 files changed
+42 -12
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

test/command/4742.md
+25
View File
@@ -0,0 +1,25 @@
Check that the commonmark reader handles the `ascii_identifiers`
extension properly.
```
% pandoc -f commonmark+gfm_auto_identifiers+ascii_identifiers -t native
# non ascii ⚠️ räksmörgås
^D
[Header 1 ("non-ascii--raksmorgas",[],[]) [Str "non",Space,Str "ascii",Space,Str "\9888\65039",Space,Str "r\228ksm\246rg\229s"]]
```
```
% pandoc -f commonmark+gfm_auto_identifiers-ascii_identifiers -t native
# non ascii ⚠️ räksmörgås
^D
[Header 1 ("non-ascii-\65039-r\228ksm\246rg\229s",[],[]) [Str "non",Space,Str "ascii",Space,Str "\9888\65039",Space,Str "r\228ksm\246rg\229s"]]
```
`gfm` should have `ascii_identifiers` enabled by default.
```
% pandoc -f gfm -t native
# non ascii ⚠️ räksmörgås
^D
[Header 1 ("non-ascii--raksmorgas",[],[]) [Str "non",Space,Str "ascii",Space,Str "\9888\65039",Space,Str "r\228ksm\246rg\229s"]]
```