2502 Commits
Author SHA1 Message Date
John MacFarlane 2b11ce9bab Update tests for previous commit (protecting phantomsection). 2025-03-15 11:14:36 -07:00
John MacFarlane 4bf3a735f5 LaTeX writer: use * for multirow width when no colwidth specified.
Otherwise the multirow will be excessively wide.

Closes #10685.
2025-03-14 18:42:59 -07:00
John MacFarlane 28eca1e41e Markdown reader: remove some misguided list fanciness.
Previously we tried to handle things like commented out list
items:

    - one
    <!--
    - two
    -->
    - three

and also things like:

    - one `and
    - two` and

But the code we added to handle these cases caused problems with
other, more straightforward things, like:

    - one
    - ```
      code
      ```
    - three

So we are rolling back all the fanciness, so that the markdown
parser now behaves more like the commonmark parser, in which
indicators of block-level structure always take priority over
indicators of inline structure.

Closes #9865. Closes #7778. See also #5628.
2025-03-14 15:07:16 -07:00
John MacFarlane b7d2c4815f Markdown reader: fixed escapedChar' parser.
It should not accept escaped newlines.
See #10672.
2025-03-07 14:28:10 -08:00
John MacFarlane 45fdd1de10 Fix invalid OOXML in definition_list.docx test.
Closes #10394.
2025-03-05 21:41:30 -08:00
John MacFarlane e73b9ee1d8 Disable citations extension in writers if --citeproc is used.
Otherwise we get undesirable results, as the format's native
citation mechanism is used instead of (or in addition to) the
citeproc-generated citations. Closes #10662.
2025-03-05 13:24:05 -08:00
John MacFarlane 6c3e43dc57 LaTeX reader: better handle comments/whitespace in option lists and includes.
Closes #10659.
2025-03-04 15:00:37 -08:00
John MacFarlane 4ba0bac5c1 Update JATS tests for mathml rendering changes. 2025-03-01 22:14:40 -08:00
John MacFarlane 97ec88a16c Update typst test. 2025-02-28 22:55:39 -08:00
John MacFarlane ac79938043 Typst writer: better heuristics for escaping potential list markers.
Closes #10650.
2025-02-27 13:37:25 -08:00
John MacFarlane e2a0cc9dda Use latest dev texmath. 2025-02-25 22:49:50 -08:00
John MacFarlane 3caf2b1e3a Revert "Docx reader and writer: support row heads."
This reverts commit cbe67b9602.

Word sets `w:firstColumn="1"` by default for tables.  You have to find
the Table Design tab and explicitly uncheck "First Column" to make this
go away.  In most cases, I don't think writers intend to designate
the first column as a row head, so this commit is going to produce
unexpected results.  In addition, because of the table normalization
done by pandoc-type's `tableWith`, any table containing a colspanned
cell in the left-hand column will get broken if the first column is
designated a row head.  For these reasons it seems best to revert this
change, which was made in response to #9495.

Closes #10627.
2025-02-19 10:02:50 -08:00
John MacFarlane bf1c17c883 Markdown reader: allow line break between URL and title of link.
Closes #10621.
2025-02-14 10:17:26 -08:00
John MacFarlane f5d41a0c3f Powerpoint writer: avoid extra blank lines before author.
(In the case where there is no subtitle.)

Closes #10619.
2025-02-13 14:35:08 -08:00
John MacFarlane 54039e392d Update pandoc-citeproc-320a test.
See #10610.
2025-02-13 14:19:58 -08:00
John MacFarlane c21177b113 Smart quote parsing: ignore curly quotes.
Previously we tried to match curly quotes as well as straight
quotes, producing Quoted inlines.  But it seems better just to
assume that those who use curly quotes want them passed through
verbatim.

This also fixes an (unintended) bug whereby curly single left
quotes would sometimes be changed to single right quotes.

Closes #10610.
2025-02-13 13:58:53 -08:00
John MacFarlane 0fe6254535 Markdown writer: omit extra space after bullets.
We used to insert extra spaces to ensure that the content respected
the four-space rule.  That is not really necessary now, since pandoc's
markdown and most markdowns don't follow the four-space rule.

Those who want the old behavior can obtain it by using
`-t markdown+four_space_rule`.

Closes #7172.
2025-02-12 09:41:20 -08:00
John MacFarlane 49d154c769 Use babel options shorthands=off.
This has been fixed now in Babel for some time.  So we can now
get rid of the ugly code that disabled language-specific shorthands
(see e26d31d).

Closes #6817.
2025-02-10 13:22:33 -08:00
John MacFarlane 4948d27fee Remove selnolig-langs.
We now specify the language as a global option again, so we
no longer need to specify it when invoking selnolig.

See #9863.
2025-02-10 13:02:58 -08:00
John MacFarlane 64a4f60c02 TWiki reader: use "wikilink" class, instead of title. 2025-02-09 11:43:38 -08:00
John MacFarlane 9be0963327 LaTeX writer/template: Improve babel support.
Previously we used the `.ini` files for every language, but
for European languages these tend to provide inferior results
to the `.ldf` files used by classic Babel. Currently Babel
documentation recommends using the classic system for European
languages written in Latin and Cyrillic scripts and Vietnamese.
So the LaTeX writer and template now follow this guidance.

Main languages in the list of languages with good "classic" support
are added to global documentclass options and will be automatically
handled by Babel using the `.ldf` files.

If the main language is not in this list, the `babeloptions` variable
will be set to `provide=*`, which will cause support to be loaded from
the `.ini` file rather than an `.ldf`. So, for example, setting
`-V babeloptions=''` with a polytonic Greek document will cause the
`.ldf` support to be used instead of the `.ini`.

The default setting of this variable can be overwritten, but in most
cases the default should give good results.

Closes #8283.
2025-02-08 10:45:11 -08:00
Evan Silberman 97b36ecb77 Track wikilinks with a class instead of a title
Once upon a time the only metadata element for links in Pandoc's AST was
a title, and it was hijacked to track certain links as having originated
in the wikilink syntax. Now we have Attrs and we can use a class to
handle wikilinks instead.

Requires coordinated changes to commonmark-hs.
2025-02-07 14:04:12 -08:00
Charles Tapley HoytandJez Cope 1eed55f391 Add CRediT roles to JATS
Enable annotating author roles using the Contribution Role Taxonomy
(CRediT) and export this information in conformant JATS

Closes #10152.

Co-Authored-By: Jez Cope <457628+jezcope@users.noreply.github.com>
2025-02-05 21:28:56 -08:00
John MacFarlane f72548a7c2 DocBook reader: Handle title inside orderedlist.
Also some other elements that allow title: blockquote,
calloutlist, etc.
Closes #10594.
2025-02-03 12:33:39 -08:00
John MacFarlane 1470b3a573 DocBook reader: better handle formalpara, example, and sidebar.
Include identifiers and titles in each case.

The code should be credited to @tombolano.

Closes #8666.
2025-02-01 17:04:38 -08:00
John MacFarlane fe3e7c948c ODT reader: create Figure elements for images that are figures.
Closes #10567.
2025-02-01 10:39:31 -08:00
John MacFarlane 6fbb50fc88 Docx writer: repeat reference doc's sectPr for each new section.
Previously we were only carrying over the reference doc's sectPr
at the end of the document, so it wouldn't affect the intermediate
sections that are now added if `--top-level-division` is `chapter`
or `part`. This could lead to bad results (e.g. page numbering
starting only on the last chapter).

Closes #10577.
2025-01-31 11:44:48 -08:00
John MacFarlane a14fe6f446 Update docx golden tests for reference doc changes. 2025-01-31 09:20:51 -08:00
John MacFarlane 42ea0fff1f ODT reader: avoid producing spurious blockquotes in list items.
Closes #9505.
2025-01-30 22:21:10 -08:00
Stephen ReindlandStephen Reindl 3c8ca600ef DOCX reader: do not issue warning for comments with +styles (#10572)
Closes #10571.

Co-authored-by: Stephen Reindl <stephen.reindl@outlook.de>
2025-01-30 15:23:53 -08:00
Evan Silberman d680ce0100 Handle <abbr> as a span-like inline
Closes #5793
2025-01-29 15:59:26 -06:00
silby 0be07a5e4d Test \{,re}newcommand arguments (#10573)
Closes #4470
2025-01-29 11:32:25 -08:00
Gordon Woodhull 220dde406b brace tables with typst:no-figure and typst:text attributes (#10563)
The combination of #9648 Typst property output and #9778
`typst:no-figure` can cause fonts to spill out of tables.

This is because setting Typst text properties across a table
requires `set text(...)` outside the table, and previously we
were relying on the figure to provide a scope.

This adds an extra `#{...}` when the table has class `typst:no-figure`
and also has `typst:text:*` attributes.
2025-01-24 10:48:03 -08:00
Max Heller b95645b0a0 Prefer MIME type when determining extensions for MediaBag items (#10557)
Currently, remote images added to the MediaBag are stored at paths with
extensions determined based on the external URI. For instance, an image
from https://example.com/image.png is stored as <hash>.png. If the
URI does not contain an extension (e.g., https://example.com/image),
then the content-type of the downloaded image is used to determine the
extension.

This change switches the precedence such that content-type is preferred
over extensions contained in the URI. This is necessary because some
images are located at URIs with misleading extensions -- shields.io,
for instance, serves SVGs from URIs with .yml extensions. With this
change, the image/svg+xml content-type is now preferred over the .yml
URI extension. This fixes a bug in the PDF writer in which such an image
would be mishandled due to not being identified as an SVG.
2025-01-21 17:54:47 -08:00
John MacFarlane 96d4f5be51 Citeproc: fix moving punctuation before citation notes.
This previously worked with regular citations, but not author-in-text
citations. Now it works with both.
2025-01-16 08:32:02 -08:00
silby 806dcb0849 Consume blanks after =encoding in pod reader (#10544)
The reader did not properly consume empty lines after =encoding commands,
which produced various incorrect parses depending on the content between
there and the next command.

Fixes #10537
2025-01-15 12:07:26 -08:00
John MacFarlane 2b6554c475 Fix escaping of - in ms writer.
In 5132f1ef33 we added `-` to
the list of characters needing backslash escaping, to accommodate
a change in groff man's behavior, described here:
https://lwn.net/Articles/947941/

This change also led `-` to be escaped in ms output, but that
is wrong; `\-` in ms is a unicode minus sign.

To fix this, we add a Boolean parameter to `escapeString` in
Text.Pandoc.Writers.Roff that determines whether `-` is to
be escaped.  (NB: This is not an exported function in the API.)

The list `standardEscapes` in Text.Pandoc.RoffChar no longer
contains `-`.

Closes #10536.
2025-01-14 09:27:02 -08:00
Hendrik Erz 0a2e8dd1d6 HTML styles: fix style of hr so it works when printed (#10535)
Previously `background-color` was used to style the hr, but this gets ignored
when printing.  This commit uses `border-top` instead.
2025-01-14 09:19:42 -08:00
John MacFarlane c79ef1270e Fix 9495 command test for windows. 2025-01-10 23:43:32 -08:00
John MacFarlane cbe67b9602 Docx reader and writer: support row heads.
Reader: When `w:tblLook` has `w:firstColumn` set (or an equivalent bit
mask), we set row heads = 1 in the AST.

Writer: set `w:firstColumn` in `w:tblLook` when there are row
heads. (Word only allows one, so this is triggered by any number
of row heads > 0.)

Closes #9495.
2025-01-10 22:50:17 -08:00
John MacFarlane 6051d62e56 Docx reader: read table styles as custom styles...
...when `styles` extension is enabled.  Closes #9603.

Also improve manual's coverage of custom styles.
2025-01-10 10:30:08 -08:00
John MacFarlane 968b0c13ee Typst writer: fix handling of pixel image dimensions.
These are now converted to inches as in the LaTeX writer.

Closes #9945.
2025-01-01 23:00:35 -08:00
John MacFarlane 01b54593cc AsciiDoc writer: improve escaping.
Closes #10385.
Closes #2337.
Closes #6424.
2024-12-28 19:43:23 -08:00
John MacFarlane 9fa4fa3c51 RST reader: fix handling of underscores.
Fixes a regression in 3.6 that caused problems parsing
text with underscores.

Closes #10497.
2024-12-27 19:38:56 -08:00
Evan Silberman c4716d41c5 Add Pod reader
Pod ("Plain old documentation") is a markup languaged used principally
to document Perl modules and programs. Since it was originally meant to
be translated pretty directly to man, the semantics are fairly simple.

This Pod reader was developed with reference to the canonical user and
implementer documentation of Pod: https://perldoc.perl.org/perlpod and
https://perldoc.perl.org/perlpodspec.

There are 1490 .pod, .pl, and .pm in the Perl 5.34 distribution found in
/System/Library/Perl on my mac. Of those, this reader dies with a parse
error on 7 of them. All of them seem to be cases where pod commands are
found within a non-colon-prefixed =begin/=end. perlpodspec says I may
treat this as an error.

[API change] adds readPod
2024-12-27 11:10:48 -08:00
John MacFarlane 3c0982c893 MediaWiki reader: allow empty quoted attributes.
Closes #10490.
2024-12-23 10:36:09 -08:00
John MacFarlane e122ca04b0 MediaWiki reader: allow cells starting with +.
Closes #10491.
2024-12-23 10:27:13 -08:00
John MacFarlane b6aff21452 Docx writer: restart footnotes by section by default.
This can be overridden by a final sectPr element in the body
of the reference.docx.

It will only change things for `--top-level-division=chapter`,
since only top-level chapters are put in separate sections.
For that use it will mean that footnote numbers start over with
each chapter, which is usually what is wanted.

Closes #2773.
2024-12-22 13:18:27 -08:00
silby d064ad77a5 RST reader: handle explicit reference links (#10485)
This case was missed when changing the reference link strategy for RST
to allow a single pass.

Closes #10484.
2024-12-22 10:03:00 -08:00
John MacFarlane cfb9bd5cf3 Mediawiki writer: escape line-initial characters...
...that would otherwise be interpreted as list starts.

Closes #9700.
2024-12-20 10:31:43 -08:00