    | DocBook: The Definitive Guide 0.0.12 for DocBook V5.0b1 (Alpha) |
| | DocBook: The Definitive Guide 0.0.12 for DocBook V5.0b1 (Alpha) |
token — A unit of information
token ::=
altanchorannotationbibliorefindexterm (db.indexterm.endofrange)indexterm (db.indexterm.singular)indexterm (db.indexterm.startofrange)inlinemediaobjectlinkolinkphrase (db._phrase)remarkreplaceablesubscriptsuperscriptxrefA Token identifies a unit of information. Usually,
“tokens” are the result of some processing pass that
has performed lexical analysis and divided a data set into the
smallest units of information used for subsequent processing.
Exactly what constitutes a token varies by context.
These elements contain token: bridgehead, citation, citetitle, classsynopsisinfo, computeroutput, emphasis (db.emphasis), entry, firstterm, funcsynopsisinfo, glosssee, glossseealso, glossterm, html:button, html:label, html:legend, link, literallayout, member, olink, orgdiv, para, phrase (db.phrase), primary, primaryie, programlisting, quote, refdescriptor, refentrytitle, refname, refpurpose, screen, secondary, secondaryie, see, seealso, seealsoie, seeie, seg, segtitle, simpara, subtitle, synopsis, td, term, termdef, tertiary, tertiaryie, th, title, titleabbrev, tocentry, userinput.
The following elements occur in token: text, alt, anchor, annotation, biblioref, indexterm (db.indexterm.endofrange), indexterm (db.indexterm.singular), indexterm (db.indexterm.startofrange), inlinemediaobject, link, olink, phrase (db._phrase), remark, replaceable, subscript, superscript, xref.
<article xmlns='http://docbook.org/ns/docbook'> <title>Example token</title> <para>In parsing, line ends are turned into the <token>CRLF</token>, all other whitespace becomes <token>WHITESP</token>. </para> </article>
In parsing, line ends are turned into the CRLF, all other whitespace becomes WHITESP.
| | | |
| tocentry | | trademark |