1<html> 2<head> 3<title>pcreapi specification</title> 4</head> 5<body bgcolor="#FFFFFF" text="#00005A" link="#0066FF" alink="#3399FF" vlink="#2222BB"> 6<h1>pcreapi man page</h1> 7<p> 8Return to the <a href="index.html">PCRE index page</a>. 9</p> 10<p> 11This page is part of the PCRE HTML documentation. It was generated automatically 12from the original man page. If there is any nonsense in it, please consult the 13man page, in case the conversion went wrong. 14<br> 15<ul> 16<li><a name="TOC1" href="#SEC1">PCRE NATIVE API BASIC FUNCTIONS</a> 17<li><a name="TOC2" href="#SEC2">PCRE NATIVE API STRING EXTRACTION FUNCTIONS</a> 18<li><a name="TOC3" href="#SEC3">PCRE NATIVE API AUXILIARY FUNCTIONS</a> 19<li><a name="TOC4" href="#SEC4">PCRE NATIVE API INDIRECTED FUNCTIONS</a> 20<li><a name="TOC5" href="#SEC5">PCRE 8-BIT, 16-BIT, AND 32-BIT LIBRARIES</a> 21<li><a name="TOC6" href="#SEC6">PCRE API OVERVIEW</a> 22<li><a name="TOC7" href="#SEC7">NEWLINES</a> 23<li><a name="TOC8" href="#SEC8">MULTITHREADING</a> 24<li><a name="TOC9" href="#SEC9">SAVING PRECOMPILED PATTERNS FOR LATER USE</a> 25<li><a name="TOC10" href="#SEC10">CHECKING BUILD-TIME OPTIONS</a> 26<li><a name="TOC11" href="#SEC11">COMPILING A PATTERN</a> 27<li><a name="TOC12" href="#SEC12">COMPILATION ERROR CODES</a> 28<li><a name="TOC13" href="#SEC13">STUDYING A PATTERN</a> 29<li><a name="TOC14" href="#SEC14">LOCALE SUPPORT</a> 30<li><a name="TOC15" href="#SEC15">INFORMATION ABOUT A PATTERN</a> 31<li><a name="TOC16" href="#SEC16">REFERENCE COUNTS</a> 32<li><a name="TOC17" href="#SEC17">MATCHING A PATTERN: THE TRADITIONAL FUNCTION</a> 33<li><a name="TOC18" href="#SEC18">EXTRACTING CAPTURED SUBSTRINGS BY NUMBER</a> 34<li><a name="TOC19" href="#SEC19">EXTRACTING CAPTURED SUBSTRINGS BY NAME</a> 35<li><a name="TOC20" href="#SEC20">DUPLICATE SUBPATTERN NAMES</a> 36<li><a name="TOC21" href="#SEC21">FINDING ALL POSSIBLE MATCHES</a> 37<li><a name="TOC22" href="#SEC22">OBTAINING AN ESTIMATE OF STACK USAGE</a> 38<li><a name="TOC23" href="#SEC23">MATCHING A PATTERN: THE ALTERNATIVE FUNCTION</a> 39<li><a name="TOC24" href="#SEC24">SEE ALSO</a> 40<li><a name="TOC25" href="#SEC25">AUTHOR</a> 41<li><a name="TOC26" href="#SEC26">REVISION</a> 42</ul> 43<P> 44<b>#include <pcre.h></b> 45</P> 46<br><a name="SEC1" href="#TOC1">PCRE NATIVE API BASIC FUNCTIONS</a><br> 47<P> 48<b>pcre *pcre_compile(const char *<i>pattern</i>, int <i>options</i>,</b> 49<b> const char **<i>errptr</i>, int *<i>erroffset</i>,</b> 50<b> const unsigned char *<i>tableptr</i>);</b> 51<br> 52<br> 53<b>pcre *pcre_compile2(const char *<i>pattern</i>, int <i>options</i>,</b> 54<b> int *<i>errorcodeptr</i>,</b> 55<b> const char **<i>errptr</i>, int *<i>erroffset</i>,</b> 56<b> const unsigned char *<i>tableptr</i>);</b> 57<br> 58<br> 59<b>pcre_extra *pcre_study(const pcre *<i>code</i>, int <i>options</i>,</b> 60<b> const char **<i>errptr</i>);</b> 61<br> 62<br> 63<b>void pcre_free_study(pcre_extra *<i>extra</i>);</b> 64<br> 65<br> 66<b>int pcre_exec(const pcre *<i>code</i>, const pcre_extra *<i>extra</i>,</b> 67<b> const char *<i>subject</i>, int <i>length</i>, int <i>startoffset</i>,</b> 68<b> int <i>options</i>, int *<i>ovector</i>, int <i>ovecsize</i>);</b> 69<br> 70<br> 71<b>int pcre_dfa_exec(const pcre *<i>code</i>, const pcre_extra *<i>extra</i>,</b> 72<b> const char *<i>subject</i>, int <i>length</i>, int <i>startoffset</i>,</b> 73<b> int <i>options</i>, int *<i>ovector</i>, int <i>ovecsize</i>,</b> 74<b> int *<i>workspace</i>, int <i>wscount</i>);</b> 75</P> 76<br><a name="SEC2" href="#TOC1">PCRE NATIVE API STRING EXTRACTION FUNCTIONS</a><br> 77<P> 78<b>int pcre_copy_named_substring(const pcre *<i>code</i>,</b> 79<b> const char *<i>subject</i>, int *<i>ovector</i>,</b> 80<b> int <i>stringcount</i>, const char *<i>stringname</i>,</b> 81<b> char *<i>buffer</i>, int <i>buffersize</i>);</b> 82<br> 83<br> 84<b>int pcre_copy_substring(const char *<i>subject</i>, int *<i>ovector</i>,</b> 85<b> int <i>stringcount</i>, int <i>stringnumber</i>, char *<i>buffer</i>,</b> 86<b> int <i>buffersize</i>);</b> 87<br> 88<br> 89<b>int pcre_get_named_substring(const pcre *<i>code</i>,</b> 90<b> const char *<i>subject</i>, int *<i>ovector</i>,</b> 91<b> int <i>stringcount</i>, const char *<i>stringname</i>,</b> 92<b> const char **<i>stringptr</i>);</b> 93<br> 94<br> 95<b>int pcre_get_stringnumber(const pcre *<i>code</i>,</b> 96<b> const char *<i>name</i>);</b> 97<br> 98<br> 99<b>int pcre_get_stringtable_entries(const pcre *<i>code</i>,</b> 100<b> const char *<i>name</i>, char **<i>first</i>, char **<i>last</i>);</b> 101<br> 102<br> 103<b>int pcre_get_substring(const char *<i>subject</i>, int *<i>ovector</i>,</b> 104<b> int <i>stringcount</i>, int <i>stringnumber</i>,</b> 105<b> const char **<i>stringptr</i>);</b> 106<br> 107<br> 108<b>int pcre_get_substring_list(const char *<i>subject</i>,</b> 109<b> int *<i>ovector</i>, int <i>stringcount</i>, const char ***<i>listptr</i>);</b> 110<br> 111<br> 112<b>void pcre_free_substring(const char *<i>stringptr</i>);</b> 113<br> 114<br> 115<b>void pcre_free_substring_list(const char **<i>stringptr</i>);</b> 116</P> 117<br><a name="SEC3" href="#TOC1">PCRE NATIVE API AUXILIARY FUNCTIONS</a><br> 118<P> 119<b>int pcre_jit_exec(const pcre *<i>code</i>, const pcre_extra *<i>extra</i>,</b> 120<b> const char *<i>subject</i>, int <i>length</i>, int <i>startoffset</i>,</b> 121<b> int <i>options</i>, int *<i>ovector</i>, int <i>ovecsize</i>,</b> 122<b> pcre_jit_stack *<i>jstack</i>);</b> 123<br> 124<br> 125<b>pcre_jit_stack *pcre_jit_stack_alloc(int <i>startsize</i>, int <i>maxsize</i>);</b> 126<br> 127<br> 128<b>void pcre_jit_stack_free(pcre_jit_stack *<i>stack</i>);</b> 129<br> 130<br> 131<b>void pcre_assign_jit_stack(pcre_extra *<i>extra</i>,</b> 132<b> pcre_jit_callback <i>callback</i>, void *<i>data</i>);</b> 133<br> 134<br> 135<b>const unsigned char *pcre_maketables(void);</b> 136<br> 137<br> 138<b>int pcre_fullinfo(const pcre *<i>code</i>, const pcre_extra *<i>extra</i>,</b> 139<b> int <i>what</i>, void *<i>where</i>);</b> 140<br> 141<br> 142<b>int pcre_refcount(pcre *<i>code</i>, int <i>adjust</i>);</b> 143<br> 144<br> 145<b>int pcre_config(int <i>what</i>, void *<i>where</i>);</b> 146<br> 147<br> 148<b>const char *pcre_version(void);</b> 149<br> 150<br> 151<b>int pcre_pattern_to_host_byte_order(pcre *<i>code</i>,</b> 152<b> pcre_extra *<i>extra</i>, const unsigned char *<i>tables</i>);</b> 153</P> 154<br><a name="SEC4" href="#TOC1">PCRE NATIVE API INDIRECTED FUNCTIONS</a><br> 155<P> 156<b>void *(*pcre_malloc)(size_t);</b> 157<br> 158<br> 159<b>void (*pcre_free)(void *);</b> 160<br> 161<br> 162<b>void *(*pcre_stack_malloc)(size_t);</b> 163<br> 164<br> 165<b>void (*pcre_stack_free)(void *);</b> 166<br> 167<br> 168<b>int (*pcre_callout)(pcre_callout_block *);</b> 169<br> 170<br> 171<b>int (*pcre_stack_guard)(void);</b> 172</P> 173<br><a name="SEC5" href="#TOC1">PCRE 8-BIT, 16-BIT, AND 32-BIT LIBRARIES</a><br> 174<P> 175As well as support for 8-bit character strings, PCRE also supports 16-bit 176strings (from release 8.30) and 32-bit strings (from release 8.32), by means of 177two additional libraries. They can be built as well as, or instead of, the 1788-bit library. To avoid too much complication, this document describes the 1798-bit versions of the functions, with only occasional references to the 16-bit 180and 32-bit libraries. 181</P> 182<P> 183The 16-bit and 32-bit functions operate in the same way as their 8-bit 184counterparts; they just use different data types for their arguments and 185results, and their names start with <b>pcre16_</b> or <b>pcre32_</b> instead of 186<b>pcre_</b>. For every option that has UTF8 in its name (for example, 187PCRE_UTF8), there are corresponding 16-bit and 32-bit names with UTF8 replaced 188by UTF16 or UTF32, respectively. This facility is in fact just cosmetic; the 18916-bit and 32-bit option names define the same bit values. 190</P> 191<P> 192References to bytes and UTF-8 in this document should be read as references to 19316-bit data units and UTF-16 when using the 16-bit library, or 32-bit data 194units and UTF-32 when using the 32-bit library, unless specified otherwise. 195More details of the specific differences for the 16-bit and 32-bit libraries 196are given in the 197<a href="pcre16.html"><b>pcre16</b></a> 198and 199<a href="pcre32.html"><b>pcre32</b></a> 200pages. 201</P> 202<br><a name="SEC6" href="#TOC1">PCRE API OVERVIEW</a><br> 203<P> 204PCRE has its own native API, which is described in this document. There are 205also some wrapper functions (for the 8-bit library only) that correspond to the 206POSIX regular expression API, but they do not give access to all the 207functionality. They are described in the 208<a href="pcreposix.html"><b>pcreposix</b></a> 209documentation. Both of these APIs define a set of C function calls. A C++ 210wrapper (again for the 8-bit library only) is also distributed with PCRE. It is 211documented in the 212<a href="pcrecpp.html"><b>pcrecpp</b></a> 213page. 214</P> 215<P> 216The native API C function prototypes are defined in the header file 217<b>pcre.h</b>, and on Unix-like systems the (8-bit) library itself is called 218<b>libpcre</b>. It can normally be accessed by adding <b>-lpcre</b> to the 219command for linking an application that uses PCRE. The header file defines the 220macros PCRE_MAJOR and PCRE_MINOR to contain the major and minor release numbers 221for the library. Applications can use these to include support for different 222releases of PCRE. 223</P> 224<P> 225In a Windows environment, if you want to statically link an application program 226against a non-dll <b>pcre.a</b> file, you must define PCRE_STATIC before 227including <b>pcre.h</b> or <b>pcrecpp.h</b>, because otherwise the 228<b>pcre_malloc()</b> and <b>pcre_free()</b> exported functions will be declared 229<b>__declspec(dllimport)</b>, with unwanted results. 230</P> 231<P> 232The functions <b>pcre_compile()</b>, <b>pcre_compile2()</b>, <b>pcre_study()</b>, 233and <b>pcre_exec()</b> are used for compiling and matching regular expressions 234in a Perl-compatible manner. A sample program that demonstrates the simplest 235way of using them is provided in the file called <i>pcredemo.c</i> in the PCRE 236source distribution. A listing of this program is given in the 237<a href="pcredemo.html"><b>pcredemo</b></a> 238documentation, and the 239<a href="pcresample.html"><b>pcresample</b></a> 240documentation describes how to compile and run it. 241</P> 242<P> 243Just-in-time compiler support is an optional feature of PCRE that can be built 244in appropriate hardware environments. It greatly speeds up the matching 245performance of many patterns. Simple programs can easily request that it be 246used if available, by setting an option that is ignored when it is not 247relevant. More complicated programs might need to make use of the functions 248<b>pcre_jit_stack_alloc()</b>, <b>pcre_jit_stack_free()</b>, and 249<b>pcre_assign_jit_stack()</b> in order to control the JIT code's memory usage. 250</P> 251<P> 252From release 8.32 there is also a direct interface for JIT execution, which 253gives improved performance. The JIT-specific functions are discussed in the 254<a href="pcrejit.html"><b>pcrejit</b></a> 255documentation. 256</P> 257<P> 258A second matching function, <b>pcre_dfa_exec()</b>, which is not 259Perl-compatible, is also provided. This uses a different algorithm for the 260matching. The alternative algorithm finds all possible matches (at a given 261point in the subject), and scans the subject just once (unless there are 262lookbehind assertions). However, this algorithm does not return captured 263substrings. A description of the two matching algorithms and their advantages 264and disadvantages is given in the 265<a href="pcrematching.html"><b>pcrematching</b></a> 266documentation. 267</P> 268<P> 269In addition to the main compiling and matching functions, there are convenience 270functions for extracting captured substrings from a subject string that is 271matched by <b>pcre_exec()</b>. They are: 272<pre> 273 <b>pcre_copy_substring()</b> 274 <b>pcre_copy_named_substring()</b> 275 <b>pcre_get_substring()</b> 276 <b>pcre_get_named_substring()</b> 277 <b>pcre_get_substring_list()</b> 278 <b>pcre_get_stringnumber()</b> 279 <b>pcre_get_stringtable_entries()</b> 280</pre> 281<b>pcre_free_substring()</b> and <b>pcre_free_substring_list()</b> are also 282provided, to free the memory used for extracted strings. 283</P> 284<P> 285The function <b>pcre_maketables()</b> is used to build a set of character tables 286in the current locale for passing to <b>pcre_compile()</b>, <b>pcre_exec()</b>, 287or <b>pcre_dfa_exec()</b>. This is an optional facility that is provided for 288specialist use. Most commonly, no special tables are passed, in which case 289internal tables that are generated when PCRE is built are used. 290</P> 291<P> 292The function <b>pcre_fullinfo()</b> is used to find out information about a 293compiled pattern. The function <b>pcre_version()</b> returns a pointer to a 294string containing the version of PCRE and its date of release. 295</P> 296<P> 297The function <b>pcre_refcount()</b> maintains a reference count in a data block 298containing a compiled pattern. This is provided for the benefit of 299object-oriented applications. 300</P> 301<P> 302The global variables <b>pcre_malloc</b> and <b>pcre_free</b> initially contain 303the entry points of the standard <b>malloc()</b> and <b>free()</b> functions, 304respectively. PCRE calls the memory management functions via these variables, 305so a calling program can replace them if it wishes to intercept the calls. This 306should be done before calling any PCRE functions. 307</P> 308<P> 309The global variables <b>pcre_stack_malloc</b> and <b>pcre_stack_free</b> are also 310indirections to memory management functions. These special functions are used 311only when PCRE is compiled to use the heap for remembering data, instead of 312recursive function calls, when running the <b>pcre_exec()</b> function. See the 313<a href="pcrebuild.html"><b>pcrebuild</b></a> 314documentation for details of how to do this. It is a non-standard way of 315building PCRE, for use in environments that have limited stacks. Because of the 316greater use of memory management, it runs more slowly. Separate functions are 317provided so that special-purpose external code can be used for this case. When 318used, these functions are always called in a stack-like manner (last obtained, 319first freed), and always for memory blocks of the same size. There is a 320discussion about PCRE's stack usage in the 321<a href="pcrestack.html"><b>pcrestack</b></a> 322documentation. 323</P> 324<P> 325The global variable <b>pcre_callout</b> initially contains NULL. It can be set 326by the caller to a "callout" function, which PCRE will then call at specified 327points during a matching operation. Details are given in the 328<a href="pcrecallout.html"><b>pcrecallout</b></a> 329documentation. 330</P> 331<P> 332The global variable <b>pcre_stack_guard</b> initially contains NULL. It can be 333set by the caller to a function that is called by PCRE whenever it starts 334to compile a parenthesized part of a pattern. When parentheses are nested, PCRE 335uses recursive function calls, which use up the system stack. This function is 336provided so that applications with restricted stacks can force a compilation 337error if the stack runs out. The function should return zero if all is well, or 338non-zero to force an error. 339<a name="newlines"></a></P> 340<br><a name="SEC7" href="#TOC1">NEWLINES</a><br> 341<P> 342PCRE supports five different conventions for indicating line breaks in 343strings: a single CR (carriage return) character, a single LF (linefeed) 344character, the two-character sequence CRLF, any of the three preceding, or any 345Unicode newline sequence. The Unicode newline sequences are the three just 346mentioned, plus the single characters VT (vertical tab, U+000B), FF (form feed, 347U+000C), NEL (next line, U+0085), LS (line separator, U+2028), and PS 348(paragraph separator, U+2029). 349</P> 350<P> 351Each of the first three conventions is used by at least one operating system as 352its standard newline sequence. When PCRE is built, a default can be specified. 353The default default is LF, which is the Unix standard. When PCRE is run, the 354default can be overridden, either when a pattern is compiled, or when it is 355matched. 356</P> 357<P> 358At compile time, the newline convention can be specified by the <i>options</i> 359argument of <b>pcre_compile()</b>, or it can be specified by special text at the 360start of the pattern itself; this overrides any other settings. See the 361<a href="pcrepattern.html"><b>pcrepattern</b></a> 362page for details of the special character sequences. 363</P> 364<P> 365In the PCRE documentation the word "newline" is used to mean "the character or 366pair of characters that indicate a line break". The choice of newline 367convention affects the handling of the dot, circumflex, and dollar 368metacharacters, the handling of #-comments in /x mode, and, when CRLF is a 369recognized line ending sequence, the match position advancement for a 370non-anchored pattern. There is more detail about this in the 371<a href="#execoptions">section on <b>pcre_exec()</b> options</a> 372below. 373</P> 374<P> 375The choice of newline convention does not affect the interpretation of 376the \n or \r escape sequences, nor does it affect what \R matches, which is 377controlled in a similar way, but by separate options. 378</P> 379<br><a name="SEC8" href="#TOC1">MULTITHREADING</a><br> 380<P> 381The PCRE functions can be used in multi-threading applications, with the 382proviso that the memory management functions pointed to by <b>pcre_malloc</b>, 383<b>pcre_free</b>, <b>pcre_stack_malloc</b>, and <b>pcre_stack_free</b>, and the 384callout and stack-checking functions pointed to by <b>pcre_callout</b> and 385<b>pcre_stack_guard</b>, are shared by all threads. 386</P> 387<P> 388The compiled form of a regular expression is not altered during matching, so 389the same compiled pattern can safely be used by several threads at once. 390</P> 391<P> 392If the just-in-time optimization feature is being used, it needs separate 393memory stack areas for each thread. See the 394<a href="pcrejit.html"><b>pcrejit</b></a> 395documentation for more details. 396</P> 397<br><a name="SEC9" href="#TOC1">SAVING PRECOMPILED PATTERNS FOR LATER USE</a><br> 398<P> 399The compiled form of a regular expression can be saved and re-used at a later 400time, possibly by a different program, and even on a host other than the one on 401which it was compiled. Details are given in the 402<a href="pcreprecompile.html"><b>pcreprecompile</b></a> 403documentation, which includes a description of the 404<b>pcre_pattern_to_host_byte_order()</b> function. However, compiling a regular 405expression with one version of PCRE for use with a different version is not 406guaranteed to work and may cause crashes. 407</P> 408<br><a name="SEC10" href="#TOC1">CHECKING BUILD-TIME OPTIONS</a><br> 409<P> 410<b>int pcre_config(int <i>what</i>, void *<i>where</i>);</b> 411</P> 412<P> 413The function <b>pcre_config()</b> makes it possible for a PCRE client to 414discover which optional features have been compiled into the PCRE library. The 415<a href="pcrebuild.html"><b>pcrebuild</b></a> 416documentation has more details about these optional features. 417</P> 418<P> 419The first argument for <b>pcre_config()</b> is an integer, specifying which 420information is required; the second argument is a pointer to a variable into 421which the information is placed. The returned value is zero on success, or the 422negative error code PCRE_ERROR_BADOPTION if the value in the first argument is 423not recognized. The following information is available: 424<pre> 425 PCRE_CONFIG_UTF8 426</pre> 427The output is an integer that is set to one if UTF-8 support is available; 428otherwise it is set to zero. This value should normally be given to the 8-bit 429version of this function, <b>pcre_config()</b>. If it is given to the 16-bit 430or 32-bit version of this function, the result is PCRE_ERROR_BADOPTION. 431<pre> 432 PCRE_CONFIG_UTF16 433</pre> 434The output is an integer that is set to one if UTF-16 support is available; 435otherwise it is set to zero. This value should normally be given to the 16-bit 436version of this function, <b>pcre16_config()</b>. If it is given to the 8-bit 437or 32-bit version of this function, the result is PCRE_ERROR_BADOPTION. 438<pre> 439 PCRE_CONFIG_UTF32 440</pre> 441The output is an integer that is set to one if UTF-32 support is available; 442otherwise it is set to zero. This value should normally be given to the 32-bit 443version of this function, <b>pcre32_config()</b>. If it is given to the 8-bit 444or 16-bit version of this function, the result is PCRE_ERROR_BADOPTION. 445<pre> 446 PCRE_CONFIG_UNICODE_PROPERTIES 447</pre> 448The output is an integer that is set to one if support for Unicode character 449properties is available; otherwise it is set to zero. 450<pre> 451 PCRE_CONFIG_JIT 452</pre> 453The output is an integer that is set to one if support for just-in-time 454compiling is available; otherwise it is set to zero. 455<pre> 456 PCRE_CONFIG_JITTARGET 457</pre> 458The output is a pointer to a zero-terminated "const char *" string. If JIT 459support is available, the string contains the name of the architecture for 460which the JIT compiler is configured, for example "x86 32bit (little endian + 461unaligned)". If JIT support is not available, the result is NULL. 462<pre> 463 PCRE_CONFIG_NEWLINE 464</pre> 465The output is an integer whose value specifies the default character sequence 466that is recognized as meaning "newline". The values that are supported in 467ASCII/Unicode environments are: 10 for LF, 13 for CR, 3338 for CRLF, -2 for 468ANYCRLF, and -1 for ANY. In EBCDIC environments, CR, ANYCRLF, and ANY yield the 469same values. However, the value for LF is normally 21, though some EBCDIC 470environments use 37. The corresponding values for CRLF are 3349 and 3365. The 471default should normally correspond to the standard sequence for your operating 472system. 473<pre> 474 PCRE_CONFIG_BSR 475</pre> 476The output is an integer whose value indicates what character sequences the \R 477escape sequence matches by default. A value of 0 means that \R matches any 478Unicode line ending sequence; a value of 1 means that \R matches only CR, LF, 479or CRLF. The default can be overridden when a pattern is compiled or matched. 480<pre> 481 PCRE_CONFIG_LINK_SIZE 482</pre> 483The output is an integer that contains the number of bytes used for internal 484linkage in compiled regular expressions. For the 8-bit library, the value can 485be 2, 3, or 4. For the 16-bit library, the value is either 2 or 4 and is still 486a number of bytes. For the 32-bit library, the value is either 2 or 4 and is 487still a number of bytes. The default value of 2 is sufficient for all but the 488most massive patterns, since it allows the compiled pattern to be up to 64K in 489size. Larger values allow larger regular expressions to be compiled, at the 490expense of slower matching. 491<pre> 492 PCRE_CONFIG_POSIX_MALLOC_THRESHOLD 493</pre> 494The output is an integer that contains the threshold above which the POSIX 495interface uses <b>malloc()</b> for output vectors. Further details are given in 496the 497<a href="pcreposix.html"><b>pcreposix</b></a> 498documentation. 499<pre> 500 PCRE_CONFIG_PARENS_LIMIT 501</pre> 502The output is a long integer that gives the maximum depth of nesting of 503parentheses (of any kind) in a pattern. This limit is imposed to cap the amount 504of system stack used when a pattern is compiled. It is specified when PCRE is 505built; the default is 250. This limit does not take into account the stack that 506may already be used by the calling application. For finer control over 507compilation stack usage, you can set a pointer to an external checking function 508in <b>pcre_stack_guard</b>. 509<pre> 510 PCRE_CONFIG_MATCH_LIMIT 511</pre> 512The output is a long integer that gives the default limit for the number of 513internal matching function calls in a <b>pcre_exec()</b> execution. Further 514details are given with <b>pcre_exec()</b> below. 515<pre> 516 PCRE_CONFIG_MATCH_LIMIT_RECURSION 517</pre> 518The output is a long integer that gives the default limit for the depth of 519recursion when calling the internal matching function in a <b>pcre_exec()</b> 520execution. Further details are given with <b>pcre_exec()</b> below. 521<pre> 522 PCRE_CONFIG_STACKRECURSE 523</pre> 524The output is an integer that is set to one if internal recursion when running 525<b>pcre_exec()</b> is implemented by recursive function calls that use the stack 526to remember their state. This is the usual way that PCRE is compiled. The 527output is zero if PCRE was compiled to use blocks of data on the heap instead 528of recursive function calls. In this case, <b>pcre_stack_malloc</b> and 529<b>pcre_stack_free</b> are called to manage memory blocks on the heap, thus 530avoiding the use of the stack. 531</P> 532<br><a name="SEC11" href="#TOC1">COMPILING A PATTERN</a><br> 533<P> 534<b>pcre *pcre_compile(const char *<i>pattern</i>, int <i>options</i>,</b> 535<b> const char **<i>errptr</i>, int *<i>erroffset</i>,</b> 536<b> const unsigned char *<i>tableptr</i>);</b> 537<br> 538<br> 539<b>pcre *pcre_compile2(const char *<i>pattern</i>, int <i>options</i>,</b> 540<b> int *<i>errorcodeptr</i>,</b> 541<b> const char **<i>errptr</i>, int *<i>erroffset</i>,</b> 542<b> const unsigned char *<i>tableptr</i>);</b> 543</P> 544<P> 545Either of the functions <b>pcre_compile()</b> or <b>pcre_compile2()</b> can be 546called to compile a pattern into an internal form. The only difference between 547the two interfaces is that <b>pcre_compile2()</b> has an additional argument, 548<i>errorcodeptr</i>, via which a numerical error code can be returned. To avoid 549too much repetition, we refer just to <b>pcre_compile()</b> below, but the 550information applies equally to <b>pcre_compile2()</b>. 551</P> 552<P> 553The pattern is a C string terminated by a binary zero, and is passed in the 554<i>pattern</i> argument. A pointer to a single block of memory that is obtained 555via <b>pcre_malloc</b> is returned. This contains the compiled code and related 556data. The <b>pcre</b> type is defined for the returned block; this is a typedef 557for a structure whose contents are not externally defined. It is up to the 558caller to free the memory (via <b>pcre_free</b>) when it is no longer required. 559</P> 560<P> 561Although the compiled code of a PCRE regex is relocatable, that is, it does not 562depend on memory location, the complete <b>pcre</b> data block is not 563fully relocatable, because it may contain a copy of the <i>tableptr</i> 564argument, which is an address (see below). 565</P> 566<P> 567The <i>options</i> argument contains various bit settings that affect the 568compilation. It should be zero if no options are required. The available 569options are described below. Some of them (in particular, those that are 570compatible with Perl, but some others as well) can also be set and unset from 571within the pattern (see the detailed description in the 572<a href="pcrepattern.html"><b>pcrepattern</b></a> 573documentation). For those options that can be different in different parts of 574the pattern, the contents of the <i>options</i> argument specifies their 575settings at the start of compilation and execution. The PCRE_ANCHORED, 576PCRE_BSR_<i>xxx</i>, PCRE_NEWLINE_<i>xxx</i>, PCRE_NO_UTF8_CHECK, and 577PCRE_NO_START_OPTIMIZE options can be set at the time of matching as well as at 578compile time. 579</P> 580<P> 581If <i>errptr</i> is NULL, <b>pcre_compile()</b> returns NULL immediately. 582Otherwise, if compilation of a pattern fails, <b>pcre_compile()</b> returns 583NULL, and sets the variable pointed to by <i>errptr</i> to point to a textual 584error message. This is a static string that is part of the library. You must 585not try to free it. Normally, the offset from the start of the pattern to the 586data unit that was being processed when the error was discovered is placed in 587the variable pointed to by <i>erroffset</i>, which must not be NULL (if it is, 588an immediate error is given). However, for an invalid UTF-8 or UTF-16 string, 589the offset is that of the first data unit of the failing character. 590</P> 591<P> 592Some errors are not detected until the whole pattern has been scanned; in these 593cases, the offset passed back is the length of the pattern. Note that the 594offset is in data units, not characters, even in a UTF mode. It may sometimes 595point into the middle of a UTF-8 or UTF-16 character. 596</P> 597<P> 598If <b>pcre_compile2()</b> is used instead of <b>pcre_compile()</b>, and the 599<i>errorcodeptr</i> argument is not NULL, a non-zero error code number is 600returned via this argument in the event of an error. This is in addition to the 601textual error message. Error codes and messages are listed below. 602</P> 603<P> 604If the final argument, <i>tableptr</i>, is NULL, PCRE uses a default set of 605character tables that are built when PCRE is compiled, using the default C 606locale. Otherwise, <i>tableptr</i> must be an address that is the result of a 607call to <b>pcre_maketables()</b>. This value is stored with the compiled 608pattern, and used again by <b>pcre_exec()</b> and <b>pcre_dfa_exec()</b> when the 609pattern is matched. For more discussion, see the section on locale support 610below. 611</P> 612<P> 613This code fragment shows a typical straightforward call to <b>pcre_compile()</b>: 614<pre> 615 pcre *re; 616 const char *error; 617 int erroffset; 618 re = pcre_compile( 619 "^A.*Z", /* the pattern */ 620 0, /* default options */ 621 &error, /* for error message */ 622 &erroffset, /* for error offset */ 623 NULL); /* use default character tables */ 624</pre> 625The following names for option bits are defined in the <b>pcre.h</b> header 626file: 627<pre> 628 PCRE_ANCHORED 629</pre> 630If this bit is set, the pattern is forced to be "anchored", that is, it is 631constrained to match only at the first matching point in the string that is 632being searched (the "subject string"). This effect can also be achieved by 633appropriate constructs in the pattern itself, which is the only way to do it in 634Perl. 635<pre> 636 PCRE_AUTO_CALLOUT 637</pre> 638If this bit is set, <b>pcre_compile()</b> automatically inserts callout items, 639all with number 255, before each pattern item. For discussion of the callout 640facility, see the 641<a href="pcrecallout.html"><b>pcrecallout</b></a> 642documentation. 643<pre> 644 PCRE_BSR_ANYCRLF 645 PCRE_BSR_UNICODE 646</pre> 647These options (which are mutually exclusive) control what the \R escape 648sequence matches. The choice is either to match only CR, LF, or CRLF, or to 649match any Unicode newline sequence. The default is specified when PCRE is 650built. It can be overridden from within the pattern, or by setting an option 651when a compiled pattern is matched. 652<pre> 653 PCRE_CASELESS 654</pre> 655If this bit is set, letters in the pattern match both upper and lower case 656letters. It is equivalent to Perl's /i option, and it can be changed within a 657pattern by a (?i) option setting. In UTF-8 mode, PCRE always understands the 658concept of case for characters whose values are less than 128, so caseless 659matching is always possible. For characters with higher values, the concept of 660case is supported if PCRE is compiled with Unicode property support, but not 661otherwise. If you want to use caseless matching for characters 128 and above, 662you must ensure that PCRE is compiled with Unicode property support as well as 663with UTF-8 support. 664<pre> 665 PCRE_DOLLAR_ENDONLY 666</pre> 667If this bit is set, a dollar metacharacter in the pattern matches only at the 668end of the subject string. Without this option, a dollar also matches 669immediately before a newline at the end of the string (but not before any other 670newlines). The PCRE_DOLLAR_ENDONLY option is ignored if PCRE_MULTILINE is set. 671There is no equivalent to this option in Perl, and no way to set it within a 672pattern. 673<pre> 674 PCRE_DOTALL 675</pre> 676If this bit is set, a dot metacharacter in the pattern matches a character of 677any value, including one that indicates a newline. However, it only ever 678matches one character, even if newlines are coded as CRLF. Without this option, 679a dot does not match when the current position is at a newline. This option is 680equivalent to Perl's /s option, and it can be changed within a pattern by a 681(?s) option setting. A negative class such as [^a] always matches newline 682characters, independent of the setting of this option. 683<pre> 684 PCRE_DUPNAMES 685</pre> 686If this bit is set, names used to identify capturing subpatterns need not be 687unique. This can be helpful for certain types of pattern when it is known that 688only one instance of the named subpattern can ever be matched. There are more 689details of named subpatterns below; see also the 690<a href="pcrepattern.html"><b>pcrepattern</b></a> 691documentation. 692<pre> 693 PCRE_EXTENDED 694</pre> 695If this bit is set, most white space characters in the pattern are totally 696ignored except when escaped or inside a character class. However, white space 697is not allowed within sequences such as (?> that introduce various 698parenthesized subpatterns, nor within a numerical quantifier such as {1,3}. 699However, ignorable white space is permitted between an item and a following 700quantifier and between a quantifier and a following + that indicates 701possessiveness. 702</P> 703<P> 704White space did not used to include the VT character (code 11), because Perl 705did not treat this character as white space. However, Perl changed at release 7065.18, so PCRE followed at release 8.34, and VT is now treated as white space. 707</P> 708<P> 709PCRE_EXTENDED also causes characters between an unescaped # outside a character 710class and the next newline, inclusive, to be ignored. PCRE_EXTENDED is 711equivalent to Perl's /x option, and it can be changed within a pattern by a 712(?x) option setting. 713</P> 714<P> 715Which characters are interpreted as newlines is controlled by the options 716passed to <b>pcre_compile()</b> or by a special sequence at the start of the 717pattern, as described in the section entitled 718<a href="pcrepattern.html#newlines">"Newline conventions"</a> 719in the <b>pcrepattern</b> documentation. Note that the end of this type of 720comment is a literal newline sequence in the pattern; escape sequences that 721happen to represent a newline do not count. 722</P> 723<P> 724This option makes it possible to include comments inside complicated patterns. 725Note, however, that this applies only to data characters. White space characters 726may never appear within special character sequences in a pattern, for example 727within the sequence (?( that introduces a conditional subpattern. 728<pre> 729 PCRE_EXTRA 730</pre> 731This option was invented in order to turn on additional functionality of PCRE 732that is incompatible with Perl, but it is currently of very little use. When 733set, any backslash in a pattern that is followed by a letter that has no 734special meaning causes an error, thus reserving these combinations for future 735expansion. By default, as in Perl, a backslash followed by a letter with no 736special meaning is treated as a literal. (Perl can, however, be persuaded to 737give an error for this, by running it with the -w option.) There are at present 738no other features controlled by this option. It can also be set by a (?X) 739option setting within a pattern. 740<pre> 741 PCRE_FIRSTLINE 742</pre> 743If this option is set, an unanchored pattern is required to match before or at 744the first newline in the subject string, though the matched text may continue 745over the newline. 746<pre> 747 PCRE_JAVASCRIPT_COMPAT 748</pre> 749If this option is set, PCRE's behaviour is changed in some ways so that it is 750compatible with JavaScript rather than Perl. The changes are as follows: 751</P> 752<P> 753(1) A lone closing square bracket in a pattern causes a compile-time error, 754because this is illegal in JavaScript (by default it is treated as a data 755character). Thus, the pattern AB]CD becomes illegal when this option is set. 756</P> 757<P> 758(2) At run time, a back reference to an unset subpattern group matches an empty 759string (by default this causes the current matching alternative to fail). A 760pattern such as (\1)(a) succeeds when this option is set (assuming it can find 761an "a" in the subject), whereas it fails by default, for Perl compatibility. 762</P> 763<P> 764(3) \U matches an upper case "U" character; by default \U causes a compile 765time error (Perl uses \U to upper case subsequent characters). 766</P> 767<P> 768(4) \u matches a lower case "u" character unless it is followed by four 769hexadecimal digits, in which case the hexadecimal number defines the code point 770to match. By default, \u causes a compile time error (Perl uses it to upper 771case the following character). 772</P> 773<P> 774(5) \x matches a lower case "x" character unless it is followed by two 775hexadecimal digits, in which case the hexadecimal number defines the code point 776to match. By default, as in Perl, a hexadecimal number is always expected after 777\x, but it may have zero, one, or two digits (so, for example, \xz matches a 778binary zero character followed by z). 779<pre> 780 PCRE_MULTILINE 781</pre> 782By default, for the purposes of matching "start of line" and "end of line", 783PCRE treats the subject string as consisting of a single line of characters, 784even if it actually contains newlines. The "start of line" metacharacter (^) 785matches only at the start of the string, and the "end of line" metacharacter 786($) matches only at the end of the string, or before a terminating newline 787(except when PCRE_DOLLAR_ENDONLY is set). Note, however, that unless 788PCRE_DOTALL is set, the "any character" metacharacter (.) does not match at a 789newline. This behaviour (for ^, $, and dot) is the same as Perl. 790</P> 791<P> 792When PCRE_MULTILINE it is set, the "start of line" and "end of line" constructs 793match immediately following or immediately before internal newlines in the 794subject string, respectively, as well as at the very start and end. This is 795equivalent to Perl's /m option, and it can be changed within a pattern by a 796(?m) option setting. If there are no newlines in a subject string, or no 797occurrences of ^ or $ in a pattern, setting PCRE_MULTILINE has no effect. 798<pre> 799 PCRE_NEVER_UTF 800</pre> 801This option locks out interpretation of the pattern as UTF-8 (or UTF-16 or 802UTF-32 in the 16-bit and 32-bit libraries). In particular, it prevents the 803creator of the pattern from switching to UTF interpretation by starting the 804pattern with (*UTF). This may be useful in applications that process patterns 805from external sources. The combination of PCRE_UTF8 and PCRE_NEVER_UTF also 806causes an error. 807<pre> 808 PCRE_NEWLINE_CR 809 PCRE_NEWLINE_LF 810 PCRE_NEWLINE_CRLF 811 PCRE_NEWLINE_ANYCRLF 812 PCRE_NEWLINE_ANY 813</pre> 814These options override the default newline definition that was chosen when PCRE 815was built. Setting the first or the second specifies that a newline is 816indicated by a single character (CR or LF, respectively). Setting 817PCRE_NEWLINE_CRLF specifies that a newline is indicated by the two-character 818CRLF sequence. Setting PCRE_NEWLINE_ANYCRLF specifies that any of the three 819preceding sequences should be recognized. Setting PCRE_NEWLINE_ANY specifies 820that any Unicode newline sequence should be recognized. 821</P> 822<P> 823In an ASCII/Unicode environment, the Unicode newline sequences are the three 824just mentioned, plus the single characters VT (vertical tab, U+000B), FF (form 825feed, U+000C), NEL (next line, U+0085), LS (line separator, U+2028), and PS 826(paragraph separator, U+2029). For the 8-bit library, the last two are 827recognized only in UTF-8 mode. 828</P> 829<P> 830When PCRE is compiled to run in an EBCDIC (mainframe) environment, the code for 831CR is 0x0d, the same as ASCII. However, the character code for LF is normally 8320x15, though in some EBCDIC environments 0x25 is used. Whichever of these is 833not LF is made to correspond to Unicode's NEL character. EBCDIC codes are all 834less than 256. For more details, see the 835<a href="pcrebuild.html"><b>pcrebuild</b></a> 836documentation. 837</P> 838<P> 839The newline setting in the options word uses three bits that are treated 840as a number, giving eight possibilities. Currently only six are used (default 841plus the five values above). This means that if you set more than one newline 842option, the combination may or may not be sensible. For example, 843PCRE_NEWLINE_CR with PCRE_NEWLINE_LF is equivalent to PCRE_NEWLINE_CRLF, but 844other combinations may yield unused numbers and cause an error. 845</P> 846<P> 847The only time that a line break in a pattern is specially recognized when 848compiling is when PCRE_EXTENDED is set. CR and LF are white space characters, 849and so are ignored in this mode. Also, an unescaped # outside a character class 850indicates a comment that lasts until after the next line break sequence. In 851other circumstances, line break sequences in patterns are treated as literal 852data. 853</P> 854<P> 855The newline option that is set at compile time becomes the default that is used 856for <b>pcre_exec()</b> and <b>pcre_dfa_exec()</b>, but it can be overridden. 857<pre> 858 PCRE_NO_AUTO_CAPTURE 859</pre> 860If this option is set, it disables the use of numbered capturing parentheses in 861the pattern. Any opening parenthesis that is not followed by ? behaves as if it 862were followed by ?: but named parentheses can still be used for capturing (and 863they acquire numbers in the usual way). There is no equivalent of this option 864in Perl. 865<pre> 866 PCRE_NO_AUTO_POSSESS 867</pre> 868If this option is set, it disables "auto-possessification". This is an 869optimization that, for example, turns a+b into a++b in order to avoid 870backtracks into a+ that can never be successful. However, if callouts are in 871use, auto-possessification means that some of them are never taken. You can set 872this option if you want the matching functions to do a full unoptimized search 873and run all the callouts, but it is mainly provided for testing purposes. 874<pre> 875 PCRE_NO_START_OPTIMIZE 876</pre> 877This is an option that acts at matching time; that is, it is really an option 878for <b>pcre_exec()</b> or <b>pcre_dfa_exec()</b>. If it is set at compile time, 879it is remembered with the compiled pattern and assumed at matching time. This 880is necessary if you want to use JIT execution, because the JIT compiler needs 881to know whether or not this option is set. For details see the discussion of 882PCRE_NO_START_OPTIMIZE 883<a href="#execoptions">below.</a> 884<pre> 885 PCRE_UCP 886</pre> 887This option changes the way PCRE processes \B, \b, \D, \d, \S, \s, \W, 888\w, and some of the POSIX character classes. By default, only ASCII characters 889are recognized, but if PCRE_UCP is set, Unicode properties are used instead to 890classify characters. More details are given in the section on 891<a href="pcre.html#genericchartypes">generic character types</a> 892in the 893<a href="pcrepattern.html"><b>pcrepattern</b></a> 894page. If you set PCRE_UCP, matching one of the items it affects takes much 895longer. The option is available only if PCRE has been compiled with Unicode 896property support. 897<pre> 898 PCRE_UNGREEDY 899</pre> 900This option inverts the "greediness" of the quantifiers so that they are not 901greedy by default, but become greedy if followed by "?". It is not compatible 902with Perl. It can also be set by a (?U) option setting within the pattern. 903<pre> 904 PCRE_UTF8 905</pre> 906This option causes PCRE to regard both the pattern and the subject as strings 907of UTF-8 characters instead of single-byte strings. However, it is available 908only when PCRE is built to include UTF support. If not, the use of this option 909provokes an error. Details of how this option changes the behaviour of PCRE are 910given in the 911<a href="pcreunicode.html"><b>pcreunicode</b></a> 912page. 913<pre> 914 PCRE_NO_UTF8_CHECK 915</pre> 916When PCRE_UTF8 is set, the validity of the pattern as a UTF-8 string is 917automatically checked. There is a discussion about the 918<a href="pcreunicode.html#utf8strings">validity of UTF-8 strings</a> 919in the 920<a href="pcreunicode.html"><b>pcreunicode</b></a> 921page. If an invalid UTF-8 sequence is found, <b>pcre_compile()</b> returns an 922error. If you already know that your pattern is valid, and you want to skip 923this check for performance reasons, you can set the PCRE_NO_UTF8_CHECK option. 924When it is set, the effect of passing an invalid UTF-8 string as a pattern is 925undefined. It may cause your program to crash or loop. Note that this option 926can also be passed to <b>pcre_exec()</b> and <b>pcre_dfa_exec()</b>, to suppress 927the validity checking of subject strings only. If the same string is being 928matched many times, the option can be safely set for the second and subsequent 929matchings to improve performance. 930</P> 931<br><a name="SEC12" href="#TOC1">COMPILATION ERROR CODES</a><br> 932<P> 933The following table lists the error codes than may be returned by 934<b>pcre_compile2()</b>, along with the error messages that may be returned by 935both compiling functions. Note that error messages are always 8-bit ASCII 936strings, even in 16-bit or 32-bit mode. As PCRE has developed, some error codes 937have fallen out of use. To avoid confusion, they have not been re-used. 938<pre> 939 0 no error 940 1 \ at end of pattern 941 2 \c at end of pattern 942 3 unrecognized character follows \ 943 4 numbers out of order in {} quantifier 944 5 number too big in {} quantifier 945 6 missing terminating ] for character class 946 7 invalid escape sequence in character class 947 8 range out of order in character class 948 9 nothing to repeat 949 10 [this code is not in use] 950 11 internal error: unexpected repeat 951 12 unrecognized character after (? or (?- 952 13 POSIX named classes are supported only within a class 953 14 missing ) 954 15 reference to non-existent subpattern 955 16 erroffset passed as NULL 956 17 unknown option bit(s) set 957 18 missing ) after comment 958 19 [this code is not in use] 959 20 regular expression is too large 960 21 failed to get memory 961 22 unmatched parentheses 962 23 internal error: code overflow 963 24 unrecognized character after (?< 964 25 lookbehind assertion is not fixed length 965 26 malformed number or name after (?( 966 27 conditional group contains more than two branches 967 28 assertion expected after (?( 968 29 (?R or (?[+-]digits must be followed by ) 969 30 unknown POSIX class name 970 31 POSIX collating elements are not supported 971 32 this version of PCRE is compiled without UTF support 972 33 [this code is not in use] 973 34 character value in \x{} or \o{} is too large 974 35 invalid condition (?(0) 975 36 \C not allowed in lookbehind assertion 976 37 PCRE does not support \L, \l, \N{name}, \U, or \u 977 38 number after (?C is > 255 978 39 closing ) for (?C expected 979 40 recursive call could loop indefinitely 980 41 unrecognized character after (?P 981 42 syntax error in subpattern name (missing terminator) 982 43 two named subpatterns have the same name 983 44 invalid UTF-8 string (specifically UTF-8) 984 45 support for \P, \p, and \X has not been compiled 985 46 malformed \P or \p sequence 986 47 unknown property name after \P or \p 987 48 subpattern name is too long (maximum 32 characters) 988 49 too many named subpatterns (maximum 10000) 989 50 [this code is not in use] 990 51 octal value is greater than \377 in 8-bit non-UTF-8 mode 991 52 internal error: overran compiling workspace 992 53 internal error: previously-checked referenced subpattern 993 not found 994 54 DEFINE group contains more than one branch 995 55 repeating a DEFINE group is not allowed 996 56 inconsistent NEWLINE options 997 57 \g is not followed by a braced, angle-bracketed, or quoted 998 name/number or by a plain number 999 58 a numbered reference must not be zero 1000 59 an argument is not allowed for (*ACCEPT), (*FAIL), or (*COMMIT) 1001 60 (*VERB) not recognized or malformed 1002 61 number is too big 1003 62 subpattern name expected 1004 63 digit expected after (?+ 1005 64 ] is an invalid data character in JavaScript compatibility mode 1006 65 different names for subpatterns of the same number are 1007 not allowed 1008 66 (*MARK) must have an argument 1009 67 this version of PCRE is not compiled with Unicode property 1010 support 1011 68 \c must be followed by an ASCII character 1012 69 \k is not followed by a braced, angle-bracketed, or quoted name 1013 70 internal error: unknown opcode in find_fixedlength() 1014 71 \N is not supported in a class 1015 72 too many forward references 1016 73 disallowed Unicode code point (>= 0xd800 && <= 0xdfff) 1017 74 invalid UTF-16 string (specifically UTF-16) 1018 75 name is too long in (*MARK), (*PRUNE), (*SKIP), or (*THEN) 1019 76 character value in \u.... sequence is too large 1020 77 invalid UTF-32 string (specifically UTF-32) 1021 78 setting UTF is disabled by the application 1022 79 non-hex character in \x{} (closing brace missing?) 1023 80 non-octal character in \o{} (closing brace missing?) 1024 81 missing opening brace after \o 1025 82 parentheses are too deeply nested 1026 83 invalid range in character class 1027 84 group name must start with a non-digit 1028 85 parentheses are too deeply nested (stack check) 1029</pre> 1030The numbers 32 and 10000 in errors 48 and 49 are defaults; different values may 1031be used if the limits were changed when PCRE was built. 1032<a name="studyingapattern"></a></P> 1033<br><a name="SEC13" href="#TOC1">STUDYING A PATTERN</a><br> 1034<P> 1035<b>pcre_extra *pcre_study(const pcre *<i>code</i>, int <i>options</i>,</b> 1036<b> const char **<i>errptr</i>);</b> 1037</P> 1038<P> 1039If a compiled pattern is going to be used several times, it is worth spending 1040more time analyzing it in order to speed up the time taken for matching. The 1041function <b>pcre_study()</b> takes a pointer to a compiled pattern as its first 1042argument. If studying the pattern produces additional information that will 1043help speed up matching, <b>pcre_study()</b> returns a pointer to a 1044<b>pcre_extra</b> block, in which the <i>study_data</i> field points to the 1045results of the study. 1046</P> 1047<P> 1048The returned value from <b>pcre_study()</b> can be passed directly to 1049<b>pcre_exec()</b> or <b>pcre_dfa_exec()</b>. However, a <b>pcre_extra</b> block 1050also contains other fields that can be set by the caller before the block is 1051passed; these are described 1052<a href="#extradata">below</a> 1053in the section on matching a pattern. 1054</P> 1055<P> 1056If studying the pattern does not produce any useful information, 1057<b>pcre_study()</b> returns NULL by default. In that circumstance, if the 1058calling program wants to pass any of the other fields to <b>pcre_exec()</b> or 1059<b>pcre_dfa_exec()</b>, it must set up its own <b>pcre_extra</b> block. However, 1060if <b>pcre_study()</b> is called with the PCRE_STUDY_EXTRA_NEEDED option, it 1061returns a <b>pcre_extra</b> block even if studying did not find any additional 1062information. It may still return NULL, however, if an error occurs in 1063<b>pcre_study()</b>. 1064</P> 1065<P> 1066The second argument of <b>pcre_study()</b> contains option bits. There are three 1067further options in addition to PCRE_STUDY_EXTRA_NEEDED: 1068<pre> 1069 PCRE_STUDY_JIT_COMPILE 1070 PCRE_STUDY_JIT_PARTIAL_HARD_COMPILE 1071 PCRE_STUDY_JIT_PARTIAL_SOFT_COMPILE 1072</pre> 1073If any of these are set, and the just-in-time compiler is available, the 1074pattern is further compiled into machine code that executes much faster than 1075the <b>pcre_exec()</b> interpretive matching function. If the just-in-time 1076compiler is not available, these options are ignored. All undefined bits in the 1077<i>options</i> argument must be zero. 1078</P> 1079<P> 1080JIT compilation is a heavyweight optimization. It can take some time for 1081patterns to be analyzed, and for one-off matches and simple patterns the 1082benefit of faster execution might be offset by a much slower study time. 1083Not all patterns can be optimized by the JIT compiler. For those that cannot be 1084handled, matching automatically falls back to the <b>pcre_exec()</b> 1085interpreter. For more details, see the 1086<a href="pcrejit.html"><b>pcrejit</b></a> 1087documentation. 1088</P> 1089<P> 1090The third argument for <b>pcre_study()</b> is a pointer for an error message. If 1091studying succeeds (even if no data is returned), the variable it points to is 1092set to NULL. Otherwise it is set to point to a textual error message. This is a 1093static string that is part of the library. You must not try to free it. You 1094should test the error pointer for NULL after calling <b>pcre_study()</b>, to be 1095sure that it has run successfully. 1096</P> 1097<P> 1098When you are finished with a pattern, you can free the memory used for the 1099study data by calling <b>pcre_free_study()</b>. This function was added to the 1100API for release 8.20. For earlier versions, the memory could be freed with 1101<b>pcre_free()</b>, just like the pattern itself. This will still work in cases 1102where JIT optimization is not used, but it is advisable to change to the new 1103function when convenient. 1104</P> 1105<P> 1106This is a typical way in which <b>pcre_study</b>() is used (except that in a 1107real application there should be tests for errors): 1108<pre> 1109 int rc; 1110 pcre *re; 1111 pcre_extra *sd; 1112 re = pcre_compile("pattern", 0, &error, &erroroffset, NULL); 1113 sd = pcre_study( 1114 re, /* result of pcre_compile() */ 1115 0, /* no options */ 1116 &error); /* set to NULL or points to a message */ 1117 rc = pcre_exec( /* see below for details of pcre_exec() options */ 1118 re, sd, "subject", 7, 0, 0, ovector, 30); 1119 ... 1120 pcre_free_study(sd); 1121 pcre_free(re); 1122</pre> 1123Studying a pattern does two things: first, a lower bound for the length of 1124subject string that is needed to match the pattern is computed. This does not 1125mean that there are any strings of that length that match, but it does 1126guarantee that no shorter strings match. The value is used to avoid wasting 1127time by trying to match strings that are shorter than the lower bound. You can 1128find out the value in a calling program via the <b>pcre_fullinfo()</b> function. 1129</P> 1130<P> 1131Studying a pattern is also useful for non-anchored patterns that do not have a 1132single fixed starting character. A bitmap of possible starting bytes is 1133created. This speeds up finding a position in the subject at which to start 1134matching. (In 16-bit mode, the bitmap is used for 16-bit values less than 256. 1135In 32-bit mode, the bitmap is used for 32-bit values less than 256.) 1136</P> 1137<P> 1138These two optimizations apply to both <b>pcre_exec()</b> and 1139<b>pcre_dfa_exec()</b>, and the information is also used by the JIT compiler. 1140The optimizations can be disabled by setting the PCRE_NO_START_OPTIMIZE option. 1141You might want to do this if your pattern contains callouts or (*MARK) and you 1142want to make use of these facilities in cases where matching fails. 1143</P> 1144<P> 1145PCRE_NO_START_OPTIMIZE can be specified at either compile time or execution 1146time. However, if PCRE_NO_START_OPTIMIZE is passed to <b>pcre_exec()</b>, (that 1147is, after any JIT compilation has happened) JIT execution is disabled. For JIT 1148execution to work with PCRE_NO_START_OPTIMIZE, the option must be set at 1149compile time. 1150</P> 1151<P> 1152There is a longer discussion of PCRE_NO_START_OPTIMIZE 1153<a href="#execoptions">below.</a> 1154<a name="localesupport"></a></P> 1155<br><a name="SEC14" href="#TOC1">LOCALE SUPPORT</a><br> 1156<P> 1157PCRE handles caseless matching, and determines whether characters are letters, 1158digits, or whatever, by reference to a set of tables, indexed by character 1159code point. When running in UTF-8 mode, or in the 16- or 32-bit libraries, this 1160applies only to characters with code points less than 256. By default, 1161higher-valued code points never match escapes such as \w or \d. However, if 1162PCRE is built with Unicode property support, all characters can be tested with 1163\p and \P, or, alternatively, the PCRE_UCP option can be set when a pattern 1164is compiled; this causes \w and friends to use Unicode property support 1165instead of the built-in tables. 1166</P> 1167<P> 1168The use of locales with Unicode is discouraged. If you are handling characters 1169with code points greater than 128, you should either use Unicode support, or 1170use locales, but not try to mix the two. 1171</P> 1172<P> 1173PCRE contains an internal set of tables that are used when the final argument 1174of <b>pcre_compile()</b> is NULL. These are sufficient for many applications. 1175Normally, the internal tables recognize only ASCII characters. However, when 1176PCRE is built, it is possible to cause the internal tables to be rebuilt in the 1177default "C" locale of the local system, which may cause them to be different. 1178</P> 1179<P> 1180The internal tables can always be overridden by tables supplied by the 1181application that calls PCRE. These may be created in a different locale from 1182the default. As more and more applications change to using Unicode, the need 1183for this locale support is expected to die away. 1184</P> 1185<P> 1186External tables are built by calling the <b>pcre_maketables()</b> function, 1187which has no arguments, in the relevant locale. The result can then be passed 1188to <b>pcre_compile()</b> as often as necessary. For example, to build and use 1189tables that are appropriate for the French locale (where accented characters 1190with values greater than 128 are treated as letters), the following code could 1191be used: 1192<pre> 1193 setlocale(LC_CTYPE, "fr_FR"); 1194 tables = pcre_maketables(); 1195 re = pcre_compile(..., tables); 1196</pre> 1197The locale name "fr_FR" is used on Linux and other Unix-like systems; if you 1198are using Windows, the name for the French locale is "french". 1199</P> 1200<P> 1201When <b>pcre_maketables()</b> runs, the tables are built in memory that is 1202obtained via <b>pcre_malloc</b>. It is the caller's responsibility to ensure 1203that the memory containing the tables remains available for as long as it is 1204needed. 1205</P> 1206<P> 1207The pointer that is passed to <b>pcre_compile()</b> is saved with the compiled 1208pattern, and the same tables are used via this pointer by <b>pcre_study()</b> 1209and also by <b>pcre_exec()</b> and <b>pcre_dfa_exec()</b>. Thus, for any single 1210pattern, compilation, studying and matching all happen in the same locale, but 1211different patterns can be processed in different locales. 1212</P> 1213<P> 1214It is possible to pass a table pointer or NULL (indicating the use of the 1215internal tables) to <b>pcre_exec()</b> or <b>pcre_dfa_exec()</b> (see the 1216discussion below in the section on matching a pattern). This facility is 1217provided for use with pre-compiled patterns that have been saved and reloaded. 1218Character tables are not saved with patterns, so if a non-standard table was 1219used at compile time, it must be provided again when the reloaded pattern is 1220matched. Attempting to use this facility to match a pattern in a different 1221locale from the one in which it was compiled is likely to lead to anomalous 1222(usually incorrect) results. 1223<a name="infoaboutpattern"></a></P> 1224<br><a name="SEC15" href="#TOC1">INFORMATION ABOUT A PATTERN</a><br> 1225<P> 1226<b>int pcre_fullinfo(const pcre *<i>code</i>, const pcre_extra *<i>extra</i>,</b> 1227<b> int <i>what</i>, void *<i>where</i>);</b> 1228</P> 1229<P> 1230The <b>pcre_fullinfo()</b> function returns information about a compiled 1231pattern. It replaces the <b>pcre_info()</b> function, which was removed from the 1232library at version 8.30, after more than 10 years of obsolescence. 1233</P> 1234<P> 1235The first argument for <b>pcre_fullinfo()</b> is a pointer to the compiled 1236pattern. The second argument is the result of <b>pcre_study()</b>, or NULL if 1237the pattern was not studied. The third argument specifies which piece of 1238information is required, and the fourth argument is a pointer to a variable 1239to receive the data. The yield of the function is zero for success, or one of 1240the following negative numbers: 1241<pre> 1242 PCRE_ERROR_NULL the argument <i>code</i> was NULL 1243 the argument <i>where</i> was NULL 1244 PCRE_ERROR_BADMAGIC the "magic number" was not found 1245 PCRE_ERROR_BADENDIANNESS the pattern was compiled with different 1246 endianness 1247 PCRE_ERROR_BADOPTION the value of <i>what</i> was invalid 1248 PCRE_ERROR_UNSET the requested field is not set 1249</pre> 1250The "magic number" is placed at the start of each compiled pattern as an simple 1251check against passing an arbitrary memory pointer. The endianness error can 1252occur if a compiled pattern is saved and reloaded on a different host. Here is 1253a typical call of <b>pcre_fullinfo()</b>, to obtain the length of the compiled 1254pattern: 1255<pre> 1256 int rc; 1257 size_t length; 1258 rc = pcre_fullinfo( 1259 re, /* result of pcre_compile() */ 1260 sd, /* result of pcre_study(), or NULL */ 1261 PCRE_INFO_SIZE, /* what is required */ 1262 &length); /* where to put the data */ 1263</pre> 1264The possible values for the third argument are defined in <b>pcre.h</b>, and are 1265as follows: 1266<pre> 1267 PCRE_INFO_BACKREFMAX 1268</pre> 1269Return the number of the highest back reference in the pattern. The fourth 1270argument should point to an <b>int</b> variable. Zero is returned if there are 1271no back references. 1272<pre> 1273 PCRE_INFO_CAPTURECOUNT 1274</pre> 1275Return the number of capturing subpatterns in the pattern. The fourth argument 1276should point to an <b>int</b> variable. 1277<pre> 1278 PCRE_INFO_DEFAULT_TABLES 1279</pre> 1280Return a pointer to the internal default character tables within PCRE. The 1281fourth argument should point to an <b>unsigned char *</b> variable. This 1282information call is provided for internal use by the <b>pcre_study()</b> 1283function. External callers can cause PCRE to use its internal tables by passing 1284a NULL table pointer. 1285<pre> 1286 PCRE_INFO_FIRSTBYTE (deprecated) 1287</pre> 1288Return information about the first data unit of any matched string, for a 1289non-anchored pattern. The name of this option refers to the 8-bit library, 1290where data units are bytes. The fourth argument should point to an <b>int</b> 1291variable. Negative values are used for special cases. However, this means that 1292when the 32-bit library is in non-UTF-32 mode, the full 32-bit range of 1293characters cannot be returned. For this reason, this value is deprecated; use 1294PCRE_INFO_FIRSTCHARACTERFLAGS and PCRE_INFO_FIRSTCHARACTER instead. 1295</P> 1296<P> 1297If there is a fixed first value, for example, the letter "c" from a pattern 1298such as (cat|cow|coyote), its value is returned. In the 8-bit library, the 1299value is always less than 256. In the 16-bit library the value can be up to 13000xffff. In the 32-bit library the value can be up to 0x10ffff. 1301</P> 1302<P> 1303If there is no fixed first value, and if either 1304<br> 1305<br> 1306(a) the pattern was compiled with the PCRE_MULTILINE option, and every branch 1307starts with "^", or 1308<br> 1309<br> 1310(b) every branch of the pattern starts with ".*" and PCRE_DOTALL is not set 1311(if it were set, the pattern would be anchored), 1312<br> 1313<br> 1314-1 is returned, indicating that the pattern matches only at the start of a 1315subject string or after any newline within the string. Otherwise -2 is 1316returned. For anchored patterns, -2 is returned. 1317<pre> 1318 PCRE_INFO_FIRSTCHARACTER 1319</pre> 1320Return the value of the first data unit (non-UTF character) of any matched 1321string in the situation where PCRE_INFO_FIRSTCHARACTERFLAGS returns 1; 1322otherwise return 0. The fourth argument should point to an <b>uint_t</b> 1323variable. 1324</P> 1325<P> 1326In the 8-bit library, the value is always less than 256. In the 16-bit library 1327the value can be up to 0xffff. In the 32-bit library in UTF-32 mode the value 1328can be up to 0x10ffff, and up to 0xffffffff when not using UTF-32 mode. 1329<pre> 1330 PCRE_INFO_FIRSTCHARACTERFLAGS 1331</pre> 1332Return information about the first data unit of any matched string, for a 1333non-anchored pattern. The fourth argument should point to an <b>int</b> 1334variable. 1335</P> 1336<P> 1337If there is a fixed first value, for example, the letter "c" from a pattern 1338such as (cat|cow|coyote), 1 is returned, and the character value can be 1339retrieved using PCRE_INFO_FIRSTCHARACTER. If there is no fixed first value, and 1340if either 1341<br> 1342<br> 1343(a) the pattern was compiled with the PCRE_MULTILINE option, and every branch 1344starts with "^", or 1345<br> 1346<br> 1347(b) every branch of the pattern starts with ".*" and PCRE_DOTALL is not set 1348(if it were set, the pattern would be anchored), 1349<br> 1350<br> 13512 is returned, indicating that the pattern matches only at the start of a 1352subject string or after any newline within the string. Otherwise 0 is 1353returned. For anchored patterns, 0 is returned. 1354<pre> 1355 PCRE_INFO_FIRSTTABLE 1356</pre> 1357If the pattern was studied, and this resulted in the construction of a 256-bit 1358table indicating a fixed set of values for the first data unit in any matching 1359string, a pointer to the table is returned. Otherwise NULL is returned. The 1360fourth argument should point to an <b>unsigned char *</b> variable. 1361<pre> 1362 PCRE_INFO_HASCRORLF 1363</pre> 1364Return 1 if the pattern contains any explicit matches for CR or LF characters, 1365otherwise 0. The fourth argument should point to an <b>int</b> variable. An 1366explicit match is either a literal CR or LF character, or \r or \n. 1367<pre> 1368 PCRE_INFO_JCHANGED 1369</pre> 1370Return 1 if the (?J) or (?-J) option setting is used in the pattern, otherwise 13710. The fourth argument should point to an <b>int</b> variable. (?J) and 1372(?-J) set and unset the local PCRE_DUPNAMES option, respectively. 1373<pre> 1374 PCRE_INFO_JIT 1375</pre> 1376Return 1 if the pattern was studied with one of the JIT options, and 1377just-in-time compiling was successful. The fourth argument should point to an 1378<b>int</b> variable. A return value of 0 means that JIT support is not available 1379in this version of PCRE, or that the pattern was not studied with a JIT option, 1380or that the JIT compiler could not handle this particular pattern. See the 1381<a href="pcrejit.html"><b>pcrejit</b></a> 1382documentation for details of what can and cannot be handled. 1383<pre> 1384 PCRE_INFO_JITSIZE 1385</pre> 1386If the pattern was successfully studied with a JIT option, return the size of 1387the JIT compiled code, otherwise return zero. The fourth argument should point 1388to a <b>size_t</b> variable. 1389<pre> 1390 PCRE_INFO_LASTLITERAL 1391</pre> 1392Return the value of the rightmost literal data unit that must exist in any 1393matched string, other than at its start, if such a value has been recorded. The 1394fourth argument should point to an <b>int</b> variable. If there is no such 1395value, -1 is returned. For anchored patterns, a last literal value is recorded 1396only if it follows something of variable length. For example, for the pattern 1397/^a\d+z\d+/ the returned value is "z", but for /^a\dz\d/ the returned value 1398is -1. 1399</P> 1400<P> 1401Since for the 32-bit library using the non-UTF-32 mode, this function is unable 1402to return the full 32-bit range of characters, this value is deprecated; 1403instead the PCRE_INFO_REQUIREDCHARFLAGS and PCRE_INFO_REQUIREDCHAR values should 1404be used. 1405<pre> 1406 PCRE_INFO_MATCH_EMPTY 1407</pre> 1408Return 1 if the pattern can match an empty string, otherwise 0. The fourth 1409argument should point to an <b>int</b> variable. 1410<pre> 1411 PCRE_INFO_MATCHLIMIT 1412</pre> 1413If the pattern set a match limit by including an item of the form 1414(*LIMIT_MATCH=nnnn) at the start, the value is returned. The fourth argument 1415should point to an unsigned 32-bit integer. If no such value has been set, the 1416call to <b>pcre_fullinfo()</b> returns the error PCRE_ERROR_UNSET. 1417<pre> 1418 PCRE_INFO_MAXLOOKBEHIND 1419</pre> 1420Return the number of characters (NB not data units) in the longest lookbehind 1421assertion in the pattern. This information is useful when doing multi-segment 1422matching using the partial matching facilities. Note that the simple assertions 1423\b and \B require a one-character lookbehind. \A also registers a 1424one-character lookbehind, though it does not actually inspect the previous 1425character. This is to ensure that at least one character from the old segment 1426is retained when a new segment is processed. Otherwise, if there are no 1427lookbehinds in the pattern, \A might match incorrectly at the start of a new 1428segment. 1429<pre> 1430 PCRE_INFO_MINLENGTH 1431</pre> 1432If the pattern was studied and a minimum length for matching subject strings 1433was computed, its value is returned. Otherwise the returned value is -1. The 1434value is a number of characters, which in UTF mode may be different from the 1435number of data units. The fourth argument should point to an <b>int</b> 1436variable. A non-negative value is a lower bound to the length of any matching 1437string. There may not be any strings of that length that do actually match, but 1438every string that does match is at least that long. 1439<pre> 1440 PCRE_INFO_NAMECOUNT 1441 PCRE_INFO_NAMEENTRYSIZE 1442 PCRE_INFO_NAMETABLE 1443</pre> 1444PCRE supports the use of named as well as numbered capturing parentheses. The 1445names are just an additional way of identifying the parentheses, which still 1446acquire numbers. Several convenience functions such as 1447<b>pcre_get_named_substring()</b> are provided for extracting captured 1448substrings by name. It is also possible to extract the data directly, by first 1449converting the name to a number in order to access the correct pointers in the 1450output vector (described with <b>pcre_exec()</b> below). To do the conversion, 1451you need to use the name-to-number map, which is described by these three 1452values. 1453</P> 1454<P> 1455The map consists of a number of fixed-size entries. PCRE_INFO_NAMECOUNT gives 1456the number of entries, and PCRE_INFO_NAMEENTRYSIZE gives the size of each 1457entry; both of these return an <b>int</b> value. The entry size depends on the 1458length of the longest name. PCRE_INFO_NAMETABLE returns a pointer to the first 1459entry of the table. This is a pointer to <b>char</b> in the 8-bit library, where 1460the first two bytes of each entry are the number of the capturing parenthesis, 1461most significant byte first. In the 16-bit library, the pointer points to 146216-bit data units, the first of which contains the parenthesis number. In the 146332-bit library, the pointer points to 32-bit data units, the first of which 1464contains the parenthesis number. The rest of the entry is the corresponding 1465name, zero terminated. 1466</P> 1467<P> 1468The names are in alphabetical order. If (?| is used to create multiple groups 1469with the same number, as described in the 1470<a href="pcrepattern.html#dupsubpatternnumber">section on duplicate subpattern numbers</a> 1471in the 1472<a href="pcrepattern.html"><b>pcrepattern</b></a> 1473page, the groups may be given the same name, but there is only one entry in the 1474table. Different names for groups of the same number are not permitted. 1475Duplicate names for subpatterns with different numbers are permitted, 1476but only if PCRE_DUPNAMES is set. They appear in the table in the order in 1477which they were found in the pattern. In the absence of (?| this is the order 1478of increasing number; when (?| is used this is not necessarily the case because 1479later subpatterns may have lower numbers. 1480</P> 1481<P> 1482As a simple example of the name/number table, consider the following pattern 1483after compilation by the 8-bit library (assume PCRE_EXTENDED is set, so white 1484space - including newlines - is ignored): 1485<pre> 1486 (?<date> (?<year>(\d\d)?\d\d) - (?<month>\d\d) - (?<day>\d\d) ) 1487</pre> 1488There are four named subpatterns, so the table has four entries, and each entry 1489in the table is eight bytes long. The table is as follows, with non-printing 1490bytes shows in hexadecimal, and undefined bytes shown as ??: 1491<pre> 1492 00 01 d a t e 00 ?? 1493 00 05 d a y 00 ?? ?? 1494 00 04 m o n t h 00 1495 00 02 y e a r 00 ?? 1496</pre> 1497When writing code to extract data from named subpatterns using the 1498name-to-number map, remember that the length of the entries is likely to be 1499different for each compiled pattern. 1500<pre> 1501 PCRE_INFO_OKPARTIAL 1502</pre> 1503Return 1 if the pattern can be used for partial matching with 1504<b>pcre_exec()</b>, otherwise 0. The fourth argument should point to an 1505<b>int</b> variable. From release 8.00, this always returns 1, because the 1506restrictions that previously applied to partial matching have been lifted. The 1507<a href="pcrepartial.html"><b>pcrepartial</b></a> 1508documentation gives details of partial matching. 1509<pre> 1510 PCRE_INFO_OPTIONS 1511</pre> 1512Return a copy of the options with which the pattern was compiled. The fourth 1513argument should point to an <b>unsigned long int</b> variable. These option bits 1514are those specified in the call to <b>pcre_compile()</b>, modified by any 1515top-level option settings at the start of the pattern itself. In other words, 1516they are the options that will be in force when matching starts. For example, 1517if the pattern /(?im)abc(?-i)d/ is compiled with the PCRE_EXTENDED option, the 1518result is PCRE_CASELESS, PCRE_MULTILINE, and PCRE_EXTENDED. 1519</P> 1520<P> 1521A pattern is automatically anchored by PCRE if all of its top-level 1522alternatives begin with one of the following: 1523<pre> 1524 ^ unless PCRE_MULTILINE is set 1525 \A always 1526 \G always 1527 .* if PCRE_DOTALL is set and there are no back references to the subpattern in which .* appears 1528</pre> 1529For such patterns, the PCRE_ANCHORED bit is set in the options returned by 1530<b>pcre_fullinfo()</b>. 1531<pre> 1532 PCRE_INFO_RECURSIONLIMIT 1533</pre> 1534If the pattern set a recursion limit by including an item of the form 1535(*LIMIT_RECURSION=nnnn) at the start, the value is returned. The fourth 1536argument should point to an unsigned 32-bit integer. If no such value has been 1537set, the call to <b>pcre_fullinfo()</b> returns the error PCRE_ERROR_UNSET. 1538<pre> 1539 PCRE_INFO_SIZE 1540</pre> 1541Return the size of the compiled pattern in bytes (for all three libraries). The 1542fourth argument should point to a <b>size_t</b> variable. This value does not 1543include the size of the <b>pcre</b> structure that is returned by 1544<b>pcre_compile()</b>. The value that is passed as the argument to 1545<b>pcre_malloc()</b> when <b>pcre_compile()</b> is getting memory in which to 1546place the compiled data is the value returned by this option plus the size of 1547the <b>pcre</b> structure. Studying a compiled pattern, with or without JIT, 1548does not alter the value returned by this option. 1549<pre> 1550 PCRE_INFO_STUDYSIZE 1551</pre> 1552Return the size in bytes (for all three libraries) of the data block pointed to 1553by the <i>study_data</i> field in a <b>pcre_extra</b> block. If <b>pcre_extra</b> 1554is NULL, or there is no study data, zero is returned. The fourth argument 1555should point to a <b>size_t</b> variable. The <i>study_data</i> field is set by 1556<b>pcre_study()</b> to record information that will speed up matching (see the 1557section entitled 1558<a href="#studyingapattern">"Studying a pattern"</a> 1559above). The format of the <i>study_data</i> block is private, but its length 1560is made available via this option so that it can be saved and restored (see the 1561<a href="pcreprecompile.html"><b>pcreprecompile</b></a> 1562documentation for details). 1563<pre> 1564 PCRE_INFO_REQUIREDCHARFLAGS 1565</pre> 1566Returns 1 if there is a rightmost literal data unit that must exist in any 1567matched string, other than at its start. The fourth argument should point to 1568an <b>int</b> variable. If there is no such value, 0 is returned. If returning 15691, the character value itself can be retrieved using PCRE_INFO_REQUIREDCHAR. 1570</P> 1571<P> 1572For anchored patterns, a last literal value is recorded only if it follows 1573something of variable length. For example, for the pattern /^a\d+z\d+/ the 1574returned value 1 (with "z" returned from PCRE_INFO_REQUIREDCHAR), but for 1575/^a\dz\d/ the returned value is 0. 1576<pre> 1577 PCRE_INFO_REQUIREDCHAR 1578</pre> 1579Return the value of the rightmost literal data unit that must exist in any 1580matched string, other than at its start, if such a value has been recorded. The 1581fourth argument should point to an <b>uint32_t</b> variable. If there is no such 1582value, 0 is returned. 1583</P> 1584<br><a name="SEC16" href="#TOC1">REFERENCE COUNTS</a><br> 1585<P> 1586<b>int pcre_refcount(pcre *<i>code</i>, int <i>adjust</i>);</b> 1587</P> 1588<P> 1589The <b>pcre_refcount()</b> function is used to maintain a reference count in the 1590data block that contains a compiled pattern. It is provided for the benefit of 1591applications that operate in an object-oriented manner, where different parts 1592of the application may be using the same compiled pattern, but you want to free 1593the block when they are all done. 1594</P> 1595<P> 1596When a pattern is compiled, the reference count field is initialized to zero. 1597It is changed only by calling this function, whose action is to add the 1598<i>adjust</i> value (which may be positive or negative) to it. The yield of the 1599function is the new value. However, the value of the count is constrained to 1600lie between 0 and 65535, inclusive. If the new value is outside these limits, 1601it is forced to the appropriate limit value. 1602</P> 1603<P> 1604Except when it is zero, the reference count is not correctly preserved if a 1605pattern is compiled on one host and then transferred to a host whose byte-order 1606is different. (This seems a highly unlikely scenario.) 1607</P> 1608<br><a name="SEC17" href="#TOC1">MATCHING A PATTERN: THE TRADITIONAL FUNCTION</a><br> 1609<P> 1610<b>int pcre_exec(const pcre *<i>code</i>, const pcre_extra *<i>extra</i>,</b> 1611<b> const char *<i>subject</i>, int <i>length</i>, int <i>startoffset</i>,</b> 1612<b> int <i>options</i>, int *<i>ovector</i>, int <i>ovecsize</i>);</b> 1613</P> 1614<P> 1615The function <b>pcre_exec()</b> is called to match a subject string against a 1616compiled pattern, which is passed in the <i>code</i> argument. If the 1617pattern was studied, the result of the study should be passed in the 1618<i>extra</i> argument. You can call <b>pcre_exec()</b> with the same <i>code</i> 1619and <i>extra</i> arguments as many times as you like, in order to match 1620different subject strings with the same pattern. 1621</P> 1622<P> 1623This function is the main matching facility of the library, and it operates in 1624a Perl-like manner. For specialist use there is also an alternative matching 1625function, which is described 1626<a href="#dfamatch">below</a> 1627in the section about the <b>pcre_dfa_exec()</b> function. 1628</P> 1629<P> 1630In most applications, the pattern will have been compiled (and optionally 1631studied) in the same process that calls <b>pcre_exec()</b>. However, it is 1632possible to save compiled patterns and study data, and then use them later 1633in different processes, possibly even on different hosts. For a discussion 1634about this, see the 1635<a href="pcreprecompile.html"><b>pcreprecompile</b></a> 1636documentation. 1637</P> 1638<P> 1639Here is an example of a simple call to <b>pcre_exec()</b>: 1640<pre> 1641 int rc; 1642 int ovector[30]; 1643 rc = pcre_exec( 1644 re, /* result of pcre_compile() */ 1645 NULL, /* we didn't study the pattern */ 1646 "some string", /* the subject string */ 1647 11, /* the length of the subject string */ 1648 0, /* start at offset 0 in the subject */ 1649 0, /* default options */ 1650 ovector, /* vector of integers for substring information */ 1651 30); /* number of elements (NOT size in bytes) */ 1652<a name="extradata"></a></PRE> 1653</P> 1654<br><b> 1655Extra data for <b>pcre_exec()</b> 1656</b><br> 1657<P> 1658If the <i>extra</i> argument is not NULL, it must point to a <b>pcre_extra</b> 1659data block. The <b>pcre_study()</b> function returns such a block (when it 1660doesn't return NULL), but you can also create one for yourself, and pass 1661additional information in it. The <b>pcre_extra</b> block contains the following 1662fields (not necessarily in this order): 1663<pre> 1664 unsigned long int <i>flags</i>; 1665 void *<i>study_data</i>; 1666 void *<i>executable_jit</i>; 1667 unsigned long int <i>match_limit</i>; 1668 unsigned long int <i>match_limit_recursion</i>; 1669 void *<i>callout_data</i>; 1670 const unsigned char *<i>tables</i>; 1671 unsigned char **<i>mark</i>; 1672</pre> 1673In the 16-bit version of this structure, the <i>mark</i> field has type 1674"PCRE_UCHAR16 **". 1675<br> 1676<br> 1677In the 32-bit version of this structure, the <i>mark</i> field has type 1678"PCRE_UCHAR32 **". 1679</P> 1680<P> 1681The <i>flags</i> field is used to specify which of the other fields are set. The 1682flag bits are: 1683<pre> 1684 PCRE_EXTRA_CALLOUT_DATA 1685 PCRE_EXTRA_EXECUTABLE_JIT 1686 PCRE_EXTRA_MARK 1687 PCRE_EXTRA_MATCH_LIMIT 1688 PCRE_EXTRA_MATCH_LIMIT_RECURSION 1689 PCRE_EXTRA_STUDY_DATA 1690 PCRE_EXTRA_TABLES 1691</pre> 1692Other flag bits should be set to zero. The <i>study_data</i> field and sometimes 1693the <i>executable_jit</i> field are set in the <b>pcre_extra</b> block that is 1694returned by <b>pcre_study()</b>, together with the appropriate flag bits. You 1695should not set these yourself, but you may add to the block by setting other 1696fields and their corresponding flag bits. 1697</P> 1698<P> 1699The <i>match_limit</i> field provides a means of preventing PCRE from using up a 1700vast amount of resources when running patterns that are not going to match, 1701but which have a very large number of possibilities in their search trees. The 1702classic example is a pattern that uses nested unlimited repeats. 1703</P> 1704<P> 1705Internally, <b>pcre_exec()</b> uses a function called <b>match()</b>, which it 1706calls repeatedly (sometimes recursively). The limit set by <i>match_limit</i> is 1707imposed on the number of times this function is called during a match, which 1708has the effect of limiting the amount of backtracking that can take place. For 1709patterns that are not anchored, the count restarts from zero for each position 1710in the subject string. 1711</P> 1712<P> 1713When <b>pcre_exec()</b> is called with a pattern that was successfully studied 1714with a JIT option, the way that the matching is executed is entirely different. 1715However, there is still the possibility of runaway matching that goes on for a 1716very long time, and so the <i>match_limit</i> value is also used in this case 1717(but in a different way) to limit how long the matching can continue. 1718</P> 1719<P> 1720The default value for the limit can be set when PCRE is built; the default 1721default is 10 million, which handles all but the most extreme cases. You can 1722override the default by suppling <b>pcre_exec()</b> with a <b>pcre_extra</b> 1723block in which <i>match_limit</i> is set, and PCRE_EXTRA_MATCH_LIMIT is set in 1724the <i>flags</i> field. If the limit is exceeded, <b>pcre_exec()</b> returns 1725PCRE_ERROR_MATCHLIMIT. 1726</P> 1727<P> 1728A value for the match limit may also be supplied by an item at the start of a 1729pattern of the form 1730<pre> 1731 (*LIMIT_MATCH=d) 1732</pre> 1733where d is a decimal number. However, such a setting is ignored unless d is 1734less than the limit set by the caller of <b>pcre_exec()</b> or, if no such limit 1735is set, less than the default. 1736</P> 1737<P> 1738The <i>match_limit_recursion</i> field is similar to <i>match_limit</i>, but 1739instead of limiting the total number of times that <b>match()</b> is called, it 1740limits the depth of recursion. The recursion depth is a smaller number than the 1741total number of calls, because not all calls to <b>match()</b> are recursive. 1742This limit is of use only if it is set smaller than <i>match_limit</i>. 1743</P> 1744<P> 1745Limiting the recursion depth limits the amount of machine stack that can be 1746used, or, when PCRE has been compiled to use memory on the heap instead of the 1747stack, the amount of heap memory that can be used. This limit is not relevant, 1748and is ignored, when matching is done using JIT compiled code. 1749</P> 1750<P> 1751The default value for <i>match_limit_recursion</i> can be set when PCRE is 1752built; the default default is the same value as the default for 1753<i>match_limit</i>. You can override the default by suppling <b>pcre_exec()</b> 1754with a <b>pcre_extra</b> block in which <i>match_limit_recursion</i> is set, and 1755PCRE_EXTRA_MATCH_LIMIT_RECURSION is set in the <i>flags</i> field. If the limit 1756is exceeded, <b>pcre_exec()</b> returns PCRE_ERROR_RECURSIONLIMIT. 1757</P> 1758<P> 1759A value for the recursion limit may also be supplied by an item at the start of 1760a pattern of the form 1761<pre> 1762 (*LIMIT_RECURSION=d) 1763</pre> 1764where d is a decimal number. However, such a setting is ignored unless d is 1765less than the limit set by the caller of <b>pcre_exec()</b> or, if no such limit 1766is set, less than the default. 1767</P> 1768<P> 1769The <i>callout_data</i> field is used in conjunction with the "callout" feature, 1770and is described in the 1771<a href="pcrecallout.html"><b>pcrecallout</b></a> 1772documentation. 1773</P> 1774<P> 1775The <i>tables</i> field is provided for use with patterns that have been 1776pre-compiled using custom character tables, saved to disc or elsewhere, and 1777then reloaded, because the tables that were used to compile a pattern are not 1778saved with it. See the 1779<a href="pcreprecompile.html"><b>pcreprecompile</b></a> 1780documentation for a discussion of saving compiled patterns for later use. If 1781NULL is passed using this mechanism, it forces PCRE's internal tables to be 1782used. 1783</P> 1784<P> 1785<b>Warning:</b> The tables that <b>pcre_exec()</b> uses must be the same as those 1786that were used when the pattern was compiled. If this is not the case, the 1787behaviour of <b>pcre_exec()</b> is undefined. Therefore, when a pattern is 1788compiled and matched in the same process, this field should never be set. In 1789this (the most common) case, the correct table pointer is automatically passed 1790with the compiled pattern from <b>pcre_compile()</b> to <b>pcre_exec()</b>. 1791</P> 1792<P> 1793If PCRE_EXTRA_MARK is set in the <i>flags</i> field, the <i>mark</i> field must 1794be set to point to a suitable variable. If the pattern contains any 1795backtracking control verbs such as (*MARK:NAME), and the execution ends up with 1796a name to pass back, a pointer to the name string (zero terminated) is placed 1797in the variable pointed to by the <i>mark</i> field. The names are within the 1798compiled pattern; if you wish to retain such a name you must copy it before 1799freeing the memory of a compiled pattern. If there is no name to pass back, the 1800variable pointed to by the <i>mark</i> field is set to NULL. For details of the 1801backtracking control verbs, see the section entitled 1802<a href="pcrepattern#backtrackcontrol">"Backtracking control"</a> 1803in the 1804<a href="pcrepattern.html"><b>pcrepattern</b></a> 1805documentation. 1806<a name="execoptions"></a></P> 1807<br><b> 1808Option bits for <b>pcre_exec()</b> 1809</b><br> 1810<P> 1811The unused bits of the <i>options</i> argument for <b>pcre_exec()</b> must be 1812zero. The only bits that may be set are PCRE_ANCHORED, PCRE_NEWLINE_<i>xxx</i>, 1813PCRE_NOTBOL, PCRE_NOTEOL, PCRE_NOTEMPTY, PCRE_NOTEMPTY_ATSTART, 1814PCRE_NO_START_OPTIMIZE, PCRE_NO_UTF8_CHECK, PCRE_PARTIAL_HARD, and 1815PCRE_PARTIAL_SOFT. 1816</P> 1817<P> 1818If the pattern was successfully studied with one of the just-in-time (JIT) 1819compile options, the only supported options for JIT execution are 1820PCRE_NO_UTF8_CHECK, PCRE_NOTBOL, PCRE_NOTEOL, PCRE_NOTEMPTY, 1821PCRE_NOTEMPTY_ATSTART, PCRE_PARTIAL_HARD, and PCRE_PARTIAL_SOFT. If an 1822unsupported option is used, JIT execution is disabled and the normal 1823interpretive code in <b>pcre_exec()</b> is run. 1824<pre> 1825 PCRE_ANCHORED 1826</pre> 1827The PCRE_ANCHORED option limits <b>pcre_exec()</b> to matching at the first 1828matching position. If a pattern was compiled with PCRE_ANCHORED, or turned out 1829to be anchored by virtue of its contents, it cannot be made unachored at 1830matching time. 1831<pre> 1832 PCRE_BSR_ANYCRLF 1833 PCRE_BSR_UNICODE 1834</pre> 1835These options (which are mutually exclusive) control what the \R escape 1836sequence matches. The choice is either to match only CR, LF, or CRLF, or to 1837match any Unicode newline sequence. These options override the choice that was 1838made or defaulted when the pattern was compiled. 1839<pre> 1840 PCRE_NEWLINE_CR 1841 PCRE_NEWLINE_LF 1842 PCRE_NEWLINE_CRLF 1843 PCRE_NEWLINE_ANYCRLF 1844 PCRE_NEWLINE_ANY 1845</pre> 1846These options override the newline definition that was chosen or defaulted when 1847the pattern was compiled. For details, see the description of 1848<b>pcre_compile()</b> above. During matching, the newline choice affects the 1849behaviour of the dot, circumflex, and dollar metacharacters. It may also alter 1850the way the match position is advanced after a match failure for an unanchored 1851pattern. 1852</P> 1853<P> 1854When PCRE_NEWLINE_CRLF, PCRE_NEWLINE_ANYCRLF, or PCRE_NEWLINE_ANY is set, and a 1855match attempt for an unanchored pattern fails when the current position is at a 1856CRLF sequence, and the pattern contains no explicit matches for CR or LF 1857characters, the match position is advanced by two characters instead of one, in 1858other words, to after the CRLF. 1859</P> 1860<P> 1861The above rule is a compromise that makes the most common cases work as 1862expected. For example, if the pattern is .+A (and the PCRE_DOTALL option is not 1863set), it does not match the string "\r\nA" because, after failing at the 1864start, it skips both the CR and the LF before retrying. However, the pattern 1865[\r\n]A does match that string, because it contains an explicit CR or LF 1866reference, and so advances only by one character after the first failure. 1867</P> 1868<P> 1869An explicit match for CR of LF is either a literal appearance of one of those 1870characters, or one of the \r or \n escape sequences. Implicit matches such as 1871[^X] do not count, nor does \s (which includes CR and LF in the characters 1872that it matches). 1873</P> 1874<P> 1875Notwithstanding the above, anomalous effects may still occur when CRLF is a 1876valid newline sequence and explicit \r or \n escapes appear in the pattern. 1877<pre> 1878 PCRE_NOTBOL 1879</pre> 1880This option specifies that first character of the subject string is not the 1881beginning of a line, so the circumflex metacharacter should not match before 1882it. Setting this without PCRE_MULTILINE (at compile time) causes circumflex 1883never to match. This option affects only the behaviour of the circumflex 1884metacharacter. It does not affect \A. 1885<pre> 1886 PCRE_NOTEOL 1887</pre> 1888This option specifies that the end of the subject string is not the end of a 1889line, so the dollar metacharacter should not match it nor (except in multiline 1890mode) a newline immediately before it. Setting this without PCRE_MULTILINE (at 1891compile time) causes dollar never to match. This option affects only the 1892behaviour of the dollar metacharacter. It does not affect \Z or \z. 1893<pre> 1894 PCRE_NOTEMPTY 1895</pre> 1896An empty string is not considered to be a valid match if this option is set. If 1897there are alternatives in the pattern, they are tried. If all the alternatives 1898match the empty string, the entire match fails. For example, if the pattern 1899<pre> 1900 a?b? 1901</pre> 1902is applied to a string not beginning with "a" or "b", it matches an empty 1903string at the start of the subject. With PCRE_NOTEMPTY set, this match is not 1904valid, so PCRE searches further into the string for occurrences of "a" or "b". 1905<pre> 1906 PCRE_NOTEMPTY_ATSTART 1907</pre> 1908This is like PCRE_NOTEMPTY, except that an empty string match that is not at 1909the start of the subject is permitted. If the pattern is anchored, such a match 1910can occur only if the pattern contains \K. 1911</P> 1912<P> 1913Perl has no direct equivalent of PCRE_NOTEMPTY or PCRE_NOTEMPTY_ATSTART, but it 1914does make a special case of a pattern match of the empty string within its 1915<b>split()</b> function, and when using the /g modifier. It is possible to 1916emulate Perl's behaviour after matching a null string by first trying the match 1917again at the same offset with PCRE_NOTEMPTY_ATSTART and PCRE_ANCHORED, and then 1918if that fails, by advancing the starting offset (see below) and trying an 1919ordinary match again. There is some code that demonstrates how to do this in 1920the 1921<a href="pcredemo.html"><b>pcredemo</b></a> 1922sample program. In the most general case, you have to check to see if the 1923newline convention recognizes CRLF as a newline, and if so, and the current 1924character is CR followed by LF, advance the starting offset by two characters 1925instead of one. 1926<pre> 1927 PCRE_NO_START_OPTIMIZE 1928</pre> 1929There are a number of optimizations that <b>pcre_exec()</b> uses at the start of 1930a match, in order to speed up the process. For example, if it is known that an 1931unanchored match must start with a specific character, it searches the subject 1932for that character, and fails immediately if it cannot find it, without 1933actually running the main matching function. This means that a special item 1934such as (*COMMIT) at the start of a pattern is not considered until after a 1935suitable starting point for the match has been found. Also, when callouts or 1936(*MARK) items are in use, these "start-up" optimizations can cause them to be 1937skipped if the pattern is never actually used. The start-up optimizations are 1938in effect a pre-scan of the subject that takes place before the pattern is run. 1939</P> 1940<P> 1941The PCRE_NO_START_OPTIMIZE option disables the start-up optimizations, possibly 1942causing performance to suffer, but ensuring that in cases where the result is 1943"no match", the callouts do occur, and that items such as (*COMMIT) and (*MARK) 1944are considered at every possible starting position in the subject string. If 1945PCRE_NO_START_OPTIMIZE is set at compile time, it cannot be unset at matching 1946time. The use of PCRE_NO_START_OPTIMIZE at matching time (that is, passing it 1947to <b>pcre_exec()</b>) disables JIT execution; in this situation, matching is 1948always done using interpretively. 1949</P> 1950<P> 1951Setting PCRE_NO_START_OPTIMIZE can change the outcome of a matching operation. 1952Consider the pattern 1953<pre> 1954 (*COMMIT)ABC 1955</pre> 1956When this is compiled, PCRE records the fact that a match must start with the 1957character "A". Suppose the subject string is "DEFABC". The start-up 1958optimization scans along the subject, finds "A" and runs the first match 1959attempt from there. The (*COMMIT) item means that the pattern must match the 1960current starting position, which in this case, it does. However, if the same 1961match is run with PCRE_NO_START_OPTIMIZE set, the initial scan along the 1962subject string does not happen. The first match attempt is run starting from 1963"D" and when this fails, (*COMMIT) prevents any further matches being tried, so 1964the overall result is "no match". If the pattern is studied, more start-up 1965optimizations may be used. For example, a minimum length for the subject may be 1966recorded. Consider the pattern 1967<pre> 1968 (*MARK:A)(X|Y) 1969</pre> 1970The minimum length for a match is one character. If the subject is "ABC", there 1971will be attempts to match "ABC", "BC", "C", and then finally an empty string. 1972If the pattern is studied, the final attempt does not take place, because PCRE 1973knows that the subject is too short, and so the (*MARK) is never encountered. 1974In this case, studying the pattern does not affect the overall match result, 1975which is still "no match", but it does affect the auxiliary information that is 1976returned. 1977<pre> 1978 PCRE_NO_UTF8_CHECK 1979</pre> 1980When PCRE_UTF8 is set at compile time, the validity of the subject as a UTF-8 1981string is automatically checked when <b>pcre_exec()</b> is subsequently called. 1982The entire string is checked before any other processing takes place. The value 1983of <i>startoffset</i> is also checked to ensure that it points to the start of a 1984UTF-8 character. There is a discussion about the 1985<a href="pcreunicode.html#utf8strings">validity of UTF-8 strings</a> 1986in the 1987<a href="pcreunicode.html"><b>pcreunicode</b></a> 1988page. If an invalid sequence of bytes is found, <b>pcre_exec()</b> returns the 1989error PCRE_ERROR_BADUTF8 or, if PCRE_PARTIAL_HARD is set and the problem is a 1990truncated character at the end of the subject, PCRE_ERROR_SHORTUTF8. In both 1991cases, information about the precise nature of the error may also be returned 1992(see the descriptions of these errors in the section entitled \fIError return 1993values from\fP <b>pcre_exec()</b> 1994<a href="#errorlist">below).</a> 1995If <i>startoffset</i> contains a value that does not point to the start of a 1996UTF-8 character (or to the end of the subject), PCRE_ERROR_BADUTF8_OFFSET is 1997returned. 1998</P> 1999<P> 2000If you already know that your subject is valid, and you want to skip these 2001checks for performance reasons, you can set the PCRE_NO_UTF8_CHECK option when 2002calling <b>pcre_exec()</b>. You might want to do this for the second and 2003subsequent calls to <b>pcre_exec()</b> if you are making repeated calls to find 2004all the matches in a single subject string. However, you should be sure that 2005the value of <i>startoffset</i> points to the start of a character (or the end 2006of the subject). When PCRE_NO_UTF8_CHECK is set, the effect of passing an 2007invalid string as a subject or an invalid value of <i>startoffset</i> is 2008undefined. Your program may crash or loop. 2009<pre> 2010 PCRE_PARTIAL_HARD 2011 PCRE_PARTIAL_SOFT 2012</pre> 2013These options turn on the partial matching feature. For backwards 2014compatibility, PCRE_PARTIAL is a synonym for PCRE_PARTIAL_SOFT. A partial match 2015occurs if the end of the subject string is reached successfully, but there are 2016not enough subject characters to complete the match. If this happens when 2017PCRE_PARTIAL_SOFT (but not PCRE_PARTIAL_HARD) is set, matching continues by 2018testing any remaining alternatives. Only if no complete match can be found is 2019PCRE_ERROR_PARTIAL returned instead of PCRE_ERROR_NOMATCH. In other words, 2020PCRE_PARTIAL_SOFT says that the caller is prepared to handle a partial match, 2021but only if no complete match can be found. 2022</P> 2023<P> 2024If PCRE_PARTIAL_HARD is set, it overrides PCRE_PARTIAL_SOFT. In this case, if a 2025partial match is found, <b>pcre_exec()</b> immediately returns 2026PCRE_ERROR_PARTIAL, without considering any other alternatives. In other words, 2027when PCRE_PARTIAL_HARD is set, a partial match is considered to be more 2028important that an alternative complete match. 2029</P> 2030<P> 2031In both cases, the portion of the string that was inspected when the partial 2032match was found is set as the first matching string. There is a more detailed 2033discussion of partial and multi-segment matching, with examples, in the 2034<a href="pcrepartial.html"><b>pcrepartial</b></a> 2035documentation. 2036</P> 2037<br><b> 2038The string to be matched by <b>pcre_exec()</b> 2039</b><br> 2040<P> 2041The subject string is passed to <b>pcre_exec()</b> as a pointer in 2042<i>subject</i>, a length in <i>length</i>, and a starting offset in 2043<i>startoffset</i>. The units for <i>length</i> and <i>startoffset</i> are bytes 2044for the 8-bit library, 16-bit data items for the 16-bit library, and 32-bit 2045data items for the 32-bit library. 2046</P> 2047<P> 2048If <i>startoffset</i> is negative or greater than the length of the subject, 2049<b>pcre_exec()</b> returns PCRE_ERROR_BADOFFSET. When the starting offset is 2050zero, the search for a match starts at the beginning of the subject, and this 2051is by far the most common case. In UTF-8 or UTF-16 mode, the offset must point 2052to the start of a character, or the end of the subject (in UTF-32 mode, one 2053data unit equals one character, so all offsets are valid). Unlike the pattern 2054string, the subject may contain binary zeroes. 2055</P> 2056<P> 2057A non-zero starting offset is useful when searching for another match in the 2058same subject by calling <b>pcre_exec()</b> again after a previous success. 2059Setting <i>startoffset</i> differs from just passing over a shortened string and 2060setting PCRE_NOTBOL in the case of a pattern that begins with any kind of 2061lookbehind. For example, consider the pattern 2062<pre> 2063 \Biss\B 2064</pre> 2065which finds occurrences of "iss" in the middle of words. (\B matches only if 2066the current position in the subject is not a word boundary.) When applied to 2067the string "Mississipi" the first call to <b>pcre_exec()</b> finds the first 2068occurrence. If <b>pcre_exec()</b> is called again with just the remainder of the 2069subject, namely "issipi", it does not match, because \B is always false at the 2070start of the subject, which is deemed to be a word boundary. However, if 2071<b>pcre_exec()</b> is passed the entire string again, but with <i>startoffset</i> 2072set to 4, it finds the second occurrence of "iss" because it is able to look 2073behind the starting point to discover that it is preceded by a letter. 2074</P> 2075<P> 2076Finding all the matches in a subject is tricky when the pattern can match an 2077empty string. It is possible to emulate Perl's /g behaviour by first trying the 2078match again at the same offset, with the PCRE_NOTEMPTY_ATSTART and 2079PCRE_ANCHORED options, and then if that fails, advancing the starting offset 2080and trying an ordinary match again. There is some code that demonstrates how to 2081do this in the 2082<a href="pcredemo.html"><b>pcredemo</b></a> 2083sample program. In the most general case, you have to check to see if the 2084newline convention recognizes CRLF as a newline, and if so, and the current 2085character is CR followed by LF, advance the starting offset by two characters 2086instead of one. 2087</P> 2088<P> 2089If a non-zero starting offset is passed when the pattern is anchored, one 2090attempt to match at the given offset is made. This can only succeed if the 2091pattern does not require the match to be at the start of the subject. 2092</P> 2093<br><b> 2094How <b>pcre_exec()</b> returns captured substrings 2095</b><br> 2096<P> 2097In general, a pattern matches a certain portion of the subject, and in 2098addition, further substrings from the subject may be picked out by parts of the 2099pattern. Following the usage in Jeffrey Friedl's book, this is called 2100"capturing" in what follows, and the phrase "capturing subpattern" is used for 2101a fragment of a pattern that picks out a substring. PCRE supports several other 2102kinds of parenthesized subpattern that do not cause substrings to be captured. 2103</P> 2104<P> 2105Captured substrings are returned to the caller via a vector of integers whose 2106address is passed in <i>ovector</i>. The number of elements in the vector is 2107passed in <i>ovecsize</i>, which must be a non-negative number. <b>Note</b>: this 2108argument is NOT the size of <i>ovector</i> in bytes. 2109</P> 2110<P> 2111The first two-thirds of the vector is used to pass back captured substrings, 2112each substring using a pair of integers. The remaining third of the vector is 2113used as workspace by <b>pcre_exec()</b> while matching capturing subpatterns, 2114and is not available for passing back information. The number passed in 2115<i>ovecsize</i> should always be a multiple of three. If it is not, it is 2116rounded down. 2117</P> 2118<P> 2119When a match is successful, information about captured substrings is returned 2120in pairs of integers, starting at the beginning of <i>ovector</i>, and 2121continuing up to two-thirds of its length at the most. The first element of 2122each pair is set to the offset of the first character in a substring, and the 2123second is set to the offset of the first character after the end of a 2124substring. These values are always data unit offsets, even in UTF mode. They 2125are byte offsets in the 8-bit library, 16-bit data item offsets in the 16-bit 2126library, and 32-bit data item offsets in the 32-bit library. <b>Note</b>: they 2127are not character counts. 2128</P> 2129<P> 2130The first pair of integers, <i>ovector[0]</i> and <i>ovector[1]</i>, identify the 2131portion of the subject string matched by the entire pattern. The next pair is 2132used for the first capturing subpattern, and so on. The value returned by 2133<b>pcre_exec()</b> is one more than the highest numbered pair that has been set. 2134For example, if two substrings have been captured, the returned value is 3. If 2135there are no capturing subpatterns, the return value from a successful match is 21361, indicating that just the first pair of offsets has been set. 2137</P> 2138<P> 2139If a capturing subpattern is matched repeatedly, it is the last portion of the 2140string that it matched that is returned. 2141</P> 2142<P> 2143If the vector is too small to hold all the captured substring offsets, it is 2144used as far as possible (up to two-thirds of its length), and the function 2145returns a value of zero. If neither the actual string matched nor any captured 2146substrings are of interest, <b>pcre_exec()</b> may be called with <i>ovector</i> 2147passed as NULL and <i>ovecsize</i> as zero. However, if the pattern contains 2148back references and the <i>ovector</i> is not big enough to remember the related 2149substrings, PCRE has to get additional memory for use during matching. Thus it 2150is usually advisable to supply an <i>ovector</i> of reasonable size. 2151</P> 2152<P> 2153There are some cases where zero is returned (indicating vector overflow) when 2154in fact the vector is exactly the right size for the final match. For example, 2155consider the pattern 2156<pre> 2157 (a)(?:(b)c|bd) 2158</pre> 2159If a vector of 6 elements (allowing for only 1 captured substring) is given 2160with subject string "abd", <b>pcre_exec()</b> will try to set the second 2161captured string, thereby recording a vector overflow, before failing to match 2162"c" and backing up to try the second alternative. The zero return, however, 2163does correctly indicate that the maximum number of slots (namely 2) have been 2164filled. In similar cases where there is temporary overflow, but the final 2165number of used slots is actually less than the maximum, a non-zero value is 2166returned. 2167</P> 2168<P> 2169The <b>pcre_fullinfo()</b> function can be used to find out how many capturing 2170subpatterns there are in a compiled pattern. The smallest size for 2171<i>ovector</i> that will allow for <i>n</i> captured substrings, in addition to 2172the offsets of the substring matched by the whole pattern, is (<i>n</i>+1)*3. 2173</P> 2174<P> 2175It is possible for capturing subpattern number <i>n+1</i> to match some part of 2176the subject when subpattern <i>n</i> has not been used at all. For example, if 2177the string "abc" is matched against the pattern (a|(z))(bc) the return from the 2178function is 4, and subpatterns 1 and 3 are matched, but 2 is not. When this 2179happens, both values in the offset pairs corresponding to unused subpatterns 2180are set to -1. 2181</P> 2182<P> 2183Offset values that correspond to unused subpatterns at the end of the 2184expression are also set to -1. For example, if the string "abc" is matched 2185against the pattern (abc)(x(yz)?)? subpatterns 2 and 3 are not matched. The 2186return from the function is 2, because the highest used capturing subpattern 2187number is 1, and the offsets for for the second and third capturing subpatterns 2188(assuming the vector is large enough, of course) are set to -1. 2189</P> 2190<P> 2191<b>Note</b>: Elements in the first two-thirds of <i>ovector</i> that do not 2192correspond to capturing parentheses in the pattern are never changed. That is, 2193if a pattern contains <i>n</i> capturing parentheses, no more than 2194<i>ovector[0]</i> to <i>ovector[2n+1]</i> are set by <b>pcre_exec()</b>. The other 2195elements (in the first two-thirds) retain whatever values they previously had. 2196</P> 2197<P> 2198Some convenience functions are provided for extracting the captured substrings 2199as separate strings. These are described below. 2200<a name="errorlist"></a></P> 2201<br><b> 2202Error return values from <b>pcre_exec()</b> 2203</b><br> 2204<P> 2205If <b>pcre_exec()</b> fails, it returns a negative number. The following are 2206defined in the header file: 2207<pre> 2208 PCRE_ERROR_NOMATCH (-1) 2209</pre> 2210The subject string did not match the pattern. 2211<pre> 2212 PCRE_ERROR_NULL (-2) 2213</pre> 2214Either <i>code</i> or <i>subject</i> was passed as NULL, or <i>ovector</i> was 2215NULL and <i>ovecsize</i> was not zero. 2216<pre> 2217 PCRE_ERROR_BADOPTION (-3) 2218</pre> 2219An unrecognized bit was set in the <i>options</i> argument. 2220<pre> 2221 PCRE_ERROR_BADMAGIC (-4) 2222</pre> 2223PCRE stores a 4-byte "magic number" at the start of the compiled code, to catch 2224the case when it is passed a junk pointer and to detect when a pattern that was 2225compiled in an environment of one endianness is run in an environment with the 2226other endianness. This is the error that PCRE gives when the magic number is 2227not present. 2228<pre> 2229 PCRE_ERROR_UNKNOWN_OPCODE (-5) 2230</pre> 2231While running the pattern match, an unknown item was encountered in the 2232compiled pattern. This error could be caused by a bug in PCRE or by overwriting 2233of the compiled pattern. 2234<pre> 2235 PCRE_ERROR_NOMEMORY (-6) 2236</pre> 2237If a pattern contains back references, but the <i>ovector</i> that is passed to 2238<b>pcre_exec()</b> is not big enough to remember the referenced substrings, PCRE 2239gets a block of memory at the start of matching to use for this purpose. If the 2240call via <b>pcre_malloc()</b> fails, this error is given. The memory is 2241automatically freed at the end of matching. 2242</P> 2243<P> 2244This error is also given if <b>pcre_stack_malloc()</b> fails in 2245<b>pcre_exec()</b>. This can happen only when PCRE has been compiled with 2246<b>--disable-stack-for-recursion</b>. 2247<pre> 2248 PCRE_ERROR_NOSUBSTRING (-7) 2249</pre> 2250This error is used by the <b>pcre_copy_substring()</b>, 2251<b>pcre_get_substring()</b>, and <b>pcre_get_substring_list()</b> functions (see 2252below). It is never returned by <b>pcre_exec()</b>. 2253<pre> 2254 PCRE_ERROR_MATCHLIMIT (-8) 2255</pre> 2256The backtracking limit, as specified by the <i>match_limit</i> field in a 2257<b>pcre_extra</b> structure (or defaulted) was reached. See the description 2258above. 2259<pre> 2260 PCRE_ERROR_CALLOUT (-9) 2261</pre> 2262This error is never generated by <b>pcre_exec()</b> itself. It is provided for 2263use by callout functions that want to yield a distinctive error code. See the 2264<a href="pcrecallout.html"><b>pcrecallout</b></a> 2265documentation for details. 2266<pre> 2267 PCRE_ERROR_BADUTF8 (-10) 2268</pre> 2269A string that contains an invalid UTF-8 byte sequence was passed as a subject, 2270and the PCRE_NO_UTF8_CHECK option was not set. If the size of the output vector 2271(<i>ovecsize</i>) is at least 2, the byte offset to the start of the the invalid 2272UTF-8 character is placed in the first element, and a reason code is placed in 2273the second element. The reason codes are listed in the 2274<a href="#badutf8reasons">following section.</a> 2275For backward compatibility, if PCRE_PARTIAL_HARD is set and the problem is a 2276truncated UTF-8 character at the end of the subject (reason codes 1 to 5), 2277PCRE_ERROR_SHORTUTF8 is returned instead of PCRE_ERROR_BADUTF8. 2278<pre> 2279 PCRE_ERROR_BADUTF8_OFFSET (-11) 2280</pre> 2281The UTF-8 byte sequence that was passed as a subject was checked and found to 2282be valid (the PCRE_NO_UTF8_CHECK option was not set), but the value of 2283<i>startoffset</i> did not point to the beginning of a UTF-8 character or the 2284end of the subject. 2285<pre> 2286 PCRE_ERROR_PARTIAL (-12) 2287</pre> 2288The subject string did not match, but it did match partially. See the 2289<a href="pcrepartial.html"><b>pcrepartial</b></a> 2290documentation for details of partial matching. 2291<pre> 2292 PCRE_ERROR_BADPARTIAL (-13) 2293</pre> 2294This code is no longer in use. It was formerly returned when the PCRE_PARTIAL 2295option was used with a compiled pattern containing items that were not 2296supported for partial matching. From release 8.00 onwards, there are no 2297restrictions on partial matching. 2298<pre> 2299 PCRE_ERROR_INTERNAL (-14) 2300</pre> 2301An unexpected internal error has occurred. This error could be caused by a bug 2302in PCRE or by overwriting of the compiled pattern. 2303<pre> 2304 PCRE_ERROR_BADCOUNT (-15) 2305</pre> 2306This error is given if the value of the <i>ovecsize</i> argument is negative. 2307<pre> 2308 PCRE_ERROR_RECURSIONLIMIT (-21) 2309</pre> 2310The internal recursion limit, as specified by the <i>match_limit_recursion</i> 2311field in a <b>pcre_extra</b> structure (or defaulted) was reached. See the 2312description above. 2313<pre> 2314 PCRE_ERROR_BADNEWLINE (-23) 2315</pre> 2316An invalid combination of PCRE_NEWLINE_<i>xxx</i> options was given. 2317<pre> 2318 PCRE_ERROR_BADOFFSET (-24) 2319</pre> 2320The value of <i>startoffset</i> was negative or greater than the length of the 2321subject, that is, the value in <i>length</i>. 2322<pre> 2323 PCRE_ERROR_SHORTUTF8 (-25) 2324</pre> 2325This error is returned instead of PCRE_ERROR_BADUTF8 when the subject string 2326ends with a truncated UTF-8 character and the PCRE_PARTIAL_HARD option is set. 2327Information about the failure is returned as for PCRE_ERROR_BADUTF8. It is in 2328fact sufficient to detect this case, but this special error code for 2329PCRE_PARTIAL_HARD precedes the implementation of returned information; it is 2330retained for backwards compatibility. 2331<pre> 2332 PCRE_ERROR_RECURSELOOP (-26) 2333</pre> 2334This error is returned when <b>pcre_exec()</b> detects a recursion loop within 2335the pattern. Specifically, it means that either the whole pattern or a 2336subpattern has been called recursively for the second time at the same position 2337in the subject string. Some simple patterns that might do this are detected and 2338faulted at compile time, but more complicated cases, in particular mutual 2339recursions between two different subpatterns, cannot be detected until run 2340time. 2341<pre> 2342 PCRE_ERROR_JIT_STACKLIMIT (-27) 2343</pre> 2344This error is returned when a pattern that was successfully studied using a 2345JIT compile option is being matched, but the memory available for the 2346just-in-time processing stack is not large enough. See the 2347<a href="pcrejit.html"><b>pcrejit</b></a> 2348documentation for more details. 2349<pre> 2350 PCRE_ERROR_BADMODE (-28) 2351</pre> 2352This error is given if a pattern that was compiled by the 8-bit library is 2353passed to a 16-bit or 32-bit library function, or vice versa. 2354<pre> 2355 PCRE_ERROR_BADENDIANNESS (-29) 2356</pre> 2357This error is given if a pattern that was compiled and saved is reloaded on a 2358host with different endianness. The utility function 2359<b>pcre_pattern_to_host_byte_order()</b> can be used to convert such a pattern 2360so that it runs on the new host. 2361<pre> 2362 PCRE_ERROR_JIT_BADOPTION 2363</pre> 2364This error is returned when a pattern that was successfully studied using a JIT 2365compile option is being matched, but the matching mode (partial or complete 2366match) does not correspond to any JIT compilation mode. When the JIT fast path 2367function is used, this error may be also given for invalid options. See the 2368<a href="pcrejit.html"><b>pcrejit</b></a> 2369documentation for more details. 2370<pre> 2371 PCRE_ERROR_BADLENGTH (-32) 2372</pre> 2373This error is given if <b>pcre_exec()</b> is called with a negative value for 2374the <i>length</i> argument. 2375</P> 2376<P> 2377Error numbers -16 to -20, -22, and 30 are not used by <b>pcre_exec()</b>. 2378<a name="badutf8reasons"></a></P> 2379<br><b> 2380Reason codes for invalid UTF-8 strings 2381</b><br> 2382<P> 2383This section applies only to the 8-bit library. The corresponding information 2384for the 16-bit and 32-bit libraries is given in the 2385<a href="pcre16.html"><b>pcre16</b></a> 2386and 2387<a href="pcre32.html"><b>pcre32</b></a> 2388pages. 2389</P> 2390<P> 2391When <b>pcre_exec()</b> returns either PCRE_ERROR_BADUTF8 or 2392PCRE_ERROR_SHORTUTF8, and the size of the output vector (<i>ovecsize</i>) is at 2393least 2, the offset of the start of the invalid UTF-8 character is placed in 2394the first output vector element (<i>ovector[0]</i>) and a reason code is placed 2395in the second element (<i>ovector[1]</i>). The reason codes are given names in 2396the <b>pcre.h</b> header file: 2397<pre> 2398 PCRE_UTF8_ERR1 2399 PCRE_UTF8_ERR2 2400 PCRE_UTF8_ERR3 2401 PCRE_UTF8_ERR4 2402 PCRE_UTF8_ERR5 2403</pre> 2404The string ends with a truncated UTF-8 character; the code specifies how many 2405bytes are missing (1 to 5). Although RFC 3629 restricts UTF-8 characters to be 2406no longer than 4 bytes, the encoding scheme (originally defined by RFC 2279) 2407allows for up to 6 bytes, and this is checked first; hence the possibility of 24084 or 5 missing bytes. 2409<pre> 2410 PCRE_UTF8_ERR6 2411 PCRE_UTF8_ERR7 2412 PCRE_UTF8_ERR8 2413 PCRE_UTF8_ERR9 2414 PCRE_UTF8_ERR10 2415</pre> 2416The two most significant bits of the 2nd, 3rd, 4th, 5th, or 6th byte of the 2417character do not have the binary value 0b10 (that is, either the most 2418significant bit is 0, or the next bit is 1). 2419<pre> 2420 PCRE_UTF8_ERR11 2421 PCRE_UTF8_ERR12 2422</pre> 2423A character that is valid by the RFC 2279 rules is either 5 or 6 bytes long; 2424these code points are excluded by RFC 3629. 2425<pre> 2426 PCRE_UTF8_ERR13 2427</pre> 2428A 4-byte character has a value greater than 0x10fff; these code points are 2429excluded by RFC 3629. 2430<pre> 2431 PCRE_UTF8_ERR14 2432</pre> 2433A 3-byte character has a value in the range 0xd800 to 0xdfff; this range of 2434code points are reserved by RFC 3629 for use with UTF-16, and so are excluded 2435from UTF-8. 2436<pre> 2437 PCRE_UTF8_ERR15 2438 PCRE_UTF8_ERR16 2439 PCRE_UTF8_ERR17 2440 PCRE_UTF8_ERR18 2441 PCRE_UTF8_ERR19 2442</pre> 2443A 2-, 3-, 4-, 5-, or 6-byte character is "overlong", that is, it codes for a 2444value that can be represented by fewer bytes, which is invalid. For example, 2445the two bytes 0xc0, 0xae give the value 0x2e, whose correct coding uses just 2446one byte. 2447<pre> 2448 PCRE_UTF8_ERR20 2449</pre> 2450The two most significant bits of the first byte of a character have the binary 2451value 0b10 (that is, the most significant bit is 1 and the second is 0). Such a 2452byte can only validly occur as the second or subsequent byte of a multi-byte 2453character. 2454<pre> 2455 PCRE_UTF8_ERR21 2456</pre> 2457The first byte of a character has the value 0xfe or 0xff. These values can 2458never occur in a valid UTF-8 string. 2459<pre> 2460 PCRE_UTF8_ERR22 2461</pre> 2462This error code was formerly used when the presence of a so-called 2463"non-character" caused an error. Unicode corrigendum #9 makes it clear that 2464such characters should not cause a string to be rejected, and so this code is 2465no longer in use and is never returned. 2466</P> 2467<br><a name="SEC18" href="#TOC1">EXTRACTING CAPTURED SUBSTRINGS BY NUMBER</a><br> 2468<P> 2469<b>int pcre_copy_substring(const char *<i>subject</i>, int *<i>ovector</i>,</b> 2470<b> int <i>stringcount</i>, int <i>stringnumber</i>, char *<i>buffer</i>,</b> 2471<b> int <i>buffersize</i>);</b> 2472<br> 2473<br> 2474<b>int pcre_get_substring(const char *<i>subject</i>, int *<i>ovector</i>,</b> 2475<b> int <i>stringcount</i>, int <i>stringnumber</i>,</b> 2476<b> const char **<i>stringptr</i>);</b> 2477<br> 2478<br> 2479<b>int pcre_get_substring_list(const char *<i>subject</i>,</b> 2480<b> int *<i>ovector</i>, int <i>stringcount</i>, const char ***<i>listptr</i>);</b> 2481</P> 2482<P> 2483Captured substrings can be accessed directly by using the offsets returned by 2484<b>pcre_exec()</b> in <i>ovector</i>. For convenience, the functions 2485<b>pcre_copy_substring()</b>, <b>pcre_get_substring()</b>, and 2486<b>pcre_get_substring_list()</b> are provided for extracting captured substrings 2487as new, separate, zero-terminated strings. These functions identify substrings 2488by number. The next section describes functions for extracting named 2489substrings. 2490</P> 2491<P> 2492A substring that contains a binary zero is correctly extracted and has a 2493further zero added on the end, but the result is not, of course, a C string. 2494However, you can process such a string by referring to the length that is 2495returned by <b>pcre_copy_substring()</b> and <b>pcre_get_substring()</b>. 2496Unfortunately, the interface to <b>pcre_get_substring_list()</b> is not adequate 2497for handling strings containing binary zeros, because the end of the final 2498string is not independently indicated. 2499</P> 2500<P> 2501The first three arguments are the same for all three of these functions: 2502<i>subject</i> is the subject string that has just been successfully matched, 2503<i>ovector</i> is a pointer to the vector of integer offsets that was passed to 2504<b>pcre_exec()</b>, and <i>stringcount</i> is the number of substrings that were 2505captured by the match, including the substring that matched the entire regular 2506expression. This is the value returned by <b>pcre_exec()</b> if it is greater 2507than zero. If <b>pcre_exec()</b> returned zero, indicating that it ran out of 2508space in <i>ovector</i>, the value passed as <i>stringcount</i> should be the 2509number of elements in the vector divided by three. 2510</P> 2511<P> 2512The functions <b>pcre_copy_substring()</b> and <b>pcre_get_substring()</b> 2513extract a single substring, whose number is given as <i>stringnumber</i>. A 2514value of zero extracts the substring that matched the entire pattern, whereas 2515higher values extract the captured substrings. For <b>pcre_copy_substring()</b>, 2516the string is placed in <i>buffer</i>, whose length is given by 2517<i>buffersize</i>, while for <b>pcre_get_substring()</b> a new block of memory is 2518obtained via <b>pcre_malloc</b>, and its address is returned via 2519<i>stringptr</i>. The yield of the function is the length of the string, not 2520including the terminating zero, or one of these error codes: 2521<pre> 2522 PCRE_ERROR_NOMEMORY (-6) 2523</pre> 2524The buffer was too small for <b>pcre_copy_substring()</b>, or the attempt to get 2525memory failed for <b>pcre_get_substring()</b>. 2526<pre> 2527 PCRE_ERROR_NOSUBSTRING (-7) 2528</pre> 2529There is no substring whose number is <i>stringnumber</i>. 2530</P> 2531<P> 2532The <b>pcre_get_substring_list()</b> function extracts all available substrings 2533and builds a list of pointers to them. All this is done in a single block of 2534memory that is obtained via <b>pcre_malloc</b>. The address of the memory block 2535is returned via <i>listptr</i>, which is also the start of the list of string 2536pointers. The end of the list is marked by a NULL pointer. The yield of the 2537function is zero if all went well, or the error code 2538<pre> 2539 PCRE_ERROR_NOMEMORY (-6) 2540</pre> 2541if the attempt to get the memory block failed. 2542</P> 2543<P> 2544When any of these functions encounter a substring that is unset, which can 2545happen when capturing subpattern number <i>n+1</i> matches some part of the 2546subject, but subpattern <i>n</i> has not been used at all, they return an empty 2547string. This can be distinguished from a genuine zero-length substring by 2548inspecting the appropriate offset in <i>ovector</i>, which is negative for unset 2549substrings. 2550</P> 2551<P> 2552The two convenience functions <b>pcre_free_substring()</b> and 2553<b>pcre_free_substring_list()</b> can be used to free the memory returned by 2554a previous call of <b>pcre_get_substring()</b> or 2555<b>pcre_get_substring_list()</b>, respectively. They do nothing more than call 2556the function pointed to by <b>pcre_free</b>, which of course could be called 2557directly from a C program. However, PCRE is used in some situations where it is 2558linked via a special interface to another programming language that cannot use 2559<b>pcre_free</b> directly; it is for these cases that the functions are 2560provided. 2561</P> 2562<br><a name="SEC19" href="#TOC1">EXTRACTING CAPTURED SUBSTRINGS BY NAME</a><br> 2563<P> 2564<b>int pcre_get_stringnumber(const pcre *<i>code</i>,</b> 2565<b> const char *<i>name</i>);</b> 2566<br> 2567<br> 2568<b>int pcre_copy_named_substring(const pcre *<i>code</i>,</b> 2569<b> const char *<i>subject</i>, int *<i>ovector</i>,</b> 2570<b> int <i>stringcount</i>, const char *<i>stringname</i>,</b> 2571<b> char *<i>buffer</i>, int <i>buffersize</i>);</b> 2572<br> 2573<br> 2574<b>int pcre_get_named_substring(const pcre *<i>code</i>,</b> 2575<b> const char *<i>subject</i>, int *<i>ovector</i>,</b> 2576<b> int <i>stringcount</i>, const char *<i>stringname</i>,</b> 2577<b> const char **<i>stringptr</i>);</b> 2578</P> 2579<P> 2580To extract a substring by name, you first have to find associated number. 2581For example, for this pattern 2582<pre> 2583 (a+)b(?<xxx>\d+)... 2584</pre> 2585the number of the subpattern called "xxx" is 2. If the name is known to be 2586unique (PCRE_DUPNAMES was not set), you can find the number from the name by 2587calling <b>pcre_get_stringnumber()</b>. The first argument is the compiled 2588pattern, and the second is the name. The yield of the function is the 2589subpattern number, or PCRE_ERROR_NOSUBSTRING (-7) if there is no subpattern of 2590that name. 2591</P> 2592<P> 2593Given the number, you can extract the substring directly, or use one of the 2594functions described in the previous section. For convenience, there are also 2595two functions that do the whole job. 2596</P> 2597<P> 2598Most of the arguments of <b>pcre_copy_named_substring()</b> and 2599<b>pcre_get_named_substring()</b> are the same as those for the similarly named 2600functions that extract by number. As these are described in the previous 2601section, they are not re-described here. There are just two differences: 2602</P> 2603<P> 2604First, instead of a substring number, a substring name is given. Second, there 2605is an extra argument, given at the start, which is a pointer to the compiled 2606pattern. This is needed in order to gain access to the name-to-number 2607translation table. 2608</P> 2609<P> 2610These functions call <b>pcre_get_stringnumber()</b>, and if it succeeds, they 2611then call <b>pcre_copy_substring()</b> or <b>pcre_get_substring()</b>, as 2612appropriate. <b>NOTE:</b> If PCRE_DUPNAMES is set and there are duplicate names, 2613the behaviour may not be what you want (see the next section). 2614</P> 2615<P> 2616<b>Warning:</b> If the pattern uses the (?| feature to set up multiple 2617subpatterns with the same number, as described in the 2618<a href="pcrepattern.html#dupsubpatternnumber">section on duplicate subpattern numbers</a> 2619in the 2620<a href="pcrepattern.html"><b>pcrepattern</b></a> 2621page, you cannot use names to distinguish the different subpatterns, because 2622names are not included in the compiled code. The matching process uses only 2623numbers. For this reason, the use of different names for subpatterns of the 2624same number causes an error at compile time. 2625</P> 2626<br><a name="SEC20" href="#TOC1">DUPLICATE SUBPATTERN NAMES</a><br> 2627<P> 2628<b>int pcre_get_stringtable_entries(const pcre *<i>code</i>,</b> 2629<b> const char *<i>name</i>, char **<i>first</i>, char **<i>last</i>);</b> 2630</P> 2631<P> 2632When a pattern is compiled with the PCRE_DUPNAMES option, names for subpatterns 2633are not required to be unique. (Duplicate names are always allowed for 2634subpatterns with the same number, created by using the (?| feature. Indeed, if 2635such subpatterns are named, they are required to use the same names.) 2636</P> 2637<P> 2638Normally, patterns with duplicate names are such that in any one match, only 2639one of the named subpatterns participates. An example is shown in the 2640<a href="pcrepattern.html"><b>pcrepattern</b></a> 2641documentation. 2642</P> 2643<P> 2644When duplicates are present, <b>pcre_copy_named_substring()</b> and 2645<b>pcre_get_named_substring()</b> return the first substring corresponding to 2646the given name that is set. If none are set, PCRE_ERROR_NOSUBSTRING (-7) is 2647returned; no data is returned. The <b>pcre_get_stringnumber()</b> function 2648returns one of the numbers that are associated with the name, but it is not 2649defined which it is. 2650</P> 2651<P> 2652If you want to get full details of all captured substrings for a given name, 2653you must use the <b>pcre_get_stringtable_entries()</b> function. The first 2654argument is the compiled pattern, and the second is the name. The third and 2655fourth are pointers to variables which are updated by the function. After it 2656has run, they point to the first and last entries in the name-to-number table 2657for the given name. The function itself returns the length of each entry, or 2658PCRE_ERROR_NOSUBSTRING (-7) if there are none. The format of the table is 2659described above in the section entitled <i>Information about a pattern</i> 2660<a href="#infoaboutpattern">above.</a> 2661Given all the relevant entries for the name, you can extract each of their 2662numbers, and hence the captured data, if any. 2663</P> 2664<br><a name="SEC21" href="#TOC1">FINDING ALL POSSIBLE MATCHES</a><br> 2665<P> 2666The traditional matching function uses a similar algorithm to Perl, which stops 2667when it finds the first match, starting at a given point in the subject. If you 2668want to find all possible matches, or the longest possible match, consider 2669using the alternative matching function (see below) instead. If you cannot use 2670the alternative function, but still need to find all possible matches, you 2671can kludge it up by making use of the callout facility, which is described in 2672the 2673<a href="pcrecallout.html"><b>pcrecallout</b></a> 2674documentation. 2675</P> 2676<P> 2677What you have to do is to insert a callout right at the end of the pattern. 2678When your callout function is called, extract and save the current matched 2679substring. Then return 1, which forces <b>pcre_exec()</b> to backtrack and try 2680other alternatives. Ultimately, when it runs out of matches, <b>pcre_exec()</b> 2681will yield PCRE_ERROR_NOMATCH. 2682</P> 2683<br><a name="SEC22" href="#TOC1">OBTAINING AN ESTIMATE OF STACK USAGE</a><br> 2684<P> 2685Matching certain patterns using <b>pcre_exec()</b> can use a lot of process 2686stack, which in certain environments can be rather limited in size. Some users 2687find it helpful to have an estimate of the amount of stack that is used by 2688<b>pcre_exec()</b>, to help them set recursion limits, as described in the 2689<a href="pcrestack.html"><b>pcrestack</b></a> 2690documentation. The estimate that is output by <b>pcretest</b> when called with 2691the <b>-m</b> and <b>-C</b> options is obtained by calling <b>pcre_exec</b> with 2692the values NULL, NULL, NULL, -999, and -999 for its first five arguments. 2693</P> 2694<P> 2695Normally, if its first argument is NULL, <b>pcre_exec()</b> immediately returns 2696the negative error code PCRE_ERROR_NULL, but with this special combination of 2697arguments, it returns instead a negative number whose absolute value is the 2698approximate stack frame size in bytes. (A negative number is used so that it is 2699clear that no match has happened.) The value is approximate because in some 2700cases, recursive calls to <b>pcre_exec()</b> occur when there are one or two 2701additional variables on the stack. 2702</P> 2703<P> 2704If PCRE has been compiled to use the heap instead of the stack for recursion, 2705the value returned is the size of each block that is obtained from the heap. 2706<a name="dfamatch"></a></P> 2707<br><a name="SEC23" href="#TOC1">MATCHING A PATTERN: THE ALTERNATIVE FUNCTION</a><br> 2708<P> 2709<b>int pcre_dfa_exec(const pcre *<i>code</i>, const pcre_extra *<i>extra</i>,</b> 2710<b> const char *<i>subject</i>, int <i>length</i>, int <i>startoffset</i>,</b> 2711<b> int <i>options</i>, int *<i>ovector</i>, int <i>ovecsize</i>,</b> 2712<b> int *<i>workspace</i>, int <i>wscount</i>);</b> 2713</P> 2714<P> 2715The function <b>pcre_dfa_exec()</b> is called to match a subject string against 2716a compiled pattern, using a matching algorithm that scans the subject string 2717just once, and does not backtrack. This has different characteristics to the 2718normal algorithm, and is not compatible with Perl. Some of the features of PCRE 2719patterns are not supported. Nevertheless, there are times when this kind of 2720matching can be useful. For a discussion of the two matching algorithms, and a 2721list of features that <b>pcre_dfa_exec()</b> does not support, see the 2722<a href="pcrematching.html"><b>pcrematching</b></a> 2723documentation. 2724</P> 2725<P> 2726The arguments for the <b>pcre_dfa_exec()</b> function are the same as for 2727<b>pcre_exec()</b>, plus two extras. The <i>ovector</i> argument is used in a 2728different way, and this is described below. The other common arguments are used 2729in the same way as for <b>pcre_exec()</b>, so their description is not repeated 2730here. 2731</P> 2732<P> 2733The two additional arguments provide workspace for the function. The workspace 2734vector should contain at least 20 elements. It is used for keeping track of 2735multiple paths through the pattern tree. More workspace will be needed for 2736patterns and subjects where there are a lot of potential matches. 2737</P> 2738<P> 2739Here is an example of a simple call to <b>pcre_dfa_exec()</b>: 2740<pre> 2741 int rc; 2742 int ovector[10]; 2743 int wspace[20]; 2744 rc = pcre_dfa_exec( 2745 re, /* result of pcre_compile() */ 2746 NULL, /* we didn't study the pattern */ 2747 "some string", /* the subject string */ 2748 11, /* the length of the subject string */ 2749 0, /* start at offset 0 in the subject */ 2750 0, /* default options */ 2751 ovector, /* vector of integers for substring information */ 2752 10, /* number of elements (NOT size in bytes) */ 2753 wspace, /* working space vector */ 2754 20); /* number of elements (NOT size in bytes) */ 2755</PRE> 2756</P> 2757<br><b> 2758Option bits for <b>pcre_dfa_exec()</b> 2759</b><br> 2760<P> 2761The unused bits of the <i>options</i> argument for <b>pcre_dfa_exec()</b> must be 2762zero. The only bits that may be set are PCRE_ANCHORED, PCRE_NEWLINE_<i>xxx</i>, 2763PCRE_NOTBOL, PCRE_NOTEOL, PCRE_NOTEMPTY, PCRE_NOTEMPTY_ATSTART, 2764PCRE_NO_UTF8_CHECK, PCRE_BSR_ANYCRLF, PCRE_BSR_UNICODE, PCRE_NO_START_OPTIMIZE, 2765PCRE_PARTIAL_HARD, PCRE_PARTIAL_SOFT, PCRE_DFA_SHORTEST, and PCRE_DFA_RESTART. 2766All but the last four of these are exactly the same as for <b>pcre_exec()</b>, 2767so their description is not repeated here. 2768<pre> 2769 PCRE_PARTIAL_HARD 2770 PCRE_PARTIAL_SOFT 2771</pre> 2772These have the same general effect as they do for <b>pcre_exec()</b>, but the 2773details are slightly different. When PCRE_PARTIAL_HARD is set for 2774<b>pcre_dfa_exec()</b>, it returns PCRE_ERROR_PARTIAL if the end of the subject 2775is reached and there is still at least one matching possibility that requires 2776additional characters. This happens even if some complete matches have also 2777been found. When PCRE_PARTIAL_SOFT is set, the return code PCRE_ERROR_NOMATCH 2778is converted into PCRE_ERROR_PARTIAL if the end of the subject is reached, 2779there have been no complete matches, but there is still at least one matching 2780possibility. The portion of the string that was inspected when the longest 2781partial match was found is set as the first matching string in both cases. 2782There is a more detailed discussion of partial and multi-segment matching, with 2783examples, in the 2784<a href="pcrepartial.html"><b>pcrepartial</b></a> 2785documentation. 2786<pre> 2787 PCRE_DFA_SHORTEST 2788</pre> 2789Setting the PCRE_DFA_SHORTEST option causes the matching algorithm to stop as 2790soon as it has found one match. Because of the way the alternative algorithm 2791works, this is necessarily the shortest possible match at the first possible 2792matching point in the subject string. 2793<pre> 2794 PCRE_DFA_RESTART 2795</pre> 2796When <b>pcre_dfa_exec()</b> returns a partial match, it is possible to call it 2797again, with additional subject characters, and have it continue with the same 2798match. The PCRE_DFA_RESTART option requests this action; when it is set, the 2799<i>workspace</i> and <i>wscount</i> options must reference the same vector as 2800before because data about the match so far is left in them after a partial 2801match. There is more discussion of this facility in the 2802<a href="pcrepartial.html"><b>pcrepartial</b></a> 2803documentation. 2804</P> 2805<br><b> 2806Successful returns from <b>pcre_dfa_exec()</b> 2807</b><br> 2808<P> 2809When <b>pcre_dfa_exec()</b> succeeds, it may have matched more than one 2810substring in the subject. Note, however, that all the matches from one run of 2811the function start at the same point in the subject. The shorter matches are 2812all initial substrings of the longer matches. For example, if the pattern 2813<pre> 2814 <.*> 2815</pre> 2816is matched against the string 2817<pre> 2818 This is <something> <something else> <something further> no more 2819</pre> 2820the three matched strings are 2821<pre> 2822 <something> 2823 <something> <something else> 2824 <something> <something else> <something further> 2825</pre> 2826On success, the yield of the function is a number greater than zero, which is 2827the number of matched substrings. The substrings themselves are returned in 2828<i>ovector</i>. Each string uses two elements; the first is the offset to the 2829start, and the second is the offset to the end. In fact, all the strings have 2830the same start offset. (Space could have been saved by giving this only once, 2831but it was decided to retain some compatibility with the way <b>pcre_exec()</b> 2832returns data, even though the meaning of the strings is different.) 2833</P> 2834<P> 2835The strings are returned in reverse order of length; that is, the longest 2836matching string is given first. If there were too many matches to fit into 2837<i>ovector</i>, the yield of the function is zero, and the vector is filled with 2838the longest matches. Unlike <b>pcre_exec()</b>, <b>pcre_dfa_exec()</b> can use 2839the entire <i>ovector</i> for returning matched strings. 2840</P> 2841<P> 2842NOTE: PCRE's "auto-possessification" optimization usually applies to character 2843repeats at the end of a pattern (as well as internally). For example, the 2844pattern "a\d+" is compiled as if it were "a\d++" because there is no point 2845even considering the possibility of backtracking into the repeated digits. For 2846DFA matching, this means that only one possible match is found. If you really 2847do want multiple matches in such cases, either use an ungreedy repeat 2848("a\d+?") or set the PCRE_NO_AUTO_POSSESS option when compiling. 2849</P> 2850<br><b> 2851Error returns from <b>pcre_dfa_exec()</b> 2852</b><br> 2853<P> 2854The <b>pcre_dfa_exec()</b> function returns a negative number when it fails. 2855Many of the errors are the same as for <b>pcre_exec()</b>, and these are 2856described 2857<a href="#errorlist">above.</a> 2858There are in addition the following errors that are specific to 2859<b>pcre_dfa_exec()</b>: 2860<pre> 2861 PCRE_ERROR_DFA_UITEM (-16) 2862</pre> 2863This return is given if <b>pcre_dfa_exec()</b> encounters an item in the pattern 2864that it does not support, for instance, the use of \C or a back reference. 2865<pre> 2866 PCRE_ERROR_DFA_UCOND (-17) 2867</pre> 2868This return is given if <b>pcre_dfa_exec()</b> encounters a condition item that 2869uses a back reference for the condition, or a test for recursion in a specific 2870group. These are not supported. 2871<pre> 2872 PCRE_ERROR_DFA_UMLIMIT (-18) 2873</pre> 2874This return is given if <b>pcre_dfa_exec()</b> is called with an <i>extra</i> 2875block that contains a setting of the <i>match_limit</i> or 2876<i>match_limit_recursion</i> fields. This is not supported (these fields are 2877meaningless for DFA matching). 2878<pre> 2879 PCRE_ERROR_DFA_WSSIZE (-19) 2880</pre> 2881This return is given if <b>pcre_dfa_exec()</b> runs out of space in the 2882<i>workspace</i> vector. 2883<pre> 2884 PCRE_ERROR_DFA_RECURSE (-20) 2885</pre> 2886When a recursive subpattern is processed, the matching function calls itself 2887recursively, using private vectors for <i>ovector</i> and <i>workspace</i>. This 2888error is given if the output vector is not large enough. This should be 2889extremely rare, as a vector of size 1000 is used. 2890<pre> 2891 PCRE_ERROR_DFA_BADRESTART (-30) 2892</pre> 2893When <b>pcre_dfa_exec()</b> is called with the <b>PCRE_DFA_RESTART</b> option, 2894some plausibility checks are made on the contents of the workspace, which 2895should contain data about the previous partial match. If any of these checks 2896fail, this error is given. 2897</P> 2898<br><a name="SEC24" href="#TOC1">SEE ALSO</a><br> 2899<P> 2900<b>pcre16</b>(3), <b>pcre32</b>(3), <b>pcrebuild</b>(3), <b>pcrecallout</b>(3), 2901<b>pcrecpp(3)</b>(3), <b>pcrematching</b>(3), <b>pcrepartial</b>(3), 2902<b>pcreposix</b>(3), <b>pcreprecompile</b>(3), <b>pcresample</b>(3), 2903<b>pcrestack</b>(3). 2904</P> 2905<br><a name="SEC25" href="#TOC1">AUTHOR</a><br> 2906<P> 2907Philip Hazel 2908<br> 2909University Computing Service 2910<br> 2911Cambridge CB2 3QH, England. 2912<br> 2913</P> 2914<br><a name="SEC26" href="#TOC1">REVISION</a><br> 2915<P> 2916Last updated: 09 February 2014 2917<br> 2918Copyright © 1997-2014 University of Cambridge. 2919<br> 2920<p> 2921Return to the <a href="index.html">PCRE index page</a>. 2922</p> 2923