Regular expressions are used several ways in Perl. They're used in conditionals to determine whether a string matches a particular pattern. They're also used to find patterns in strings and replace the match with something else.
The ordinary pattern match operator looks like
/
pattern
/
. It matches against the
$_
variable by default. If the pattern is found in the string, the operator returns true (
"1"
); if there is no match, a false value (
""
) is returned.
The substitution operator looks like
s/
pattern
/
replace
/
. This operator searches
$_
by default. If it finds the specified
pattern
, it is replaced with the string in
replace
. If
pattern
is not matched, nothing happens.
You may specify a variable other than
$_
with the
=~
binding operator (or the negated
!~
binding operator, which returns true if the pattern is not matched). For example:
$text =~ /sampo/;
The following list defines Perl's pattern-matching operators. Some of the operators have alternative "quoting" schemes and have a set of modifiers that can be placed directly after the operators to affect the match operation in some way.
m/
pattern
/gimosx
Searches a string for a pattern match. Modifiers are:
Modifier | Meaning |
---|---|
g
|
Match globally, i.e., find all occurrences. |
i
|
Do case-insensitive pattern matching. |
m
|
Treat string as multiple lines. |
o
|
Only compile pattern once. |
s
|
Treat string as single line. |
x
|
Use extended regular expressions. |
If
/
is the delimiter, then the initial
m
is optional. With the
m
, you can use any pair of non-alphanumeric, non-whitespace characters as delimiters.
?
pattern
?
This operator is just like the
m/
pattern
/
search, except it matches only once.
qr/
pattern
/imosx
Creates a precompiled regular expression from
pattern
, which can be passed around in variables and interpolated into other regular expressions. The modifiers are the same as those for
m//
above.
s/
pattern
/
replacement
/egimosx
Searches a string for
pattern
, and replaces any match with the
replacement
text. Returns the number of substitutions made, which can be more than one with the
/g
modifier. Otherwise, it returns false (0). If no string is specified via the
=~
or
!~
operator, the
$_
variable is searched and modified. Modifiers are:
Modifier | Meaning |
---|---|
e
|
Evaluate the right side as an expression. |
g
|
Replace globally, i.e., all occurrences. |
i
|
Do case-insensitive pattern matching. |
m
|
Treat string as multiple lines. |
o
|
Only compile pattern once. |
s
|
Treat string as single line. |
x
|
Use extended regular expressions. |
Any non-alphanumeric, non-whitespace delimiter may replace the slashes. If single quotes are used, no interpretation is done on the replacement string (the
/e
modifier overrides this, however).
tr/
pattern1
/
pattern2
/cds
y/
pattern1
/
pattern2
/cds
This operator scans a string, character by character, and replaces all occurrences of the characters found in
pattern1
with the corresponding character in
pattern2
. It returns the number of characters replaced or deleted. If no string is specified via the
=~
or
!~
operator, the
$_
string is translated. Modifiers are:
Modifier | Meaning |
---|---|
c
|
Complement
pattern1
. |
d
|
Delete found but unreplaced characters. |
s
|
Squash duplicate replaced characters. |
The simplest kind of regular expression is a literal string. More complicated patterns involve the use of metacharacters to describe all the different choices and variations that you want to build into a pattern. Metacharacters don't match themselves, but describe something else. The metacharacters are:
The "
.
" (single dot) is a wildcard character. When used in a regular expression, it can match any single character. The exception is the newline character (
\n
), except when you use the
/s
modifier on the pattern match operator. This modifier treats the string to be matched against as a single "long" string with embedded newlines.
The
^
and
$
metacharacters are used as anchors in a regular expression. The
^
matches the beginning of a line. This character should only appear at the beginning of an expression to match the line beginning. The exception to this is when the
/m
(multi-line) modifier is used, in which case it will match at the beginning of the string and after every newline (except the last, if there is one). Otherwise,
^
will match itself, unescaped, anywhere in a pattern, except if it is the first character in a bracketed character class, in which case it negates the class.
Similarly,
$
will match the end of a line (just before a newline character) only if it is at the end of a pattern, unless
/m
is used, in which case it matches just before every newline and at the end of a string. You need to escape
$
to match a literal dollar sign in all cases, because if
$
isn't at the end of a pattern (or placed right before a
)
or
]
), Perl will attempt to do variable interpretation. The same holds true for the
@
sign, which Perl will interpret as an array variable start unless it is backslashed.
The
*
,
+
, and
?
metacharacters are called
quantifiers
. They specify the number of times to match something. They act on the element immediately preceding them, which could be a single character (including the
.
), a grouped expression in parentheses, or a character class. The
{...}
construct is a generalized modifier. You may put two numbers separated by a comma within the braces to specify minimum and maximum numbers that the preceding element can match.
Parentheses are used to group characters or expressions. They also have the side effect of remembering what they matched so you can recall and reuse patterns with a special group of variables.
The
|
is the alternation operator in regular expressions. It matches either what's on its left side or right side. It does not only affect single characters. For example:
looks for any of the four words. You should use parentheses to provide boundaries for alternation:/you|me|him|her/
This will match either "Andy" or "Andrew"./And(y|rew)/
The following table lists the backslashed representations of characters that you can use in regular expressions:
Code | Matches |
---|---|
\a
|
Alarm (beep) |
\n
|
Newline |
\r
|
Carriage return |
\t
|
Tab |
\f
|
Formfeed |
\e
|
Escape |
\007
|
Any octal ASCII value |
\x7f
|
Any hexadecimal ASCII value |
\c
x
|
Control-
x
|
The
[...]
construct is used to list a set of characters (a
character class
) of which
one
will match. Brackets are often used when capitalization is uncertain in a match:
A dash (/[tT]here/
-
) may be used to indicate a range of characters in a character class: To put a literal dash in the list you must use a backslash before it (/[a-zA-Z]/; # match any single letter /[0-9]/; # match any single digit
\-
).
By placing a
^
as the first element in the brackets, you create a negated character class, i.e., it matches any character not in the list. For example:
Some common character classes have their own predefined escape sequences for your programming convenience:/[^A-Z]/; matches any character other than an uppercase letter
Code | Matches |
---|---|
\d
|
A digit, same as
[0-9]
|
\D
|
A nondigit, same as
[^0-9]
|
\w
|
A word character (alphanumeric), same as
[a-zA-Z_0-9]
|
\W
|
A nonword character,
[^a-zA-Z_0-9]
|
\s
|
A whitespace character, same as
[\t\n\r\f]
|
\S
|
A non-whitespace character,
[^\t\n\r\f]
|
These elements match any single element in (or not in) their class. A
\w
matches only one character of a word. Using a modifier, you can match a whole word, for example, with
\w+
. The abbreviated classes may also be used within brackets as elements of other character classes.
Anchors don't match any characters; they match places within a string. The two most common anchors are
^
and
$
, which match the beginning and end of a line, respectively. This table lists the anchoring patterns used to match certain boundaries in regular expressions:
Assertion | Meaning |
---|---|
^
|
Matches at the beginning of the string (or line, if |
$
|
Matches at the end of the string (or line, if |
\b
|
Matches at word boundary (between |
\B
|
Matches except at word boundary |
\A
|
Matches at the beginning of the string |
\Z
|
Matches at the end of the string or before a newline |
\z
|
Matches only at the end of the string |
\G
|
Matches where previous |
The
$
and
\Z
assertions can match not only at the end of the string, but also one character earlier than that, if the last character of the string happens to be a newline.
Quantifiers are used to specify how many instances of the previous element can match. For instance, you could say "match any number of a's, including none" (
a*
), or match between five and ten instances of the word "owie" (
(owie){5,10}
).
Quantifiers, by nature, are greedy. That is, the way the Perl regular expression "engine" works is that it will look for the biggest match possible (the farthest to the right) unless you tell it not to. Say you are searching a string that reads:
and you want to finda whatever foo, b whatever foo
a
and
foo
with something in between. You might use: A/a.*foo/
.
followed by a
*
looks for any character, any number of times, until
foo
is found. But since Perl will look as far to the right as possible to find
foo
, the first instance of
foo
is swallowed up by the greedy
.*
expression.
All the quantifiers therefore have a notation that allows for minimal matching, so they are non-greedy. This notation uses a question mark immediately following the quantifier to force Perl to look for the earliest available match (farthest to the left). The following table lists the regular expression quantifiers and their non-greedy forms:
Maximal | Minimal | Allowed Range |
---|---|---|
{
n
,
m
}
|
{
n
,
m
}?
|
Must occur at least |
{
n
,}
|
{
n
,}?
|
Must occur at least |
{
n
}
|
{
n
}?
|
Must match exactly |
*
|
*?
|
|
+
|
+?
|
|
?
|
??
|
Parentheses not only serve to group elements in a regular expression, they also remember the patterns they match. Every match from a parenthesized element is saved to a special, read-only variable indicated by a number. You can recall and reuse a match by using these variables.
Within a pattern, each parenthesized element saves its match to a numbered variable, in order starting with
1
. You can recall these matches within the expression by using
\1
,
\2
, and so on.
Outside of the matching pattern, the matched variables are recalled with the usual dollar-sign, i.e.,
$1
,
$2
, etc. The dollar sign notation should used in the replacement expression of a substitution and anywhere else you might want to use them in your program. For example, to implement "i before e, except after c":
The backreferencing variables are:s/([^c])ei/$1ie/g;
$+
Returns the last parenthesized pattern match
$&
Returns the entire matched string
$`
Returns everything before the matched string
$'
Returns everything after the matched string
Backreferencing with these variables will slow down your program noticeably for all regular expressions.
Perl defines an extended syntax for regular expressions. The syntax is a pair of parentheses with a question mark as the first thing within the parentheses. The character after the question mark gives the function of the extension. The extensions are:
(?#text)
A comment. The text is ignored.
(?:...)
This groups things like "
(...)
" but doesn't make backreferences.
(?=...)
A zero-width positive lookahead assertion. For example,
/\w+(?=\t)/
matches a word followed by a tab, without including the tab in
$&
.
(?!...)
A zero-width negative lookahead assertion. For example,
/foo(?!bar)/
matches any occurrence of "foo" that isn't followed by "bar".
(?<=...)
A zero-width positive lookbehind assertion. For example,
/(?<=bad)boy/
matches the word
boy
that follows
bad
, without including
bad
in
$&
. This only works for fixed-width lookbehind.
(?<!=...)
A zero-width negative lookbehind assertion. For example,
/(?<!=bad)boy/
matches any occurrence of "boy" that doesn't follow "bad". This only works for fixed-width lookbehind.
(?>...)
Matches the substring that the standalone pattern would match if anchored at the given position.
(?(
condition
)
yes-pattern
|
no-pattern
)
(?(
condition
)
yes-pattern
)
Matches a pattern determined by a condition. The
condition
should be either an integer, which is "true" if the pair of parentheses corresponding to the integer has matched, or a lookahead, lookbehind, or evaluate, zero-width assertion. The
no-pattern
will be used to match if the condition was not meant, but it is also optional.
(?imsx-imsx)
One or more embedded pattern-match modifiers. Modifiers are switched off if they follow a
-
(dash). The modifiers are defined as follows:
Modifier | Meaning |
---|---|
i
|
Do case-insensitive pattern matching |
m
|
Treat string as multiple lines |
s
|
Treat string as single line |
x
|
Use extended regular expressions |
Copyright © 2001 O'Reilly & Associates. All rights reserved.