Quoting constructs: Difference between revisions
Line 414: | Line 414: | ||
====Arrays==== |
====Arrays==== |
||
Literal arrays are written as #(...), where the elements are space separated; each literal array element can be any type of literal again, optionally omitting the '#'character: |
Literal arrays are written as #(...), where the elements are space separated; each literal array element can be any type of literal again, optionally omitting the '#'character: |
||
<lang smalltalk>#( 1 1.234 foo 'hello' #(9 8 7) (99 88 77) $λ '日本語' true [1 2 3] false)</lang> |
<lang smalltalk>#( 1 1.234 (1/2) foo 'hello' #(9 8 7) (99 88 77) $λ '日本語' true [1 2 3] false)</lang> |
||
Here, the third element is the symbol #'foo', |
Here, the third element is a fraction, followed by the symbol #'foo', two arrays, a character, another string, the boolean true, a byteArray and the boolean false. |
||
====ByteArrays==== |
====ByteArrays==== |
Revision as of 20:36, 25 December 2020
Pretty much every programming language has some form of quoting construct to allow embedding of data in a program, be it literal strings, numeric data or some combination thereof.
Show examples of the quoting constructs in your language. Explain where they would likely be used, what their primary use is, what limitations they have and why one might be preferred over another. Is one style interpolating and another not? Are there restrictions on the size of the quoted data? The type? The format?
This is intended to be open-ended and free form. If you find yourself writing more than a few thousand words of explanation, summarize and provide links to relevant documentation; but do provide at least a fairly comprehensive summary here, on this page, NOT just a link to [See the language docs].
Note: This is primarily for quoting constructs for data to be "embedded" in some way into a program. If there is some special format for external data, it may be mentioned but that isn't the focus of this task.
Go
<lang go>package main
import (
"fmt" "os" "regexp" "strconv"
)
/* Quoting constructs in Go. */
// In Go a Unicode codepoint, expressed as a 32-bit integer, is referred to as a 'rune' // but the more familiar term 'character' will be used instead here.
// Character literal (single quotes). // Can contain any single character including an escaped character. var (
rl1 = 'a' rl2 = '\ // single quote can only be included in escaped form
)
// Interpreted string literal (double quotes). // A sequence of characters including escaped characters. var (
is1 = "abc" is2 = "\"ab\tc\"" // double quote can only be included in escaped form
)
// Raw string literal(single back quotes). // Can contain any character including a 'physical' new line but excluding back quote. // Escaped characters are interpreted literally i.e. `\n` is backslash followed by n. // Raw strings are typically used for hard-coding pieces of text perhaps // including single and/or double quotes without the need to escape them. // They are particularly useful for regular expressions. var (
rs1 = `
first" second' third" `
rs2 = `This is one way of including a ` + "`" + ` in a raw string literal.` rs3 = `\d+` // a sequence of one or more digits in a regular expression
)
func main() {
fmt.Println(rl1, rl2) // prints the code point value not the character itself fmt.Println(is1, is2) fmt.Println(rs1) fmt.Println(rs2) re := regexp.MustCompile(rs3) fmt.Println(re.FindString("abcd1234efgh"))
/* None of the above quoting constructs can deal directly with interpolation. This is done instead using library functions. */
// C-style using %d, %f, %s etc. within a 'printf' type function. n := 3 fmt.Printf("\nThere are %d quoting constructs in Go.\n", n)
// Using a function such as fmt.Println which can take a variable // number of arguments, of any type, and print then out separated by spaces. s := "constructs" fmt.Println("There are", n, "quoting", s, "in Go.")
// Using the function os.Expand which requires a mapper function to fill placeholders // denoted by ${...} within a string. mapper := func(placeholder string) string { switch placeholder { case "NUMBER": return strconv.Itoa(n) case "TYPES": return s } return "" } fmt.Println(os.Expand("There are ${NUMBER} quoting ${TYPES} in Go.", mapper))
}</lang>
- Output:
97 39 abc "ab c" first" second' third" This is one way of including a ` in a raw string literal. 1234 There are 3 quoting constructs in Go. There are 3 quoting constructs in Go. There are 3 quoting constructs in Go.
Julia
Note: Almost all of the documentation below is quoted from various portions of the Julia documentation at docs.julialang.org.
- As with all objects in Julia, the size of a quoted string is limited by the maximum allocatable memory object in the underlying OS (32 or 64 bit).
- Quoted strings are considered to contain a series of Unicode characters, but invalid Unicode within strings does not itself throw any errors. Therefore, strings may potentially contain any values.
- String literals are delimited by double quotes or triple double quotes:
<lang julia> julia> str = "Hello, world.\n" "Hello, world.\n"
julia> """Contains "quote" characters and a newline""" "Contains \"quote\" characters and \na newline" </lang>
- Both single and triple quoted strings are may contain interpolated values. Triple-quoted strings are also dedented to the level of the least-indented line. This is useful for defining strings within code that is indented. For example:
<lang julia> julia> str = """
Hello, world. """
" Hello,\n world.\n" </lang>
- Julia allows interpolation into string literals using $:
<lang julia> julia> "$greet, $whom.\n" "Hello, world.\n" </lang>
- The shortest complete expression after the $ is taken as the expression whose value is to be interpolated into the string. Thus, you can interpolate any expression into a string using parentheses:
<lang julia> julia> "1 + 2 = $(1 + 2)" "1 + 2 = 3" </lang>
- Julia reserves the single quote ' for character literals, not for strings:
<lang julia> julia> 'π' 'π': Unicode U+03C0 (category Ll: Letter, lowercase) </lang>
- Julia requires commands sent to functions such as run() be surrounded by backticks. Such expressions create a Cmd object, which is used for running a child process from Julia:
<lang julia> julia> mycommand = `echo hello` `echo hello`
julia> typeof(mycommand) Cmd
julia> run(mycommand); hello </lang>
- Julia uses the colon : in metaprogramming for quoting symbols and other code:
<lang julia> julia> a = :+
- +
julia> typeof(a) Symbol
julia> b = quote + end quote
#= REPL[3]:1 =# +
end
julia> typeof(b) Expr
julia> eval(a) == eval(b) true
julia> c = :(2 + 3)
- (2 + 3)
julia> eval(c) 5 </lang>
Phix
Single quotes are used for single ascii characters, eg 'A'. Multibyte unicode characters are typically held as utf-8 strings.
Double quotes are used for single-line strings, with backslash interpretation, eg "one\ntwo\nthree\n".
The concatenation operator & along with a couple more quotes can certainly be used to mimic string continuation, however it is technically an implementation detail rather than part of the language specification as to whether that occurs at compile-time or run-time.
Phix does not support interpolation other than printf-style, eg printf(1,"Hello %s,\nYour account balance is %3.2f\n",{name,balance}).
Back-ticks and triple-quotes are used for multi-line strings, without backslash interpretation, eg
<lang Phix>constant t123 = `
one
two
three
`</lang>
or (entirely equivalent, except the following can contain back-ticks which the above cannot, and vice versa for triple quotes)
<lang Phix>constant t123 = """
one
two
three
"""</lang>
Both are also equivalent to the top double-quote one-liner. Note that a single leading '\n' is automatically stripped.
Several builtins such as substitute, split, and join are often used to convert such strings into the required internal form.
Regular expressions are usually enclosed in back-ticks, specifically to avoid backslash interpretation.
You can also declare hexadecimal strings, eg
<lang Phix>x"1 2 34 5678_AbC" -- same as {0x01, 0x02, 0x34, 0x56, 0x78, 0xAB, 0x0C}
-- note however it displays as {1,2,52,86,120,171,12} -- whereas x"414243" displays as "ABC" (as all chars)</lang>
Literal sequences are represented with curly braces, and can be nested to any depth, eg <lang Phix>{2, 3, 5, 7, 11, 13, 17, 19} {1, 2, {3, 3, 3}, 4, {5, {6}}} {{"John", "Smith"}, 52389, 97.25} {} -- the 0-element sequence</lang>
Raku
The Perl philosophy, which Raku thoroughly embraces, is that "There Is More Than One Way To Do It" (often abbreviated to TIMTOWDI). Quoting constructs is an area where this is enthusiastically espoused.
Raku has a whole quoting specific sub-language built in called Q. Q changes the parsing rules inside the quoting structure and allows extremely fine control over how the enclosed data is parsed. Every quoting construct in Raku is some form of a Q syntactic structure, using adverbs to fine tune the desired behavior, though many of the most commonly used have some form of "shortcut" syntax for quick and easy use. Usually, when using an adverbial form, you may omit the Q: and just use the adverb.
In general, any and all quoting structures have theoretically unlimited length, in practice, are limited by memory size, practically, it is probably better to limit them to less than a gigabyte or so, though they can be read as a supply, not needing to hold the whole thing in memory at once. They can hold multiple lines of data. How the new-line characters are treated depends entirely on any white-space adverb applied. The Q forms use some bracketing character to delimit the quoted data. Usually some Unicode bracket ( [], {}, <>, ⟪⟫, whatever,) that has an "open" and "close" bracketing character, but they may use any non-indentifier character as both opener and closer. ||, //, ??, the list goes on. The universal escape character for constructs that allow escaping is backslash "\".
The following exposition barely scratches the surface. For much more detail see the Raku documentation for quoting constructs for a comprehensive list of adverbs and examples.
- The most commonly used
- Q[ ], common shortcut: 「 」
- The most basic form of quoting. No interpolation, no escaping. What is inside is what you get. No exceptions.
- 「Ze backslash characters!\ \Zay do NUSSING!! \」 -> Ze backslash characters!\ \Zay do NUSSING!! \
- "Single quote" quoting. - Q:q[ ], adverbial: q[ ], common shortcut: ' '
- No interpolation, but allow escaping quoting characters.
- 'Don\'t panic!' -> Don't panic!
- "Double quote" quoting. - Q:qq[ ], adverbial: qq[ ], common shortcut: " "
- Interpolates: embedded variables, logical characters, character codes, continuations.
- "Hello $name, today is {Date.today} \c[grinning face] \n🦋" -> Hello Dave, today is 2020-03-25 😀
- 🦋
- Where $name is a variable containing a name (one would imagine), {Date.today} is a continuation - a code block to be executed and the result inserted, \c[grinning face] is the literal emoji character 😀 as a character code, \n is a new-line character and 🦋 is an emoji butterfly. Allows escape sequences, and indeed, requires them when embedding data that looks like it may be an interpolation target but isn't.
Every adverbial form has both a q and a qq variant to give the 'single quote' or "double quote" semantics. Only the most commonly used are listed here.
- "Quote words" - Q:qw[ ], adverbial: qw[ ], common shortcut: < >
- No interpolation, but allow escaping quote characters. (Inherited from the q[] escape semantics)
- < a β 3 Б 🇩🇪 >
- Parses whatever is inside as a white-space separated list of words. Returns a list with all white space removed. Any numeric values are returned as allomorphs.
- That list may be operated on directly with any listy operator or it may be assigned to a variable.
- say < a β 3 Б 🇩🇪 >[*-1] # What is the last item in the list? (🇩🇪)
- say +< a β 3 Б 🇩🇪 > # How many items are in the list? (5)
- "Quote words with white space protection" - Q:qww[ ], adverbial: qww[ ]
- May preserve white space by enclosing it in single or double quote characters, otherwise identical to qw[ ].
- say qww< a β '3 Б' 🇩🇪 >[2] # Item 2 in the list? (3 Б)
- "Double quote words" quoting. - Q:qqw[ ], adverbial: qqw[ ], common shortcut: << >> or « »
- Interpolates similar to standard double quote, but then interprets the interpolated string as a white space separated list.
- "Double quoted words with white space protection" - Q:qqww[ ], adverbial: qqww[ ]
- Same as qqw[ ] but retains quoted white space.
- "System command" - Q:qx[ ], adverbial: qx[ ]
- Execute the string inside the construct as a system command and return the result.
- "Heredoc format" - Q:q:to/END/; END, adverbial: q:to/END/; END
- Return structured text between two textual delimiters. Depending on the adverb, may or may not interpolate (same rules as other adverbial forms.) Will return the text with the same indent as the indent of the final delimiter. The text delimiter is user chosen (and is typically, though not necessarily, uppercase) as is the delimiter bracket character.
There are other adverbs to give precise control what interpolates or doesn't, that may be applied to any of the above constructs. See the doc page for details. There is another whole sub-genre dedicated to quoting regexes.
REXX
There are no "escape" characters used in the REXX language.
The different types (or styles) of incorporating quoted constructs are a largely matter of style. <lang rexx>/*REXX program demonstrates various ways to express a string of characters or numbers.*/ a= 'This is one method of including a (an apostrophe) within a string.' b= "This is one method of including a ' (an apostrophe) within a string."
/*sometimes, an apostrophe is called */ /*a quote. */
/*──────────────────────────────────────────────────────────────────────────────────────*/ c= "This is one method of including a "" (a double quote) within a string." d= 'This is one method of including a " (a double quote) within a string.'
/*sometimes, a double quote is also */ /*called a quote, which can make for */ /*some confusion and bewilderment. */
/*──────────────────────────────────────────────────────────────────────────────────────*/ f= 'This is one method of expressing a long literal by concatenations, the ' || ,
'trailing character of the above clause must contain a trailing ' || , 'comma (,) === note the embedded trailing blank in the above 2 statements.'
/*──────────────────────────────────────────────────────────────────────────────────────*/ g= 'This is another method of expressing a long literal by ' ,
"abutments, the trailing character of the above clause must " , 'contain a trailing comma (,)'
/*──────────────────────────────────────────────────────────────────────────────────────*/ h= 'This is another method of expressing a long literal by ' , /*still continued.*/
"abutments, the trailing character of the above clause must " , 'contain a trailing comma (,) --- in this case, the comment /* ... */ is ' , 'essentially is not considered to be "part of" the REXX clause.'
/*──────────────────────────────────────────────────────────────────────────────────────*/ i= 2 3 5 7 11 13 17 19 23 29 31 37 41 43 47 53 59 61 67 71 73 79 83 89 97 101 103 107 109
/*This is one way to express a list of */ /*numbers that don't have a sign. */
/*──────────────────────────────────────────────────────────────────────────────────────*/ j= 2 3 5 7 11 13 17 19 23 29 31 37 41 43 47 53 59 61 67 71 73 79 83 89 97 101 103 107 109,
71 73 79 83 89 97 101 103 107 109 113 127 131 137 139 149 151 157 163 167 173 179 181
/*This is one way to express a long */ /*list of numbers that don't have a */ /*sign. */ /*Note that this form of continuation */ /*implies a blank is abutted to first */ /*part of the REXX statement. */ /*Also note that some REXXs have a */ /*maximum clause length. */
/*──────────────────────────────────────────────────────────────────────────────────────*/ k= 2 3 5 7 11 13 17 19 23 29 31 37 41 43 47 53 59 61 67 71 73 79 83 89 97 101 103 107 109,
71 73 79 83 89 97 101 103 107 109 113 127 131 137 139 149 151 157 163 167 173 179 181
/*The J and K values are identical,*/ /*superfluous and extraneous blanks are*/ /*ignored. */
/*──────────────────────────────────────────────────────────────────────────────────────*/ l= '-2 3 +5 7 -11 13 17 19 -23 29 -31 37 -41 43 47 -53 59 -61 67 -71 73 79 -83 89 97 -101'
/*This is one way to express a list of */ /*numbers that have a sign. */
/*──────────────────────────────────────────────────────────────────────────────────────*/ m= a b c d f g h i j k l /*this will create a list of all the */
/*listed strings used (so far) into */ /*the variable L (with an */ /*intervening blank between each */ /*variable's value. */</lang>
Ring
<lang Ring> text = list(3)
text[1] = "This is 'first' example for quoting" text[2] = "This is second 'example' for quoting" text[3] = "This is third example 'for' quoting"
for n = 1 to len(text)
see "text for quoting: " + nl + text[n] + nl str = substr(text[n],"'","") see "quoted text:" + nl + str + nl + nl
next </lang>
- Output:
text for quoting:
This is 'first' example for quoting
quoted text:
This is first example for quoting
text for quoting:
This is second 'example' for quoting
quoted text:
This is second example for quoting
text for quoting:
This is third example 'for' quoting
quoted text:
This is third example for quoting
Smalltalk
Characters
Character literals are prefixed by a "$". Conceptionally, they are the elements of strings, although effectively only the codePoint is stored in strings. But when accessing a string element, instances of Character are used. Characters can be asked for being uppercase, lowercase, etc. <lang smalltalk>$a $Å $日</lang>
Strings
String literals are enclosed in single quotes. Conceptionally, they holde instances of Character as element, but actually the underlying storage representation is chosen to be space effective. Typically, underneath are classes like SingleByteString, TwoByteString and FourByteString, but this is transparent to the programmer. Strings can hold any Unicode character; UTF is only used when strings are exchanged with the external world. <lang smalltalk>'hello' '日本語 </lang>
Traditional Smalltalk-80 does not support any escapes inside strings, which is inconvenient, occasionally.
Smalltalk/X supports an extended syntax for C-like strings:
<lang smalltalk>c'hello\nthis\tis a C string\0x0D'</lang> and also embedded expressions: <lang smalltalk>e'hello world; it is now {Time now}\n'</lang>
Arrays
Literal arrays are written as #(...), where the elements are space separated; each literal array element can be any type of literal again, optionally omitting the '#'character: <lang smalltalk>#( 1 1.234 (1/2) foo 'hello' #(9 8 7) (99 88 77) $λ '日本語' true [1 2 3] false)</lang> Here, the third element is a fraction, followed by the symbol #'foo', two arrays, a character, another string, the boolean true, a byteArray and the boolean false.
ByteArrays
A dense collection of byte valued integers is written as #[..]. <lang smalltalk>#[ 1 2 16rFF 2r0101010 ]</lang>
Symbols
These are like symbol atoms in Lisp/Scheme, written as #'...' (i.e. like a string with hash prefix). If the characters do not contain special characters or are of the form allowed for a message selector, the quotes can be omitted. Symbols are often used as key in dictionaries, especially for message selectors and global/namespace name bindings. They can be quickly compared using "==", which is. a pointer compare (identity) instead of "=" which is compares the contents (equality). <lang smalltalk>#'foo'
- 'foo bar baz'
- foo. " same as #'foo' "
- '++'
- ++ " same as #'++' "
- a:b:c: " same as #'a:b:c:' "</lang>
In addition, some Smalltalk dialects implement additional syntax extensions.
Inline Object
<lang smalltalk>#{
foo: <someConstant> bar: <someConstant>
}</lang> Generates a literal constant instance of an anonymous class, with two instance vars: foo and bar. The object is dumb in that it only provides getter and setter functions. These are used eg. when returning structured multiple values from a method.
Dense Typed Arrays
Similar to byteArrays, there are dense arrays of ints, floats, doubles or bits (i.e. they use much less memory compared to regular arrays, which hold pointers to their elements). They are also perfect when calling out to C-language functions. The syntax is analogous to the Scheme language's syntax:
<lang>#u16( 1 2 3 ). " an array of unsigned int16s "
- u32( 1 2 3 ). " an array of unsigned int32s "
- u64( 1 2 3 ). " an array of unsigned int64s "
- s16( -1 2 3 ). " an array of signed int16s "
- s32( -1 2 3 ). " an array of signed int32s "
- s64( -1 2 3 ). " an array of signed int64s "
- f16( -1 2.0 3 ). " an array of float16s "
- f32( -1 2.0 3 ). " an array of float32s "
- f64( -1 2.0 3 ). " an array of float64s "
- b( 1 0 1 1 0 0 ). " an array of bits "
- B( true false true true ). " an array of booleans "
}</lang>
Wren
The only quoting construct Wren has is the string literal which is a sequence of characters (usually interpreted as UTF-8) enclosed in double-quotes. It can include various escape sequences as listed in the Literals/String#Wren task. Unlike many other languages, Wren doesn't currently support any form of 'raw' or 'verbatim' string whereby escape sequences etc. are interpreted literally.
However, it does support interpolation which enables any Wren expression, whatever its type or complexity, to be embedded in a string literal by placing it in parentheses immediately preceded by a % character. A literal % character is represented by the escape sequence \%.
If the expression is not a string, then it is automatically converted to one by applying its type's toString method. All classes have such a method which is usually written explicitly or can be just inherited from the Object class which sits at the top of the type hierarchy.
Interpolated expressions can also be nested though this is not usually a good idea as they can quickly become unreadable.
It can be argued that interpolated strings which contain anything other than simple expressions (for example formatting information) are hard to read anyway and, although not part of the standard language, the above module contains methods modelled after C's 'printf' function family to meet this objection.
Here are some examples of all this. <lang ecmascript>import "/fmt" for Fmt
// simple string literal System.print("Hello world!")
// string literal including an escape sequence System.print("Hello tabbed\tworld!")
// interpolated string literal var w = "world" System.print("Hello interpolated %(w)!")
// 'printf' style Fmt.print("Hello 'printf' style $s!", w)
// more complicated interpolated string literal var h = "Hello" System.print("%(Fmt.s(-8, h)) more complicated interpolated %(w.map { |c| "%(c + "\%")" }.join())!")
// more complicated 'printf' style Fmt.print("$-8s more complicated 'printf' style $s\%!", h, w.join("\%"))</lang>
- Output:
Hello world! Hello tabbed world! Hello interpolated world! Hello 'printf' style world! Hello more complicated interpolated w%o%r%l%d%! Hello more complicated 'printf' style w%o%r%l%d%!
zkl
Quoting text: zkl has two types of text: parsed and raw. Strings are limited to one line, no continuations.
Parsed text is in double quotes ("text\n") and escape ("\n" is newline, UTF-8 ("\Ubd;" or "\u00bd"), etc).
"Raw" text is unparsed, useful for things like regular expressions and unit testing of source code. It uses the form 0'<sigil>text<sigil>. For example 0'<text\n> is the text "text\\n". There is no restriction on sigil (other than it is one character).
Text blocks are multiple lines of text that are gathered into one line and then evaluated (thus can be anything, such as string or code and are often mixed). #<<< (at the start of a line) begins and ends the block. A #<<<" beginning tag prepends a " to the block. For example: <lang zkl>#<<< text:= " A ";
- <<<</lang>
is parsed as text:="\nA\n";
Other data types are pretty much as in other languages.