Everipedia Logo
Everipedia is now IQ.wiki - Join the IQ Brainlist and our Discord for early access to editing on the new platform and to participate in the beta testing.
Character (computing)

Character (computing)

In computer and machine-based telecommunications terminology, a character is a unit of information that roughly corresponds to a grapheme, grapheme-like unit, or symbol, such as in an alphabet or syllabary in the written form of a natural language.[1]

Examples of characters include letters, numerical digits, common punctuation marks (such as "." or "-"), and whitespace. The concept also includes control characters, which do not correspond to symbols in a particular natural language, but rather to other bits of information used to process text in one or more languages. Examples of control characters include carriage return or tab, as well as instructions to printers or other devices that display or otherwise process text.

Characters are typically combined into strings.

Encoding

Computers and communication equipment represent characters using a character encoding that assigns each character to something — an integer quantity represented by a sequence of digits, typically — that can be stored or transmitted through a network. Two examples of usual encodings are ASCII and the UTF-8 encoding for Unicode. While most character encodings map characters to numbers and/or bit sequences, Morse code instead represents characters using a series of electrical impulses of varying length.

Terminology

Historically, the term character has been widely used by industry professionals to refer to an encoded character, often as defined by the programming language or API. Likewise, character set has been widely used to refer to a specific repertoire of characters that have been mapped to specific bit sequences or numerical codes. The term glyph is used to describe a particular visual appearance of a character. Many computer fonts consist of glyphs that are indexed by the numerical code of the corresponding character.

With the advent and widespread acceptance of Unicode[2] and bit-agnostic coded character sets, a character is increasingly being seen as a unit of information, independent of any particular visual manifestation. The ISO/IEC 10646 (Unicode) International Standard defines character, or abstract character as "a member of a set of elements used for the organisation, control, or representation of data". Unicode's definition supplements this with explanatory notes that encourage the reader to differentiate between characters, graphemes, and glyphs, among other things. Such differentiation is an instance of the wider theme of the separation of presentation and content.

For example, the Hebrew letter aleph ("א") is often used by mathematicians to denote certain kinds of infinity, but it is also used in ordinary Hebrew text. In Unicode, these two uses are considered different characters, and have two different Unicode numerical identifiers ("code points"), though they may be rendered identically. Conversely, the Chinese logogram for water ("水") may have a slightly different appearance in Japanese texts than it does in Chinese texts, and local typefaces may reflect this. But nonetheless in Unicode they are considered the same character, and share the same code point.

The Unicode standard also differentiates between these abstract characters and coded characters or encoded characters that have been paired with numeric codes that facilitate their representation in computers.

Combining character

The combining character is also addressed by Unicode. For instance, Unicode allocates a code point to each of

  • 'i ' (U+0069),

  • the combining diaeresis (U+0308), and

  • 'ï' (U+00EF).

This makes it possible to code the middle character of the word 'naïve' either as a single character 'ï' or as a combination of the character 'i ' with the combining diaeresis: (U+0069 LATIN SMALL LETTER I + U+0308 COMBINING DIAERESIS); this is also rendered as 'ï '.

These are considered canonically equivalent by the Unicode standard.

char

A char in the C programming language is a data type with the size of exactly one byte,[3] which in turn is defined to be large enough to contain any member of the “basic execution character set”. The exact number of bits can be checked via CHAR_BIT macro. By far the most common size is 8 bits, and the POSIX standard requires it to be 8 bits.[4] In newer C standards char is required to hold UTF-8 code units[5] which requires a minimum size of 8 bits.

A Unicode code point requires 21 bits.[6]. This will not fit in a char on most systems, so more than one is used for some of them, as in the variable-length encoding UTF-8 where each code point takes 1 to 4 bytes. Furthermore, a "character" may require more than one code point (for instance with combining characters), depending on what is meant by the word "character".

Unfortunately, the fact that a character was historically stored in a single byte led to the two terms ("char" and "character") being used interchangeably in most documentation. This often makes the documentation confusing or misleading when multibyte encodings such as UTF-8 are used, and has led to inefficient and incorrect implementations of string manipulation functions (such as computing the "length" of a string as a count of code units rather than bytes). Modern POSIX documentation attempts to fix this, defining "character" as a sequence of one or more bytes representing a single graphic symbol or control code, and attempts to use "byte" when referring to char data.[7][8] However it still contains errors such as defining an array of char as a character array (rather than a byte array).[9]

Unicode can also be stored in strings made up of code units that are larger than char. These are called "wide characters". The original C type was called wchar_t. Due to some platforms defining wchar_t as 16 bits and others defining it as 32 bits, recent versions have added char16_t, char32_t. Even then the objects being stored might not be characters, for instance the variable-length UTF-16 is often stored in arrays of char16_t.

Other languages also have a char type. Some such as C++ use 8 bits like C. Others such as Java use 16 bits for char in order to represent UTF-16 values.

Word character

A "word" character has special meaning in some aspects of computing. A "word character" within ASCII typically means a letter of the alphabet A-Z (upper or lower case), the digits 0 to 9, and the underscore.[10][11]

It might be dependent on localization and encoding in use. For example, $ and | are not word characters, while 'é' (in French) or 'æ' or 'я' (in Russian) or 'ά' (in Greek) are, as used in words such as fédération, Αγορά, or Примечания.

See also

  • Character literal

  • Character (symbol)

  • Fill character

  • Combining character

  • Universal Character Set characters

  • Homoglyph

References

[1]
Citation Linkwww.merriam-webster.com"Definition of CHARACTER". www.merriam-webster.com. Retrieved 1 April 2018.
Sep 27, 2019, 5:14 PM
[2]
Citation Linkgoogleblog.blogspot.comDavis, Mark (2008-05-05). "Moving to Unicode 5.1". Google Blog. Retrieved 2008-09-28.
Sep 27, 2019, 5:14 PM
[3]
Citation Linkwww.iso.orgISO/IEC 14882:2011. § 5.3.3 Sizeof.
Sep 27, 2019, 5:14 PM
[4]
Citation Linkpubs.opengroup.org"<limits.h>". pubs.opengroup.org. Retrieved 1 April 2018.
Sep 27, 2019, 5:14 PM
[5]
Citation Linkwww.iso.orgISO/IEC 14882:2011. § 1.7 The C++ memory model.
Sep 27, 2019, 5:14 PM
[6]
Citation Linkwww.unicode.org"Glossary of Unicode Terms – Code Point". Retrieved 2019-05-14.
Sep 27, 2019, 5:14 PM
[7]
Citation Linkpubs.opengroup.orgPOSIX definition of Character
Sep 27, 2019, 5:14 PM
[8]
Citation Linkpubs.opengroup.orgPOSIX strlen reference
Sep 27, 2019, 5:14 PM
[9]
Citation Linkpubs.opengroup.orgPOSIX definition of Character Array
Sep 27, 2019, 5:14 PM
[10]
Citation Linkwww.regular-expressions.infoGoyvaerts, Jan. "Regexp Tutorial - Character Classes or Character Sets". www.regular-expressions.info. Retrieved 1 April 2018.
Sep 27, 2019, 5:14 PM
[11]
Citation Linkopenlibrary.orgSee also the [:word:] regular expression character class
Sep 27, 2019, 5:14 PM
[12]
Citation Linkwww.linfo.orgCharacters: A Brief Introduction
Sep 27, 2019, 5:14 PM
[13]
Citation Linkwww.charter724.infoISO/IEC TR 15285:1998
Sep 27, 2019, 5:14 PM
[14]
Citation Linkwww.merriam-webster.com"Definition of CHARACTER"
Sep 27, 2019, 5:14 PM
[15]
Citation Linkgoogleblog.blogspot.com"Moving to Unicode 5.1"
Sep 27, 2019, 5:14 PM
[16]
Citation Linkwww.iso.orgISO/IEC 14882:2011
Sep 27, 2019, 5:14 PM
[17]
Citation Linkpubs.opengroup.org"<limits.h>"
Sep 27, 2019, 5:14 PM
[18]
Citation Linkwww.iso.orgISO/IEC 14882:2011
Sep 27, 2019, 5:14 PM
[19]
Citation Linkwww.unicode.org"Glossary of Unicode Terms – Code Point"
Sep 27, 2019, 5:14 PM
[20]
Citation Linkpubs.opengroup.orgPOSIX definition of Character
Sep 27, 2019, 5:14 PM