Saturday, December 11, 2010

Internationalization and localization

In computing, internationalization and localization (also spelled internationalisation and localisation, see spelling differences) are means of adapting computer software to different languages, regional differences and technical requirements of a target market. Internationalization is the process of designing a software application so that it can be adapted to various languages and regions without engineering changes. Localization is the process of adapting internationalized software for a specific region or language by adding locale-specific components and translating text.

The terms are frequently abbreviated to the numeronyms i18n (where 18 stands for the number of letters between the first i and last n in internationalization, a usage coined at DEC in the 1970s or 80s[1]) and L10n respectively, due to the length of the words. The capital L in L10n helps to distinguish it from the lowercase i in i18n.

Some companies, like IBM and Sun Microsystems, use the term "globalization" for the combination of internationalization and localization.[2] Globalization can also be abbreviated to g11n.[3]

Microsoft[4] defines Internationalization as a combination of World-Readiness and localization. World-Readiness is a developer task, which enables a product to be used with multiple scripts and cultures (globalization) and separating user interface resources in a localizable format (localizability)[5].


Nomenclature

The support of multiple languages by computer systems can be considered a continuum between localisation ("L10n"), through multilingualisation (or "m17n"), to internationalisation ("i18n").

  • A localised system has been adapted or converted for use in a particular locale (other than the one it was originally developed for), including the language of the user interface (UI), input, and display, and features such as time/date display and currency. Each instance of the system only supports a single locale, and there is no explicit support for languages that are not part of that locale (although the character set may coincidentally be usable for other languages).
  • Multilingualised software supports multiple languages for concurrent display and input, but has a single UI language which cannot be changed. Multi-locale support for other features like date, time, number, and currency formats varies as the system tends towards full internationalisation. In general, a multilingualised system is intended for use in one specific locale, but is capable of handling multilingual content as data.
  • An internationalised system is equipped for use in a range of "locales" (or by users of multiple languages), by allowing the co-existence of several languages and character sets for input, display, and UI. In particular, a system may not be considered internationalised in the fullest sense unless the UI language is selectable by the user at runtime. Full internationalisation may extend beyond support for multiple languages and orthography to compliance with jurisdiction-specific legislation (in respect of copyright, for instance) and other non-linguistic conventions.

The distinction arises because it is significantly more difficult to create a multi-lingual UI than simply to support the character sets and keyboards needed to express multiple languages. To internationalise a UI, every text string employed in interaction must be translated into all supported languages; then all output of literal strings, and literal parsing of input in UI code must be replaced by hooks to i18n libraries.

It should be noted that "internationalised" does not necessarily mean that a system can be used absolutely anywhere, since simultaneous support for all possible locales is both practically almost impossible and commercially very hard to justify. In many cases an internationalised system includes full support only for the most spoken languages, plus any others of particular relevance to the application.

Scope

Focal points of internationalization and localization efforts include:

  • Language
    • Computer-encoded text
      • Alphabets/scripts; most recent systems use the Unicode standard to solve many of the character encoding problems.
      • Different systems of numerals
      • Writing direction which is e.g. left to right in German, right to left in Persian, Hebrew and Arabic
      • Spelling variants for different countries where the same language is spoken, e.g. localization (en-US, en-CA, en-GB-oed) vs. localisation (en-GB, en-AU)
      • Text processing differences, such as the concept of capitalization which exists in some scripts and not in others, different text sorting rules, etc
      • Plural forms in text output, which differ depending upon language [1]
    • Input
      • Enablement of keyboard shortcuts on any keyboard layout[6]
    • Graphical representations of text (printed materials, online images containing text)
    • Spoken (Audio)
    • Subtitling of film and video
  • Culture
    • Images and colors: issues of comprehensibility and cultural appropriateness
    • Names and titles
    • Government assigned numbers (such as the Social Security number in the US, National Insurance number in the UK, Isikukood in Estonia, and Resident registration number in South Korea.) and passports
    • Telephone numbers, addresses and international postal codes
    • Currency (symbols, positions of currency markers)
    • Weights and measures
    • Paper sizes
  • Writing conventions
    • Date/time format, including use of different calendars
    • Time zones (UTC in internationalized environments)
    • Formatting of numbers (decimal separator, digit grouping)
  • Any other aspect of the product or service that is subject to regulatory compliance

The distinction between internationalization and localization is subtle but important. Internationalization is the adaptation of products for potential use virtually everywhere, while localization is the addition of special features for use in a specific locale. Internationalization is done once per product, while localization is done once for each combination of product and locale. The processes are complementary, and must be combined to lead to the objective of a system that works globally. Subjects unique to localization include:

  • Language translation
  • National varieties of languages (see language localization)
  • Special support for certain languages such as East Asian languages
  • Local customs
  • Local content
  • Symbols
  • Order of sorting (Collation)
  • Aesthetics
  • Cultural values and social context

Business process for internationalizing software

In order to internationalize a product, it is important to look at a variety of markets that your product will foreseeably enter. Details such as field length for addresses, ability to make the zip code field optional to address countries that do not have zip codes, plus the introduction of new registration flows that adhere to local laws are just some of the examples that make internationalization a complex project.[7]

A broader approach takes into account cultural factors regarding for example the adaptation of the business process logic or the inclusion of individual cultural (behavioral) aspects[8].

Coding practice

The current prevailing practice is for applications to place text in resource strings which are loaded during program execution as needed. These strings, stored in resource files, are relatively easy to translate. Programs are often built to reference resource libraries depending on the selected locale data. One software library that aids this is gettext.

Thus to get an application to support multiple languages one would design the application to select the relevant language resource file at runtime. Resource files are translated to the required languages. This method tends to be application-specific and, at best, vendor-specific. The code required to manage date entry verification and many other locale-sensitive data types also must support differing locale requirements. Modern development systems and operating systems include sophisticated libraries for international support of these types.

Difficulties

While translating existing text to other languages may seem easy, it is more difficult to maintain the parallel versions of texts throughout the life of the product. For instance, if a message displayed to the user is modified, all of the translated versions must be changed. This in turn results in a somewhat longer development cycle.

Many localization issues (e.g. writing direction, text sorting) require more profound changes in the software than text translation. For example, OpenOffice.Org achieves this with compilation switches.

To some degree (e.g. for Quality assurance), the development team needs someone who understands foreign languages and cultures and has a technical background. In large societies with one dominant language/culture, it may be difficult to find such a person.

Cost vs benefit tradeoff

In a commercial setting, the benefit from localization is access to more markets. Some argue that the commercial case to localize products into multiple languages is very obvious, and that all is needed is a budgetary commitment from the producer to finance the considerable costs. It costs more to produce products for international markets, but in an increasingly global economy, supporting only one language/market is scarcely an option. Still, proprietary software localization is impacted by economic viability and usually lacks the ability for end users and volunteers to self-localize, as is often the case in open-source environments.

Since open source software can generally be freely modified and redistributed, it is more amenable to localization. The KDE project, for example, has been translated into over 100 languages.[9]



No comments:

Post a Comment