Bengali/Bengali
From the LDC Language Resource Wiki
(Wikimedia license links) |
m (→Unicode) |
||
Line 100: | Line 100: | ||
* Pennsylvania State University [http://tlt.its.psu.edu/suggestions/international/bylanguage/bengali.html information page]. | * Pennsylvania State University [http://tlt.its.psu.edu/suggestions/international/bylanguage/bengali.html information page]. | ||
**[http://tlt.psu.edu/suggestions/international/bylanguage/bengalichart.html Penn State chart of Unicode Entity Codes for the Bengali (Bangla) Script] (including OS X and Windows keyboard entry) | **[http://tlt.psu.edu/suggestions/international/bylanguage/bengalichart.html Penn State chart of Unicode Entity Codes for the Bengali (Bangla) Script] (including OS X and Windows keyboard entry) | ||
- | * White, Andy. (2003). [http://www.exnet.btinternet.co.uk/ Exnet]. | + | * White, Andy. (2003). [http://www.exnet.btinternet.co.uk/ Exnet]. {{Heavy quotes|This site hosts documents relating to the encoding of Indic scripts. Most documents contain a bias towards the Bengali script (due to my own preferances).}} (Last updated 10th March 2003) |
====ISCII==== | ====ISCII==== |
Revision as of 07:22, 14 May 2010
Contents |
General
Language summary
(Information from Ethnologue, 2009-05-13)
- ISO 639-3 code: ben
- Spoken in: Western Bangladesh, India, Nepal, and diaspora
- Population: 100,000,000 in Bangladesh (1994 UBS). 211,000,000 including second-language speakers (1999 WA). Population total all countries: 171,070,202.
- Alternate names: Banga-Bhasa, Bangala, Bangla
- Dialects: Languages or dialects in the Bengali group according to Grierson (1903-1928): Central (Standard) Bengali, Western Bengali (Kharia Thar, Mal Paharia, Saraki), Southwestern Bengali, Northern Bengali (Koch, Siripuria), Rajbanshi, Bahe, Eastern Bengali (East Central, including Sylhetti), Haijong, Southeastern Bengali (Chakma), Ganda, Vanga, Chittagonian (possible dialect of Southeastern Bengali).
- Classification: Indo-European, Indo-Iranian, Indo-Aryan, Eastern zone, Bengali-Assamese
- Script: Bengali
Linguistic notes
Morphology
Bengali marks plural by means of several different suffixes, the choice depending on the noun, and several cases, again by means of several different suffixes.
Writing System
Bengali is written in a Brahmi derivative, with ligatures, and with vowel markers located in various positions around the consonant.
- Omniglot
- Wikipedia: Bengali script (CC-BY-SA),(GFDL)
- Bengali script notes [Draft], Richard Ishida. [Last update 2005-02-04]
Linguistic resources
- Bhattacharya, Tanmoy. (2001): Bengali. In Facts About the World's Languages: An Encyclopedia of the World's Major Languages: Past and Present, ed. Jane Garry and Carl Rubino. New York / Dublin: H.W. Wilson Press. ISBN 0824209702.
- Klaiman, M. H. (1987): Bengali. In The World's Major Languages, ed. Bernard Comrie, pp. 490-513. Oxford University Press. ISBN 978-0195065114.
Grammar
- Milne, W. S. (1993): A Practical Bengali Grammar. Laurier Books Ltd. ISBN 8120608771. 562 pp.
- Mojumder, Atindra (1973): Bengali Language Historical Grammar. Calcutta: Firma K. L. Mukhopadhyay.
- Smith, W. L. (1997): Bengali Reference Grammar. Stockholm: Association of International Studies. Stockholm Oriental Textbook Series 1. ISBN 9197085472. 197 pp.
Lexicon
- Akhor: An English to Bengali "translation" tool is included in a large package downloadable from this site. It appears to be a large dictionary, so it could be fed a list of English words, and would output a list of Bengali words. Encoding is unclear.
- Carey, William (1761-1834). A Dictionary of the Bengali Language. Laurier Books Ltd. 2160 pp. ISBN 8120600940.
- Dev, Ashu Tosh (1961): Students' Favourite Dictionary: Bengali to English. 28th ed. Dev Sahitya Kutir. 998 p. ISBN 8173043418. Reprint. USD 7.75.
- Also: 1961, 1291 pp. Calcutta: S.C. Mazumder.
- Digital Dictionaries of South Asia at the University of Chicago:
- GNU Dictionary: Monolingual dictionary, used by GNU project spell checker.
- LTRC: Two Bengali-Hindi dictionaries, but no English glosses. ISCII encodings. There is also an English-Hindi dict, so it might be possible to cross-correlate entries. GPL license.
- Online Bangla Obhidhan: Online lexicon, at least 6k unique entries. Akkhor encoding converter appears to work. This page gives gif of Bangla chars instead.
- Virtual Bangladesh: Dictionary: On-line lexicon, claims 3k words. Results are displayed in a romanization and "often" in Bangla script using a Unicode font.
- Wiktionary. Unicode. Monolingual. 21,347 entries. (CC-BY-SA),(GFDL) [Mamandel 16:27, 3 May 2010 (UTC)]
Topical word lists
- Common Names in Bangla: Names of plants in Bengali with their scientific names
Names
- Babynology: List of Bengali baby names in Roman transliteration
Phrasebooks
- Bengali Script
- Roman transliteration
- travlang.com: transliteration with sound files
Writing
- Bagchi, Tista (1996): "Bengali Writing," in William Bright and Peter Daniels (eds.) The World's Writing Systems. New York: Oxford University Press. pp. 399-403. ISBN 0-19-507993-0.
Monographs
- Bayer, Josef (2001): "Two grammars in one: sentential complements and complementizers in Bengali and other South-Asian languages," in Peri Bhaskararao and Karamuri Venkata Subbarao (eds.) The Yearbook of South Asian Languages and Linguistics: Tokyo Symposium on South-Asian Languages - Contact, Convergence and Typology. New Delhi: Sage Publications. PDF
- Butt, Miriam (2001): "Case, agreement, pronoun incorporation, and pro-drop in South Asian languages," handout for talk presented at the workshop The Role of Agreement in Argument Structure, August 31-September 1, 2001, Utrecht.
- Dirdal, Hildegunn: "The acquisition of articles by Bengali learners of English". Handout?
- Fitzpatrick-Cole, Jennifer (1994): The Prosodic Domain Hierarchy in Reduplication. Ph.D. dissertation, Stanford.
- Fitzpatrick-Cole, Jennifer (1996): "Reduplication meets the phonological phrase in Bengali," Linguistic Review 13.305-356.
- Ghosh, Sanjukta and Probal Dasgupta: "The role of classifiers in quantification," Handout for talk presented at the 21st South Asian Language Analysis Roundtable, October 7-10, University of Konstanz.
- Keane, Elinor (2001): Echo Words in Tamil. Unpublished Ph.D. dissertation, Merton College, Oxford. Contains a fairly extensive discussion of echo words in Bengali.
- Khan, Zeeshan (1994): "Bangla Verb Classes and Alternations," in Douglas A. Jones, Robert C. Berwick, Franklin Cho, Zeeshan Khan, Karen T. Kohl, Naoyuki Nomura, Anand Radhakrishnan, Ulrich Sauerland, and Brian Ulicny, Verb Classes and Alternations in Bangla, German, English, and Korean (AI Memo # 1517). Cambridge, Massachusetts: MIT. pp. 36-50.
- Lahiri, Aditi and Jennifer Fitzpatrick-Cole (1999): "Emphatic Clitics and Focus Intonation in Bengali," in René Kager & Wim Zonneveld (eds.) Phrasal Phonology. Pp. 119-144 Dordrecht: Foris.
Linguistic portals and bibliographies
Encoding and Fonts
Before the development and general use of Unicode, computer use of Bengali and other South Asian languages required special fonts using only one byte. Many of these fonts were specific to one website or another and used idiosyncratic encodings. To some extent that is still the case; and so this page includes some such sites (see News), and some resources for specific fonts and encoding converters. See, for example, eThikana below.
In addition, the Bureau of Indian Standards supports its own ISCII standard (below), which provides an 8-bit encoding using escape sequences to announce the language of the following coded character sequence.
Encodings
Unicode
The Unicode range for Bengali is 0980-09FF.
- Constable, Peter (2004): Encoding of Bengali Khanda Ta in Unicode. Unicode Consortium Public Review Issue #30.
- Pennsylvania State University information page.
- Penn State chart of Unicode Entity Codes for the Bengali (Bangla) Script (including OS X and Windows keyboard entry)
- White, Andy. (2003). Exnet. Template:Heavy quotes (Last updated 10th March 2003)
ISCII
See ISCII.
Sutonny
This 8-bit encoding is used by a number of news sites. See Poroshmoni under Conversion, and Bangla.com: Sutonny under Fonts.
ITRANS and CS/CSX
ITRANS is a transliteration package, no longer supported but still available. Provides two input encodings:
- ITRANS: 7-bit; uses multi-character English codes to represent each Bengali letter
- CS/CSX: 8-bit; uses one-character codes
The 8-bit encoding, at least, is still used on some sites. See ItxBeng under Fonts.
Fonts
- Ekushey. Twelve Unicode fonts.
- eThikana. All are 8-bit. Grouped by encoding:
- Sutonny encoding: Oporajita (≠ Aparajita), Sulekha, MahouaMJ.
- AdarshaBangla
- AdarshaLipi, Moina
- Aparajita (≠ Oporajita)
- Basundhara
- Boishakhi
- Ekush, Falgun
- Progoty
- SonarGaon
- ItxBeng is part of the ITRANS transliteration package. The itxbeng.ttf TrueType font uses an 8-bit encoding. It is also available from RabindraSangeet.org.
- Omicron Lab. Unicode fonts for Bengali
- Penn State University. (2009.) Browser and Font Recommendations for Bengali. Also information on Setup for Keyboarding.
- Rezaul: The site is a portal of sorts; this directory has links to fonts and encoding documentation.
- South Asia Language Resource Center of the University of Chicago. Links to Bengali fonts (most of them available for free download), input schemes and keyboard layouts, and information about Mac vs. PC vs. Linux rendering issues.
Also:
- Microsoft. Creating and supporting OpenType fonts for the Bengali script: Microsoft doc on Unicode 3.1 for Bengali. "Registered features of the Bengali script are defined and illustrated, encodings are listed, and templates are included for compiling Bengali layout tables for OpenType fonts. This document also presents information about the Bengali OpenType shaping engine of Uniscribe, an operating system component responsible for text layout."
Conversion
- Unicodify: From Lancaster University, producers of Emille corpus. Includes conversion for AdarshaLipi, AdarshaLipiExp, and AdarshaLipiNormal2 fonts among others. Runs on Windows (source code available).
- Unicode Consortium: FAQ on Indic Scripts and Languages lists these conversion tools:
- Microsoft's Visual OpenType Layout Tool (VOLT)
- Apple's Font Tools
- Adobe's Font Development Kit
- Pyrus' FontLab
- PFAEDIT (X-11-based, for Mac OSX, Cygwin, etc.) (for the Linux OS)
- Poroshmoni: Firefox plug-in by Rifat Nabi: convert specific non-Unicode newspaper sites to Unicode 4.2. Ver.0.3 (2008-12-22) works with Firefox 1.5–3.0 but not newer versions. See also developer's site with user discussion blog.
All these sites but Prathom-Alo are in Sutonny encoding now. Prathom-Alo is in Unicode (see this comment on the Poroshmoni site) but their archives may not be.
Transliteration
- ALA-LC Transliteration Table (American Library Assn. - Library of Congress)
- Indian Language Converter: Type in Roman characters according to the Bengali character chart on the page and get Bengali text and HTML. On-web or download with GNU GPL. E.g.:
- Roman input: bMlaa
Bengali output: বংলা
HTML output: বংলা<br/>
- Roman input: bMlaa
- ITRANS 5.30: Chopde, Avinash. Uses ItxBeng 8-bit font. No longer supported but still available [Accessed 2009-09-5]. "A package for printing text in Indian languages using English-encoded input." [domain, aczoom.com, was formerly www.aczone.com]
Data Sources
Monolingual Text
- EMILLE corpus. Free license for non-profit research use. Approximately 5,520,000 words. Documentation
- Wikipedia. Unicode. 21,347 articles. (CC-BY-SA),(GFDL) [Mamandel 16:28, 3 May 2010 (UTC)]
News and portals
- Newspaper portals:
- BBC
- Bhorerkagoj (Sutonny encoding*)
- China Radio International, Bengali
- The Daily Amadershomoy (Sutonny encoding*)
- Daily Jugantor (Sutonny encoding*)
- Deutsche Welle Bengali
- Inqilab
- Ittefaq (Sutonny encoding*)
- The Jaijaidin (Sutonny encoding*)
- Janakantha
- Manabzamin (Sutonny encoding*)
- NHK in Bengali
- Prathom-Alo (Unicode, but see note*)
- UKBD News (UK and Bangladesh)
* see Poroshmoni under Conversion, and Bangla.com: Sutonny under Fonts
Blogs
- Banglablogs: Blog portal. Some of the blogs are in Bengali, some in English.
- Ashikshams
- Banglapundit
Parallel Text
- Ahsania: Religious (English, French, Spanish versions)
- Argentina - The Revolution has begun: Approx 13 pg article, from the website "In Defence of Marxism". English version
- Bangladesh Awami League: A pair of parallel articles: Bengali and English. Bengali texts seem to be in PDF, with an unknown encoding. Archives
- Bangla Proverbs
- Bengali in GNU/Linux HOWTO; Bangla Translation
- Bengali Poetry
- Colonel Taher: commemorating a colonel in Bangladesh war of independence; some political and news content. Bengali is in Unicode. English is not as complete as Bengali.
- EMILLE corpus. 200,000 words of text in English (information leaflets from the UK Government and various local authorities) with Bengali translation. Free license for non-profit research use.
- W3C documents: translation of "Quick Tips to Make Accessible Web Sites"; very small
Speech
- EMILLE corpus. Free license for non-profit research use. 442,000 words from radio broadcasts, plus "small amounts of demographically-sampled speech"
- BBC.
- VOA.
Portals
- Bangla
- Bangladesh-America
- Bengali Language Directory
- Bombay History
- Virtual Bangladesh
- Cyber Bangladesh: a variety of links to news profiles, literature, encyclopedias, songs, tourist information, fonts, etc.
- University of Cambridge International Examinations website
- Periodicals to support O Level Bengali
- Language Skills Practice to support O Level Bengali: Suggested resources for teachers to support the delivery of the syllabus
- http://www.Bangladesh.net
- http://www.bbc.co.uk/bengali
- http://www.indiamatch.com
Tools and Other NLP Resources
- Ankur: Project to support Bengali, mostly on XServer but some on GNU Linux. [Page last updated 2006-08-17; accessed 2009-04-20]
Includes- OpenOffice 2.0
- Bengali word list with over 100,000 words for GNU Aspell
- bspeller: "Light weight text editor with a Bengali spell checker"; runs under Linux. (The spell checker uses the Gnu Aspell program, and might be runnable as a stand-alone.)
- Bangla in GNU/Linux HOWTO: A document on developing Bengali resources for GNU/Linux, and also about setting locales etc. for Bengali.
- Bhattacharya, Samit, & Choudhury, Monojit, & Sarkar, Sudeshna, & Basu, Anupam (2005): Inflectional morphology synthesis for Bengali noun, pronoun, and verb systems. National Conference on Computer Processing of Bangla. Independent University, Bangladesh.
- bwedit: Bengali text editor for X11, writtin in Tcl/Tk. Can export ISCII.
- Dasgupta, Sajib and Vincent Ng (2007). Unsupervised morphological parsing of Bengali. Language Resources and Evaluation 40:3-4, pp. 311-330. Springer. DOI 10.1007/s10579-007-9031-y
- Faridee, Abu Zaher Md., and Francis M. Tyers. 2009. Development of a morphological analyser for Bengali. In Proceedings of the First International Workshop on Free/Open-Source Rule-Based Machine Translation, 2-3 November 2009, Universitat d’Alacant, Alacant, Spain; ed. Juan Antonio Pérez-Ortiz, Felipe Sánchez-Martínez, Francis M.Tyers; pp. 43-50. PDF, 351KB.
- indicbhaaratii: portal is meant for a collaboration effort for Indian Language Computing
- Janabhaaratii: Localisation of Free/Open Source Software for Indian languages
- Lekho: Bengali Unicode text editor, runs under UNIX and MS Windows.