Panjabi/Panjabi

From the LDC Language Resource Wiki

Revision as of 20:19, 23 June 2009 (view source) Mamandel (Talk | contribs) (New page: <center><font size=7> ਪੰਜਾਬੀ </font> <font size=7>PANJABI</font> <font size=6>(Eastern Panjabi, Gurmukhi)</font> </center> Panjabi ==General== Thi...) ← Older edit		Revision as of 20:20, 23 June 2009 (view source) Mamandel (Talk | contribs) (→ISCII) Newer edit →
Line 80:		Line 80:
	====ISCII====		====ISCII====
-	See [[Lwiki:ISCII]].	+	The Bureau of Indian Standards supports its own encoding standard. See [[ISCII]].
	====Gurbani====		====Gurbani====

---

Revision as of 20:20, 23 June 2009

ਪੰਜਾਬੀ

PANJABI

(Eastern Panjabi, Gurmukhi)

Contents 1 General 1.1 Dialects 1.1.1 Eastern Panjabi 1.1.2 Western Panjabi 1.2 Linguistic notes 1.2.1 Writing 2 Linguistic resources 2.1 Grammars 2.2 Lexicons 2.2.1 Names 2.3 Monographs 2.4 Linguistic portals and bibliographies 3 Encoding and Fonts 3.1 Encodings 3.1.1 Unicode 3.1.2 ISCII 3.1.3 Gurbani 3.2 Fonts 3.2.1 Conversion 3.2.2 Transliteration 4 Data Sources 4.1 Monolingual Text 4.1.1 News 4.1.2 Other 4.2 Parallel Text 4.3 Speech 4.4 Video 4.5 IPR notes 5 Portals 6 Tools and Other NLP Resources 7 Miscellaneous

General

This document pertains primarily to Eastern Panjabi (Gurmukhi). There is some material on Western Panjabi as well.

Dialects

Eastern Panjabi

(Information from Ethnologue, 2009-05-13)

• ISO 639-3 code: pan
• Spoken in: India: Punjab, Majhi in Gurdaspur and Amritsar districts, Bhatyiana in South Firozpur District; Rajasthan, Bhatyiana in north Ganganagar District; Haryana; Delhi; Jammu and Kashmir. Also spoken in Bangladesh and diaspora.
• Population: 27,109,000 in India
• Alternate names: Punjabi, Gurmukhi, Gurumukhi
• Dialects: Panjabi Proper, Majhi, Doab, Bhatyiana (Bhatneri, Bhatti), Powadhi, Malwa, Bathi. Western Panjabi is distinct from Eastern Panjabi, although there is a chain of dialects to Western Hindi (Urdu).
• Classification: Indo-European, Indo-Iranian, Indo-Aryan, Central zone, Panjabi
• Script: Gur(u)mukhi and Devanagari

Western Panjabi

Information from Ethnologue, 2009-05-13

• ISO 639-3 code: pnb
• Spoken in: Mainly in the Punjab area of Pakistan.
• Population: 60,647,207 in Pakistan (2000 WCD).
• Alternate names: Western Punjabi, Lahnda, Lahanda, Lahndi
• Dialects: There is a continuum of varieties between Eastern and Western Panjabi, and with Western Hindi and Urdu. 'Lahnda' is a name given earlier for Western Panjabi; an attempt to cover the dialect continuum between Hindko, Pahari-Potwari, and Western Panjabi in the north and Sindhi in the south.
• Classification: Indo-European, Indo-Iranian, Indo-Aryan, Northwestern zone, Lahnda
• Script: Perso-Arabic

Linguistic notes

Writing

Eastern Panjabi is usually written with the Brahmi-derived Gurmukhi script, and sometimes, especially by Hindus, with Devanagari. Western Panjabi is usually written in Shahmukhi, a variant of the Arabic writing system very similar to the writing system of Urdu.

Linguistic resources

Grammars

Lexicons

• Digital Dictionaries of South Asia, U. of Chicago. "Singh, Maya. The Panjabi dictionary. Lahore, Munshi Gulab Singh & Sons, 1895. This title is currently being entered by a data entry contractor. The dictionary will be functional on this site by January 2009." [Accessed 2009-05-18]
• Punjabonline English <-> Punjabi Dictionary]. On-line; size unknown. Can toggle English or Punjabi data entry. Gurbani 8-bit encoding.
• Srigranth.org English to Punjabi Dictionary. On-line; medium size? Gurbani 8-bit encoding.
• Wiktionary (Panjabi). Monolingual. Gurmukhi script, Unicode.

Names

These sites do not distinguish names by sex.

• 5abi: 8-bit Gurbani encoding.
• Babynology: List of Panjabi baby names in Roman transliteration. (Each name appears twice, once for each sex.)
• Sikh Names. Transliteration, with meanings.
• Sushmajee: About 1000 names. Transliteration.

Monographs

Linguistic portals and bibliographies

• Bashir, Elena. Resources for the Study of Panjabi. SALRC. [Last modified Dec., 2006; most recent date in content is 2000]
• Indian Language Data Centre (ILDC), part of the Technology Development for Indian Languages project of the Indian Department of Information Technology.
• South Asia Language Resource Center at the University of Chicago (SALRC)

Encoding and Fonts

Before the development and general use of Unicode, computer use of Panjabi and other South Asian languages required special fonts using only one byte. Many of these fonts were specific to one website or another and used idiosyncratic encodings. To some extent that is still the case; and so this page includes some such sites (see News), and some resources for specific fonts and encoding converters.

Encodings

Unicode

The Unicode range for Gurmukhi is 0A00-0A7F.

• Panjabi.html Penn State info page; Panjabichart.html Penn State chart of Unicode Entity Codes for ____ (including OS X and Windows keyboard entry)
• Exnet, Andy White. "This site hosts documents relating to the encoding of Indic scripts. Most documents contain a bias towards the Bengali script (due to my own preferances)." (Last updated 10th March 2003)

ISCII

The Bureau of Indian Standards supports its own encoding standard. See ISCII.

Gurbani

An 8-bit encoding used by a number of sites.

Fonts

• Alan Wood’s Unicode Resources: Unicode fonts for Windows computers; search for Gurmukhi.
• ILDC. PNOT-Amar Normal, a Unicode font.
• SALRC:
  • Gurmukhi fonts, most of them available for free download
  • Input Schemes and Keyboard Layouts
  • information about Mac vs. PC vs. Linux rendering issues
• SikhNet. A wide variety of styles in the 8-bit Gurbani encoding, many credited to Kulbir S. Thind, M.D.
• Wazu Japan's Gallery of Unicode Gurmukhi fonts, and test page

Conversion

• GUCA: Gurmukhi Unicode Conversion Application. GNU GPL. Requires Microsoft .NET Framework. Converts ASCII encoded, font-based Gurmukhi text based on Dr. Thind's fonts (e.g. AnmolLipi, GurbaniLipi fonts) into Unicode. Also includes a custom mapping engine to add encodings. -- Although the site for "Dr. Thind's fonts" now uses Unicode, many other sites still use these 8-bit encodings. See SikhNet, above.
• Unicodify: From Lancaster University, producers of the Emille corpus. For Windows; source code available.

Transliteration

• Indian Language Converter. Type in Roman characters according to the Gurmukhi character chart on the page and get Gurmukhi text and HTML. On-web or download with GNU GPL. E.g.:

  Roman input: guramukhee
  Gurmukhi output: ਗੁਰਮੁਖੀ
  HTML output: &#2583;&#2625;&#2608;&#2606;&#2625;&#2582;&#2624;<br/>

Data Sources

Monolingual Text

• EMILLE corpus. Free license for non-profit research use.

News

• 5abi Partly Unicode, partly Gurbani.
• Ajit Weekly. Unicode.
• Quamiekta. Unicode.
• Sanjh Savera Panjabi newspaper from Canada. Gurbani encoding.
• Yahoo! India. Unicode.

Other

• Academy of the Punjab in North America: English, Gurmukhi, and Shahmukhi, but many of the texts are imaged.
• Eh Din. Sikh website, has archives.
• Rationalist Society of India Gurbani encoding.

Parallel Text

• EMILLE corpus. 200,000 words of text in English (information leaflets from the UK Government and various local authorities) with Eastern Panjabi translation. Free license for non-profit research use.

• Domestic Violence Information. Leaflets from various agencies in many languages. Unicode.

COPIED FROM Lwiki:LCTL Panjabi harvest#* Bilingual Text, STILL EDITING

• Eastbourne Borough Council. Links to a lot of gov and org sites in the UK with pages in many languages.

• GUCA. belong here too? Panjabi computing resource that is also parallel English and Panjabi

• Law Society. These titles look familiar, we should check if they are already included in EMILLE corpus

• Bible. Amazon.com links for print editions.

• Guru Granth Sahib. Sikh holy texts, word lists, concordances, interlinear translations. Panjabi (Gurmukhi, Shahmukhi, Devanagari) and English. Some files Unicode, but some Gurbani encoding.

• Punjabi Online: Mool Mantar. Religious text. Interlinear, with Panjabi in Gurbani encoding, grouped as (Panjabi₁, transliteration₁, Panjabi₂, English). Panjabi₂, may be commentary on Panjabi₁, and only the commentary translated.

RESUME HERE

• Punjabilok: Font
  • In this site we can download the font and then we can see the translated version of this site

• Redhat: Reference Guide

• Redhat: Release Notes
  • (3.7.0 and up are bilingual)

• Redhat: RHEL-4 Manuals

• Religious Passages
  • http://www.greatcom.org/laws/punjabi
  • (n-way ||)

• Sikh Videos

• Sikhnet: Gurbani
  • Religious text

• Sikhnet: GuruGranthSahib
  • Religious text

• Sridasam
  • Religious text
  • 1466/2326 pages with parallel segments

• UK Gov't Leaflets
  • http://www.hse.gov.uk/languages/ (languages)
  • http://www.hse.gov.uk/contact/index.htm (english)
  • http://www.thepensionservice.gov.uk/resourcecentre/other-languages/punjabi.asp
  • http://www.babyfriendly.org.uk/parents/punjabi.asp
  • http://www.victimsupport.org/vs_england_wales/about_us/publications/leaflet_translations/punjabi/index.php
  • http://www.chooseandbook.nhs.uk/documents/implementation/commsmaterials/langs/punjabi.pdf

Speech

Video

still checking and editing

• Apna Channel (Pakistan)
• RAVi TV (US: "programmed by and for Punjabi natives residing in the United States")
• DD Punjabi (India)
• Balle Balle (India. "Currently not transmitting" [2009-05-15])
• Alpha ETC Punjabi (UK): Zee: Alpha Punjabi was launched in October 1999 in India. A majority stake in ETC was acquired in 2002 which gave birth of Alpha ETC Punjabi. The channel was brought to the USA in July 2005 as the only Punjabi language channel on the platform. The channel captures the spirit of the audiences catering to their preferences. Alpha ETC Punjabi has a variety of offerings for everybody, providing a full range of quality Punjabi language entertainment for the entire family.
• MH1 (India)
• Punjab Today (India)
• Vectone Punjab (UK)
• NRI
• WatchIndia.TV
  • ETC Channel Punjabi (India)
  • Zee Punjabi (india)

IPR notes

Portals

• Academy of the Punjab in North America: Literature, forums, other. English, Gurmukhi, and Shahmukhi, but many of the texts are imaged.
• Punjabi Network: Forums, blogs, videos? Panjabi, romanized Panjabi, and English. Signup required for some features.

Tools and Other NLP Resources

Miscellaneous