Publications
2019
Katifori, Akrivi; Kourtis, Vasileios; Μποϊλέ, Μαρία; Pavlidis, George; Aliprantis, John; Michalakis, Konstantinos; Caridakis, George
Κέντρο ολοκληρωμένης ψηφιακής διαχείρισης πολιτισμικής κληρονομιάς CultKiosk: Μια ολοκληρωμένη προσέγγιση στα νησιά του Βορείου Αιγαίου Inproceedings
In: 2019.
@inproceedings{inproceedingsb,
title = {Κέντρο ολοκληρωμένης ψηφιακής διαχείρισης πολιτισμικής κληρονομιάς CultKiosk: Μια ολοκληρωμένη προσέγγιση στα νησιά του Βορείου Αιγαίου},
author = {Akrivi Katifori and Vasileios Kourtis and Μαρία Μποϊλέ and George Pavlidis and John Aliprantis and Konstantinos Michalakis and George Caridakis},
year = {2019},
date = {2019-01-01},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
2009
Fotinea, Stavroula-Evita; Efthimiou, Eleni; Caridakis, George; Diamanti, O; Mitsiou, N; Tzafestas, Costas; Maragos, P
DIANOEMA: Visual analysis and sign recognition for GSL modelling and robot teleoperation Inproceedings
In: Proc. of the 8th International Gesture Workshop, Bielefeld, Germany, 2009.
@inproceedings{Foetal2009,
title = {DIANOEMA: Visual analysis and sign recognition for GSL modelling and robot teleoperation},
author = {Stavroula-Evita Fotinea and Eleni Efthimiou and George Caridakis and O Diamanti and N Mitsiou and Costas Tzafestas and P Maragos},
url = {https://www.techfak.uni-bielefeld.de/ags/wbski/GW2009/page6/abstracts/FotineaEA.pdf},
year = {2009},
date = {2009-02-01},
booktitle = {Proc. of the 8th International Gesture Workshop},
address = {Bielefeld, Germany},
abstract = {Here we present research work performed in the framework of the Greek national project DIANOEMA (GSRT, M3.3, id 35), focusing on the following activities: i) Development of innovative image analysis and computer vision algorithms for the effective visual analysis of video sequences, aiming at sign detection and tracking; ii) Creation of a video-corpus of the Greek Sign Language (GSL) and annotation and modelling of an indicative subset of it; iii) Automatic recognition of indicative categories of GSL gestures using automatic computer vision systems pre-trained on the GSL corpus, and combining AI techniques, machine learning and probabilistic analysis for the estimation of gesture instantiations. iv) Integration of the above into a pilot application system of robot tele-operation, on the basis of a pre-defined vocabulary of simple signs for the tele-operation control.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
Here we present research work performed in the framework of the Greek national project DIANOEMA (GSRT, M3.3, id 35), focusing on the following activities: i) Development of innovative image analysis and computer vision algorithms for the effective visual analysis of video sequences, aiming at sign detection and tracking; ii) Creation of a video-corpus of the Greek Sign Language (GSL) and annotation and modelling of an indicative subset of it; iii) Automatic recognition of indicative categories of GSL gestures using automatic computer vision systems pre-trained on the GSL corpus, and combining AI techniques, machine learning and probabilistic analysis for the estimation of gesture instantiations. iv) Integration of the above into a pilot application system of robot tele-operation, on the basis of a pre-defined vocabulary of simple signs for the tele-operation control.
2008
Fotinea, Stavroula-Evita; Efthimiou, Eleni; Karpouzis, K; Caridakis, George
A knowledge-based sign synthesis architecture Journal Article
In: Universal Access in the Information Society, vol. 6, no. 4, pp. 405-418, 2008, ISSN: 1615-5289.
@article{Fotinea:2008:KSS:1341586.1341593,
title = {A knowledge-based sign synthesis architecture},
author = {Stavroula-Evita Fotinea and Eleni Efthimiou and K Karpouzis and George Caridakis},
url = {http://portal.acm.org/citation.cfm?id=1341586.1341593},
doi = {10.1007/s10209-007-0094-8},
issn = {1615-5289},
year = {2008},
date = {2008-01-01},
journal = {Universal Access in the Information Society},
volume = {6},
number = {4},
pages = {405-418},
publisher = {Springer-Verlag},
address = {Berlin, Heidelberg},
abstract = {This paper presents the modules that comprise a knowledge-based sign synthesis architecture for Greek sign language (GSL). Such systems combine natural language (NL) knowledge, machine translation (MT) techniques and avatar technology in order to allow for dynamic generation of sign utterances. The NL knowledge of the system consists of a sign lexicon and a set of GSL structure rules, and is exploited in the context of typical natural language processing (NLP) procedures, which involve syntactic parsing of linguistic input as well as structure and lexicon mapping according to standard MT practices. The coding on linguistic strings which are relevant to GSL provide instructions for the motion of a virtual signer that performs the corresponding signing sequences. Dynamic synthesis of GSL linguistic units is achieved by mapping written Greek structures to GSL, based on a computational grammar of GSL and a lexicon that contains lemmas coded as features of GSL phonology. This approach allows for robust conversion of written Greek to GSL, which is an essential prerequisite for access to e-content by the community of native GSL signers. The developed system is sublanguage oriented and performs satisfactorily as regards its linguistic coverage, allowing for easy extensibility to other language domains. However, its overall performance is subject to current well known MT limitations.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
This paper presents the modules that comprise a knowledge-based sign synthesis architecture for Greek sign language (GSL). Such systems combine natural language (NL) knowledge, machine translation (MT) techniques and avatar technology in order to allow for dynamic generation of sign utterances. The NL knowledge of the system consists of a sign lexicon and a set of GSL structure rules, and is exploited in the context of typical natural language processing (NLP) procedures, which involve syntactic parsing of linguistic input as well as structure and lexicon mapping according to standard MT practices. The coding on linguistic strings which are relevant to GSL provide instructions for the motion of a virtual signer that performs the corresponding signing sequences. Dynamic synthesis of GSL linguistic units is achieved by mapping written Greek structures to GSL, based on a computational grammar of GSL and a lexicon that contains lemmas coded as features of GSL phonology. This approach allows for robust conversion of written Greek to GSL, which is an essential prerequisite for access to e-content by the community of native GSL signers. The developed system is sublanguage oriented and performs satisfactorily as regards its linguistic coverage, allowing for easy extensibility to other language domains. However, its overall performance is subject to current well known MT limitations.
2007
Karpouzis, K; Caridakis, George; Fotinea, Stavroula-Evita; Efthimiou, Eleni
Educational resources and implementation of a Greek sign language synthesis architecture Journal Article
In: Computers & Education, vol. 49, no. 1, pp. 54-74, 2007, ISSN: 0360-1315, (Web3D Technologies in Learning, Education and Training).
@article{Karpouzis2007,
title = {Educational resources and implementation of a Greek sign language synthesis architecture},
author = {K Karpouzis and George Caridakis and Stavroula-Evita Fotinea and Eleni Efthimiou},
url = {http://www.sciencedirect.com/science/article/B6VCJ-4H4V6WF-1/2/7485593c58f51483c6da1d049922c501},
doi = {DOI: 10.1016/j.compedu.2005.06.004},
issn = {0360-1315},
year = {2007},
date = {2007-01-01},
journal = {Computers & Education},
volume = {49},
number = {1},
pages = {54-74},
abstract = {In this paper, we present how creation and dynamic synthesis of linguistic resources of Greek Sign Language (GSL) may serve to support development and provide content to an educational multitask platform for the teaching of GSL in early elementary school classes. The presented system utilizes standard virtual character (VC) animation technologies for the synthesis of sign sequences/streams, exploiting digital linguistic resources of both lexicon and grammar of GSL. Input to the system is written Greek text, which is transformed into GSL and animated on screen. To achieve this, a syntactic parser decodes the structural patterns of written Greek and matches them into equivalent patterns of GSL, which are then signed by a VC. The adopted notation system for the representation of GSL phonology incorporated in the system's lexical knowledge database, is Hamburg Notation System (HamNoSys). For the implementation of the virtual signer tool, the definition of the VC follows the h-anim standard and is implemented in a web browser using a standard VRML plug-in.},
note = {Web3D Technologies in Learning, Education and Training},
keywords = {},
pubstate = {published},
tppubtype = {article}
}
In this paper, we present how creation and dynamic synthesis of linguistic resources of Greek Sign Language (GSL) may serve to support development and provide content to an educational multitask platform for the teaching of GSL in early elementary school classes. The presented system utilizes standard virtual character (VC) animation technologies for the synthesis of sign sequences/streams, exploiting digital linguistic resources of both lexicon and grammar of GSL. Input to the system is written Greek text, which is transformed into GSL and animated on screen. To achieve this, a syntactic parser decodes the structural patterns of written Greek and matches them into equivalent patterns of GSL, which are then signed by a VC. The adopted notation system for the representation of GSL phonology incorporated in the system's lexical knowledge database, is Hamburg Notation System (HamNoSys). For the implementation of the virtual signer tool, the definition of the VC follows the h-anim standard and is implemented in a web browser using a standard VRML plug-in.
2005
Caridakis, George; Karpouzis, K; Sapountzaki, Galini; Fotinea, Stavroula-Evita; Efthimiou, Eleni
A dynamic environment for Greek Sign Language Synthesis using virtual characters Inproceedings
In: Proc. of the Web3D 2005 Symposium, Workshop on Education and Training, Bangor, UK, 2005.
@inproceedings{Caridakis_et_al2005,
title = {A dynamic environment for Greek Sign Language Synthesis using virtual characters},
author = {George Caridakis and K Karpouzis and Galini Sapountzaki and Stavroula-Evita Fotinea and Eleni Efthimiou},
url = {https://www.academia.edu/15299292/A_dynamic_environment_for_Greek_Sign_Language_Synthesis_using_virtual_characters},
year = {2005},
date = {2005-03-01},
booktitle = {Proc. of the Web3D 2005 Symposium, Workshop on Education and Training},
address = {Bangor, UK},
abstract = {In this paper, we present a system that performs sign language synthesis in the framework of an educational platform for young deaf children. The proposed architecture is based on standardized virtual character animation concepts for the synthesis of sign sequences and lexicon-grammatical processing of Greek sign language (GSL) sequences. A major advantage of the proposed architecture is that it goes beyond the usual single-word approach which is linguistically incorrect, to provide tools to dynamically construct new sign representations from similar ones. Words and phrases are being processed and the resulting notation subset of a lexical database, HamNoSys (Hamburg Notation System), eventually transformed into GSL and animated on the clients’ side via an h-anim compliant avatar.},
keywords = {},
pubstate = {published},
tppubtype = {inproceedings}
}
In this paper, we present a system that performs sign language synthesis in the framework of an educational platform for young deaf children. The proposed architecture is based on standardized virtual character animation concepts for the synthesis of sign sequences and lexicon-grammatical processing of Greek sign language (GSL) sequences. A major advantage of the proposed architecture is that it goes beyond the usual single-word approach which is linguistically incorrect, to provide tools to dynamically construct new sign representations from similar ones. Words and phrases are being processed and the resulting notation subset of a lexical database, HamNoSys (Hamburg Notation System), eventually transformed into GSL and animated on the clients’ side via an h-anim compliant avatar.