CG/LT/corpus infrastructure threatened at SDU

39 views
Skip to first unread message

Eckhard Bick

unread,
May 8, 2023, 6:45:37 AM5/8/23
to Constraint Grammar, Tino Didriksen
Dear all,

Motivated by politically forced downsizing requirements, SDU has decided
to close entire sections of its research and teaching activities.
Specifically, the Department of Language, Culture, History and
Communication has decided to discontinue its language technology
activities, which concerns the infrastructure and people behind VISL,
Corpuseye and CG-based research.

If you think this infrastructure is important and should be maintained
despite the university's financial situation, please send us a support
mail. Especially if you have personal or institutional arguments for
doing so as a user.

We will collect your mails and use them to influence the decision makers.

Best,

Eckhard Bick & Tino Didriksen




--
Eckhard Bick,
cand.med., dr.phil.
University of Southern Denmark
e-mail: eckhar...@gmail.com
web: http://beta.visl.sdu.dk

Tino Didriksen

unread,
May 8, 2023, 8:13:02 AM5/8/23
to constrain...@googlegroups.com
The reason we're asking for any feedback to be sent directly to us, is that we don't precisely know who the final recipient or decision maker is. The only feedback channel we're given is the legally mandated "partshøring" appeal hearing, and their letter to us says the university Rector will make the final decision - whether it is rector alone, the combined leadership, or some advisory construction, we don't know.

Additionally, the appeal hearing is a legal remedy meant for unjust dismissals, which doesn't quite fit an economic cutback. But as it is the only channel we're given, we will try to make the most of it.

Deadline is May 16th - we need to send a combined package before 17th.

-- Tino Didriksen


--
You received this message because you are subscribed to the Google Groups "Constraint Grammar" group.
To unsubscribe from this group and stop receiving emails from it, send an email to constraint-gram...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/constraint-grammar/6afe14e8-3044-0e3d-7070-b23a387231cf%40mail.dk.

JOSE MARIA ARRIOLA

unread,
May 8, 2023, 9:06:18 AM5/8/23
to constrain...@googlegroups.com

Hi,
As a member of the Hitz group I express my disagreement with the decision to cease the research activities of VISL and CG.
Jose Mari Arriola
HiTZ: Basque Center for Language Technology
https://www.hitz.eus/en

'Eckhard Bick' via Constraint Grammar <constrain...@googlegroups.com> escribió:

Hèctor Alòs i Font

unread,
May 8, 2023, 2:57:09 PM5/8/23
to constrain...@googlegroups.com, Tino Didriksen
As a member of the Apertium collective and developer of machine translators for several endangered and under-resourced Romance languages, I would like to express my dismay at the decision to discontinue research and teaching activities on language technology and most especially those related with VISL and CG. These tools are one of the pillars for our developments for languages such as Aragonese, Asturian, Occitan, Arpitan, Sardinian and Sicilian. These languages lack automatic translators developed by the large multinational companies and are unlikely to have them due to the small number of electronic resources available in them. I know positively that, for the same reasons, these tools are being actively used by colleagues for dozens of other endangered and/or under-resourced languages on all five continents.

Hèctor Alòs i Font
Apertium and Research Centre for Sociolinguistics and Communication (Universitat de Barcelona)

Missatge de 'Eckhard Bick' via Constraint Grammar <constrain...@googlegroups.com> del dia dl., 8 de maig 2023 a les 13:45:

Detmar Meurers

unread,
May 8, 2023, 3:58:50 PM5/8/23
to 'Eckhard Bick' via Constraint Grammar, Tino Didriksen
Dear Eckhard, dear Tino,

at a time when language technology such as ChatGPT is receiving more
public attention than ever, so aptly highlighting the importance of
language data as a reflection of our world(s), the idea to close down
a language technology group conveys an absurd lack of understanding,
which we must speak up against.

Especially also considering the fact that for lower resource languages
(i.e. the vast majority of languages) a brute force approach relying
solely on vast corpus data is not an option, the tools you have
developed and supported are crucial building blocks for these
languages and the European multilangual mission. Just today, Mikel
Iruskieta and I were talking about CG3-based analyses of Basque for
research and tool development targeting readability analysis and
language proficiency classification.

In what form do you plan to document the support - are you collecting
official letters on letterhead as pdfs? And if you haven't already
done so, sending a message to a more widely read list may be useful to
whip up the tsunami of support that your language technology group
deserves.

All the best,
Detmar


On Mon, May 08, 2023 at 12:45:34PM +0200, 'Eckhard Bick' via Constraint Grammar wrote:
> !-------------------------------------------------------------------|
> This Message Is From an External Sender
> This message came from outside your organization.
> |-------------------------------------------------------------------!
> web: https://urldefense.com/v3/__http://beta.visl.sdu.dk__;!!KGKeukY!3g-PJSa-l0KPLVJv2FbmtXL7RGh7g2q_vGxEKP2qimPhDN3UmpcCHsa0nw9WMw0D6Qs8IqC_wYiNK3a0pLupVvDsh0ln_715pu9j$
>
> --
> You received this message because you are subscribed to the Google Groups "Constraint Grammar" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to constraint-gram...@googlegroups.com.
> To view this discussion on the web visit https://urldefense.com/v3/__https://groups.google.com/d/msgid/constraint-grammar/6afe14e8-3044-0e3d-7070-b23a387231cf*40mail.dk__;JQ!!KGKeukY!3g-PJSa-l0KPLVJv2FbmtXL7RGh7g2q_vGxEKP2qimPhDN3UmpcCHsa0nw9WMw0D6Qs8IqC_wYiNK3a0pLupVvDsh0ln_yh1ELFt$ .

--
--
Prof. Dr. Detmar Meurers http://purl.org/dm
Dept. of Linguistics - LEAD Graduate School - SFB 833 - Univ. Tübingen

Diana Santos

unread,
May 10, 2023, 3:26:31 AM5/10/23
to constrain...@googlegroups.com
The news of the discontinuation of SDU’s language technology activities came as a big shock to
me, at a time when the European Union is actively fostering open access in R&D and the use of
European products, of which VISLcg is one of the top examples in the language technology field.
• VISLcg is an extremely powerful tool which I use in my research and for providing
annotated corpora to the community of computational processing of Portuguese through
Linguateca.
• It has also been used in my teaching at the University of Oslo, both BA and MA, for the
last ten years, and it is installed at the Norwegian HPC cluster.
• Recent venues where VISLcg has been essential is in the PhD dissertation of Bárbara
Ramos, which I co-supervised at PUC-Rio, Brazil; the building of ELTeC-por (the
Portuguese part of the European Literary Text Collection); and the DIP challenge (a shared
task for identifying characters in Portuguese literature),see https://www.linguateca.pt/DIP)
For me it is almost inconceivable to lose access to this open-source resource. It will seriously
damage R&D in Portuguese, and it will also bring to an end the teaching setup built around it.
Sincerely,
Diana Santos
Full Professor, Portuguese language, University of Oslo
Leader of Linguateca, an international resource project for Portuguese

Atro Voutilainen

unread,
May 15, 2023, 8:33:56 AM5/15/23
to constrain...@googlegroups.com
I found the news about planned discontinuation of support for VISL somewhat alarming.

The research and software by Drs Bick and Didriksen has gained a unique standing in the knowledge-based linguistic research community on language engineering and text analysis (support for dozens of languages, many analysis levels, many generic as well as practical text processing applications). Unlike mainstream approaches (typically involving large language models developed and owned by large corporations), VISL, and the linguistic paradigm more generally, enable development of high-quality open-source language models and text tools for natural languages, also those languages for which there are no resources sufficient for generation of large neural models. VISL has had an important role in supporting linguistic diversity and vitalising minority languages worldwide, by enabling production of high-quality software tools (e.g. writer's aids, translation, language learning) and documentation.

With continued support for the VISL environment and team, hopefully also arrangements could be negotiated to encourage production of news material and other documentation for the general public.

Yours sincerely,
Atro Voutilainen
Ph.D., Adjunct professor of Language Technology at University of Helsinki

Trond Trosterud

unread,
May 15, 2023, 9:33:11 AM5/15/23
to constrain...@googlegroups.com

Støtteopprop for VISLCG3 i Odense

Det er med sjokk og vantro vi hører at VISL/språkteknologi-gruppa ved SDU planlegges lagt ned. Det er ikke første gang det verserer slike planer, og også forrige gang (i 2011) uttrykte vi i det internasjonale fagmiljøet svært sterk bekymring (se vedlegg). På de årene som har gått har betydninga til visl-miljøet i Odense bare økt: Sammenlignet med situasjonen den gangen har flere språksamfunn internasjonalt tatt i bruk teknologien som blir utviklet ved SDU, og teknologien har utviklet seg i samsvar med økende bruk og behov. VISL/språkteknologi-gruppa ved DSU er spydspissen i den resultatsbaserte delen av dansk språkteknologi, og må utvides og styrkes med flere stillinger (jf. konklusjonen i brevet vårt fra 2011).

Siden 2011 har det skjedd mye i språkteknologien, framforalt en forbedring av statistiske metoder og overgang til neurale nett, mest profilert i applikasjoner som Google Translate og ChatGPT. I en slik situasjon er det lett å tenke at å utvikle alternativer til denne teknologien ikke er nødvendig. For alle andre enn noen avgrensede bruksområder for et lite knippe språk stemmer ikke dette. I et dansk perspektiv er det for eksempel verdt å legge merke til at to av de tre språkene i riksfellesskapet står utenfor maskinlæringsutviklingen. Uten miljøet i Odense vil Danmark rett og slett ikke være i stand til å gjennomføre sin egen språkpolitikk for grønlandsk og færøysk.

Den dominerende trenden innenfor språkteknologien har de siste årene levert nye resultater: Robust maskinoversetting til bruk for tekstforståelse mellom ca. 100 språk (av 7000+), og en interaktiv chattjeneste som kan simulere visse sider ved menneskelig språkbruk (for ikke like mange språk). Samtidig er denne nye teknologien fullstendig avhengig av at hvert språksamfunn har en stor tekstsamling (helst hundrevis av milliarder av ord) som følger og dermed uttrykker den språknormen språksamfunnet vil ha. Uheldigvis er det bare et par titalls språk som har slike ressurser. Språksamfunn som grønlandsk og færøysk er svært fjernt fra en slik situasjon. Disse språkene har ikke nok tilgjengelig tekst til å lage språkmodeller ved hjelp av maskinlæring, og mye av teksten som finnes avviker også fra skriftnormen. Det disse språksamfunnene trenger er også noe annet enn det et neuralt nett kan tilby dem: De trenger språkteknologiske verktøy til bruk i språkplanlegging og støtte for korrekt bruk av språkene i en presset situasjon.

Det språkteknologiske miljøet i Tromsø har i likhet med mange andre språkteknologiske miljø brukt teknologien fra visl-gruppen på SDU i over 20 år. Selve visl-teknologien har produsert verktøy for brukerere siden 1990. Den felles infrastrukturen (giellalt.github.io) som både vi og visl bruker inneholder 140 språk som bruker eller har tilgang til visl-teknologien (der i underkant av 50 språk har praktiske applikasjoner). Resultatet er fungerende programmer for bl.a. grammatisk analyse, stavekontroll, grammatikkontroll, maskinoversetting og taleteknologi. Bare i 2023 lanserer vi i Tromsø grammatikkontroll for 3 nye språk (enaresamisk, lulesamisk og sørsamisk), der alle har Odenses vislcg som en kjernekomponent. I tillegg til vår infrastrukt er visl-teknologien også i bruk andre steder i Norden, i alle fall i Uleåborg, Helsingfors, Stockholm, Göteborg, Oslo, Tórshavn og Nuuk. Via maskinoversettingsnettverket Apertium (wiki.apertium.org) er visl-programvaren i bruk på alle kontinent.

Vi oppfatter den foreslåtte nedleggelsen av visl-gruppen som en trussel mot utviklingen innenfor språkteknologisk forsking. Visl-gruppen inngår i et nettverk der Helsingfors leverer løsninger for ordstruktur, Odense for syntaktisk struktur og semantikk og Tromsø generell infrastruktur og programvareintegrering. Uten Odense vil også andre språkteknologer ha vanskeligere for å argumentere for språkteknologiens samfunnsmessige relevans. Visl-miljøet i Odense står fram med toppforskning på internasjonale konferanser, shared tasks og paneldiskusjoner, og har deltatt i ulike samarbeidsprosjekt som har produsert fungerende verktøy. Når våre servere i Tromsø blir stengt ned pga. hackerangrep eller vedlikehold har vi språksamfunnet på telefonen innen et par minutter. Samtidig kan de fleste andre nordiske miljø innenfor språkteknologisk forsking ikke vise til resultater gode nok for faktisk implementering og bruk i språksamfunn, eller de har fokus andre steder. I en situasjon med stadig sterkere fokus på humanioras samfunnsrelevans er det en svært dårlig idé å legge ned det eneste språkteknologiske miljøet som faktisk leverer samfunnsrelevant programvare.

Visl er uerstattelig for den delen av det nordiske språkteknologimiljøet som arbeider med andre enn store offisielle statsspråk. Miljøet er en sentral del av språkteknologien i grensesnittet mellom fungerende og lingvistisk interessant språkteknologi. Vi ser med skuffelse på nyheten om at toppkompetanse i både internasjonal forskning og utvikling innenfor språkteknologi står i fare. I en situasjon der språkteknologi er i rampelyset som aldri før er det farlig å legge ned det eneste alternative til neurale nett, og vi vil med dette på det sterkeste oppfordre til å endre kurs. Visl-gruppen på SDU er allerede uerstattelig for mange av verdens språk, og burde ha vært det for langt flere. Vårt råd er tvert i mot at visl-gruppen får styrket sine ressurser kraftig.



Divvun- og Giellatekno-gruppene ved UiT Norges arktiske universitet, ved

Professor Trond Trosterud
Sjefsingeniør Sjur Moshagen
Dr Linda Wiechetek
Dr Flammie Pirinen




---- -----
visl_fraasegn.pdf

Tino Didriksen

unread,
May 15, 2023, 10:35:33 AM5/15/23
to constrain...@googlegroups.com
To forestall further support letters, unfortunately the appeal did not work. University of Southern Denmark made their final decision today, and the closure will happen later this year.

We will figure out what the immediate and long-term consequences of this is and make an announcement, probably before summer break. We anticipate there won't be any major disruption, but need to clear some things legally.

-- Tino Didriksen

Trond Trosterud

unread,
May 15, 2023, 12:09:52 PM5/15/23
to constrain...@googlegroups.com
I am very sad to hear this.

I heard on friday that you planned to send the letters onwards **tomorrow** and that thus we had today to send in. Evidently, SDU was not interested in keeping to their announced time plan. I am sorry we missed the unexpectingly moving deadline , although it seems it would not have made any difference.

And I am deeply concered for the future of Nordic language technology.

Trond




Tino Didriksen

unread,
May 15, 2023, 12:38:48 PM5/15/23
to constrain...@googlegroups.com
Sorry, that was poor communication on our part. The deadline was indeed tomorrow, but they heavily encouraged us to send as much as possible as early as possible, which we did. And that was enough to make a decision on, because all the external support doesn't come with money. But I have forwarded everything anyway, just in case.

Plus there is a 2nd simultaneous deadline to "voluntarily" resign, which union reps said would complicate matters if we wanted both appeal and resign at the same time, so they recommended that we try to settle the appeal early.

It's all a bit of a mess, and we're figuring out how things will play out.

-- Tino Didriksen

ALAIN FAVRE

unread,
May 16, 2023, 1:20:38 AM5/16/23
to constrain...@googlegroups.com, Hèctor Alòs i Font, ti...@didriksen.cc, Franck Monod
Dear Colleagues, 

It has come to our attention that Constraint Grammar's activities are seriously threatened by cuts in funding from the University of Southern Denmark.
As a user of the online translator Apertium (language pair French-Arpitan), Institut de la Langue Savoyarde is concerned by this decision. Minority languages such as ours are given increased visibility and possibilities of use by Apertium that come close to those of the "big languages", an advantage that it would be very damaging and unfair to lose.
We are counting on a revision of this policy that can help the survival and even the development of languages that have been less favoured by history but which have their place in a world where multilingualism is more than just a political display.
With our best regards.

Alain Favre, vice-president of Institut de la Langue Savoyarde


Reply all
Reply to author
Forward
0 new messages