[Priberam ML Seminars] Priberam Machine Learning Lunch Seminars (T12) - 4 - "Visual Attention with Sparse and Continuous Transformations", António Farinha (IT / IST)

9 views
Skip to first unread message

Rúben Cardoso

unread,
Apr 13, 2021, 10:24:58 AM4/13/21
to priberam_...@googlegroups.com, si...@omni.isr.ist.utl.pt, isr-...@isr.tecnico.ulisboa.pt
Hello all,

Hope you are all safe and healthy, the Priberam Machine Learning Seminars will continue to take place remotely via Zoom on Tuesdays at 1 p.m.

Next Tuesday, April 20th, António Farinha, a PhD student at Instituto de Telecomunicações (IT / IST) will present his work on "Visual Attention with Sparse and Continuous Transformationsat 13:00h (zoom link: https://us02web.zoom.us/j/84941193342?pwd=VVBVYTY2TmZ0YmhjWjEyenZCeHp4Zz09 ).

You can register for this event and keep watch on future seminars below:
Please note that the seminar is limited to 100 people and this will work on a 1st come 1st served basis. So please try to be on time if you wish to attend.

Best regards,
Rúben Cardoso

Priberam Labs
http://labs.priberam.com/

Priberam is hiring!
If you are interested in working with us please consult the available positions at priberam.com/careers. 

Image result for priberam logoPRIBERAM SEMINARS   --  Zoom 849 4119 3342
__________________________________________________

Priberam Machine Learning Lunch Seminar
Speaker:  António Farinha (IT / IST)
Venue: https://us02web.zoom.us/j/84941193342?pwd=VVBVYTY2TmZ0YmhjWjEyenZCeHp4Zz09
Date: Tuesday, April 20th, 2021
Time: 13:00 
Title:
Visual Attention with Sparse and Continuous Transformations
Abstract:
Visual attention mechanisms have become an important component of neural network models for Computer Vision applications, allowing them to attend to finite sets of objects or regions and identify relevant features. A key component of attention mechanisms is the differentiable transformation that maps scores representing the importance of each feature into probabilities. The usual choice is the softmax transformation, whose output is strictly dense, assigning a probability mass to every image feature. This density is wasteful, given that non-relevant features are still taken into consideration, making attention models less interpretable. Until now, visual attention has only been applied to discrete domains - this may lead to a lack of focus, where the attention distribution over the image is too scattered.
Inspired by the continuous nature of images, we explore continuous-domain alternatives to discrete attention models. We propose solutions that focus on both the continuity and the sparsity of attention distributions, being suitable for selecting compact and sparse regions such as ellipses. The former encourages the selected regions to be contiguous and the latter is able to single out the relevant features, assigning exactly zero probability to irrelevant parts. We use the fact that the Jacobian of these transformations are generalized covariances to derive efficient back-propagation algorithms for both unimodal and multimodal attention distributions. Experiments on Visual Question Answering show that continuous attention models generate smooth attention maps that seem to better relate with human judgment, while achieving improvements in terms of accuracy over grid-based methods trained on the same data.
Short Bio:
António Farinhas is a first year PhD student at Instituto Superior Técnico (IST), who is interested in Machine Learning and Natural Language Processing, being advised by André Martins. He previously obtained his MSc degree in Aerospace Engineering at IST. The work in his MSc thesis, advised by André Martins and Pedro Aguiar, focused on continuous visual attention mechanisms and was part of the NeurIPS 2020 paper “Sparse and Continuous Attention Mechanisms”.

Eventbrite:
Image result for priberam logo

Rúben Cardoso

unread,
Apr 26, 2021, 11:54:20 AM4/26/21
to priberam_...@googlegroups.com, si...@omni.isr.ist.utl.pt, isr-...@isr.tecnico.ulisboa.pt
Hello all,

Hope you are all safe and healthy, the Priberam Machine Learning Seminars will continue to take place remotely via Zoom on Tuesdays at 1 p.m.

Next Tuesday, May 4th, Professor Andreas Vlachos, a senior lecturer at the Univesity of Cambridge will guide us through his work on "Fact-checking as a conversationat 13:00h (zoom link: https://us02web.zoom.us/j/89174667219?pwd=WXovc0R0cHA2OWtTQlpzdzBDSm1wUT09 ).

You can register for this event and keep watch on future seminars below:
Please note that the seminar is limited to 100 people and this will work on a 1st come 1st served basis.

Best regards,
Rúben Cardoso

Priberam Labs
http://labs.priberam.com/

Priberam is hiring!
If you are interested in working with us please consult the available positions at priberam.com/careers. 

Image result for priberam logoPRIBERAM SEMINARS   --  Zoom 891 7466 7219
__________________________________________________

Priberam Machine Learning Lunch Seminar
Speaker:  Andreas Vlachos (University of Cambridge)
Venue: https://us02web.zoom.us/j/89174667219?pwd=WXovc0R0cHA2OWtTQlpzdzBDSm1wUT09
Date: Tuesday, May 4th, 2021
Time: 13:00 
Title:
Fact-checking as a conversation
Abstract:
Misinformation is considered one of the major challenges of our times resulting in numerous efforts against it. Fact-checking, the task of assessing whether a claim is true or false, is considered a key weapon in reducing its impact. In the first part of this talk, Professor Andreas Vlachos will present his recent and ongoing work on automating this task using natural language processing, moving beyond simply classifying claims as true or false in the following aspects: returning evidence for the predictions, factually correcting the claims and adversarial evaluation. The second part of this talk will focus on an alternative approach to combatting misinformation via dialogue agents and present results on how internet users engage in constructive disagreements and problem-solving deliberation.
Short Bio:
Professor Andreas Vlachos is a senior lecturer at the Natural Language and Information Processing group at the Department of Computer Science and Technology at the University of Cambridge. His current projects include dialogue modelling, automated fact-checking and imitation learning. Professor Andreas has also worked on semantic parsing, natural language generation and summarization, language modelling, information extraction, active learning, clustering and biomedical text mining. His research team is supported by grants from ERC, EPSRC, ESRC, Facebook, Amazon, Google and Huawei.

Rúben Cardoso

unread,
May 3, 2021, 7:53:10 AM5/3/21
to si...@omni.isr.ist.utl.pt, priberam_...@googlegroups.com, isr-...@isr.tecnico.ulisboa.pt
Hello all,

Hope you are all safe and healthy.
Unfortunately, due to a last-minute issue, tomorrow's Priberam Lunch Seminar will have to be postponed. The same seminar will now be held in 2 weeks, May 18th, at the usual time.

In two weeks, May 18th, Professor Andreas Vlachos, a senior lecturer at the Univesity of Cambridge will guide us through his work on "Fact-checking as a conversationat 13:00h (zoom link: https://us02web.zoom.us/j/89174667219?pwd=WXovc0R0cHA2OWtTQlpzdzBDSm1wUT09 ).

You can register for this event and keep watch on future seminars below:
Please note that the seminar is limited to 100 people and this will work on a 1st come 1st served basis.

Best regards,
Rúben Cardoso

Priberam Labs
http://labs.priberam.com/

Priberam is hiring!
If you are interested in working with us please consult the available positions at priberam.com/careers. 

Image result for priberam logoPRIBERAM SEMINARS   --  Zoom 891 7466 7219
__________________________________________________

Priberam Machine Learning Lunch Seminar
Speaker:  Andreas Vlachos (University of Cambridge)
Venue: https://us02web.zoom.us/j/89174667219?pwd=WXovc0R0cHA2OWtTQlpzdzBDSm1wUT09
Date: Tuesday, May 18th, 2021
Time: 13:00 
Title:
Fact-checking as a conversation
Abstract:
Misinformation is considered one of the major challenges of our times resulting in numerous efforts against it. Fact-checking, the task of assessing whether a claim is true or false, is considered a key weapon in reducing its impact. In the first part of this talk, Professor Andreas Vlachos will present his recent and ongoing work on automating this task using natural language processing, moving beyond simply classifying claims as true or false in the following aspects: returning evidence for the predictions, factually correcting the claims and adversarial evaluation. The second part of this talk will focus on an alternative approach to combatting misinformation via dialogue agents and present results on how internet users engage in constructive disagreements and problem-solving deliberation.

Rúben Cardoso

unread,
May 11, 2021, 11:39:55 AM5/11/21
to priberam_...@googlegroups.com, si...@omni.isr.ist.utl.pt, isr-...@isr.tecnico.ulisboa.pt
Hello all,

Hope you are all safe and healthy, the Priberam Machine Learning Seminars will continue to take place remotely via Zoom on Tuesdays at 1 p.m.

Next Tuesday, May 18th, Professor Andreas Vlachos, a senior lecturer at the Univesity of Cambridge will guide us through his work on "Fact-checking as a conversationat 13:00h (zoom link: https://us02web.zoom.us/j/89174667219?pwd=WXovc0R0cHA2OWtTQlpzdzBDSm1wUT09 ).

You can register for this event and keep watch on future seminars below:
Please note that the seminar is limited to 100 people and this will work on a 1st come 1st served basis.

Best regards,
Rúben Cardoso

Priberam Labs
http://labs.priberam.com/

Priberam is hiring!
If you are interested in working with us please consult the available positions at priberam.com/careers. 

Image result for priberam logoPRIBERAM SEMINARS   --  Zoom 891 7466 7219
__________________________________________________

Priberam Machine Learning Lunch Seminar
Speaker:  Andreas Vlachos (University of Cambridge)
Venue: https://us02web.zoom.us/j/89174667219?pwd=WXovc0R0cHA2OWtTQlpzdzBDSm1wUT09
Date: Tuesday, May 18th, 2021
Time: 13:00 
Title:
Fact-checking as a conversation
Abstract:
Misinformation is considered one of the major challenges of our times resulting in numerous efforts against it. Fact-checking, the task of assessing whether a claim is true or false, is considered a key weapon in reducing its impact. In the first part of this talk, Professor Andreas Vlachos will present his recent and ongoing work on automating this task using natural language processing, moving beyond simply classifying claims as true or false in the following aspects: returning evidence for the predictions, factually correcting the claims and adversarial evaluation. The second part of this talk will focus on an alternative approach to combatting misinformation via dialogue agents and present results on how internet users engage in constructive disagreements and problem-solving deliberation.
Reply all
Reply to author
Forward
0 new messages