Virtual Event
- This event has passed.
SICSA Seminar – Theory and Practice of Efficient Evaluation
27 May @ 4:00 pm - 5:00 pm
Virtual Event
Join us on Wednesday 27 May for an AI & Data Science Seminar.
Vilém Zouhar of EHT Zurich presents
Theory and Practice of Efficient Evaluation
Science without evaluation is limited to blind exploration, though good evaluation comes at a cost. In this session, we first cover basics of annotation protocols. We then build a formalism (based on coresets and multi-armed bandits) for choosing which models to evaluate and on which items, in order to make evaluation more efficient.
Vilém Zouhar is last-year PhD at ETH Zurich and Google PhD Fellow. He works on both the practical and theoretical aspects of evaluation (human annotations, automated metrics, methods), especially in the context of multilingual NLP.
