default search action
Google
Google Scholar
Semantic Scholar
Internet Archive Scholar
CiteSeerX
ORCIDSebastian Ruder
Person information
SPARQL queries 
🛈 Please note that only 54% of the records listed on this page have a DOI. Therefore, DOI-based queries can only provide partial results.
Refine list
refinements active!
zoomed in on ?? of ?? records
view refined list in
export refined list as
showing all ?? records
2020 – today
- 2024
[c73]Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje Karlsson, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Vu Chien, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker:
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. ACL (1) 2024: 11521-11567- [c72]Daan van Esch, Sandy Ritchie, Sebastian Ruder, Julia Kreutzer, Clara Rivera, Ishank Saxena, Isaac Caswell:
Connecting Language Technologies with Rich, Diverse Data Sources Covering Thousands of Languages. LREC/COLING 2024: 3729-3746 - [c71]Holy Lovenia, Rahmad Mahendra, Salsabil Maulana Akbar, Lester James V. Miranda, Jennifer Santoso, Elyanah Aco, Akhdan Fadhilah, Jonibek Mansurov, Joseph Marvin Imperial, Onno Kampman, Joel Ruben Antony Moniz, Muhammad Ravi Shulthan Habibi, Frederikus Hudi, Jann Montalan, Ryan Hadiwijaya, Joanito Agili Lopo, William Nixon, Börje Karlsson, James Jaya, Ryandito Diandaru, Yuze Gao, Patrick Amadeus Irawan, Bin Wang, Jan Christian Blaise Cruz, Chenxi Whitehouse, Ivan Halim Parmonangan, Maria Khelli, Wenyu Zhang, Lucky Susanto, Reynard Adha Ryanda, Sonny Lazuardi Hermawan, Dan John Velasco, Muhammad Dehan Al Kautsar, Willy Fitra Hendria, Yasmin Moslem, Noah Flynn, Muhammad Farid Adilazuarda, Haochen Li, Johanes Lee, R. Damanhuri, Shuo Sun, Muhammad Reza Qorib, Amirbek Djanibekov, Wei Qi Leong, Quyet V. Do, Niklas Muennighoff, Tanrada Pansuwan, Ilham Firdausi Putra, Yan Xu, Ngee Tai Chia, Ayu Purwarianti, Sebastian Ruder, William-Chandra Tjhi, Peerat Limkonchotiwat, Alham Fikri Aji, Sedrick Keh, Genta Indra Winata, Ruochen Zhang, Fajri Koto, Zheng Xin Yong, Samuel Cahyawijaya:
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages. EMNLP 2024: 5155-5203 - [c70]Kelly Marchisio, Wei-Yin Ko, Alexandre Berard, Théo Dehaze, Sebastian Ruder:
Understanding and Mitigating Language Confusion in LLMs. EMNLP 2024: 6653-6677 - [c69]Luísa Shimabucoro, Sebastian Ruder, Julia Kreutzer, Marzieh Fadaee, Sara Hooker:
LLM See, LLM Do: Leveraging Active Inheritance to Target Non-Differentiable Objectives. EMNLP 2024: 9243-9267 - [c68]Kelly Marchisio, Saurabh Dash, Hongyu Chen, Dennis Aumiller, Ahmet Üstün, Sara Hooker, Sebastian Ruder:
How Does Quantization Affect Multilingual LLMs? EMNLP (Findings) 2024: 15928-15947 - [c67]Akari Asai, Sneha Kudugunta, Xinyan Yu, Terra Blevins, Hila Gonen, Machel Reid, Yulia Tsvetkov, Sebastian Ruder, Hannaneh Hajishirzi:
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer. NAACL-HLT 2024: 1771-1800 - [i87]Shivalika Singh, Freddie Vargus, Daniel D'souza, Börje F. Karlsson
, Abinaya Mahendiran, Wei-Yin Ko, Herumb Shandilya, Jay Patel, Deividas Mataciunas, Laura O'Mahony, Mike Zhang, Ramith Hettiarachchi, Joseph Wilson, Marina Machado, Luisa Souza Moura, Dominik Krzeminski, Hakimeh Fadaei, Irem Ergün, Ifeoma Okoh, Aisha Alaagib, Oshan Mudannayake, Zaid Alyafeai, Minh Chien Vu, Sebastian Ruder, Surya Guthikonda, Emad A. Alghamdi, Sebastian Gehrmann, Niklas Muennighoff, Max Bartolo, Julia Kreutzer, Ahmet Üstün, Marzieh Fadaee, Sara Hooker:
Aya Dataset: An Open-Access Collection for Multilingual Instruction Tuning. CoRR abs/2402.06619 (2024) - [i86]Viraat Aryabumi, John Dang, Dwarak Talupuru, Saurabh Dash, David Cairuz, Hangyu Lin, Bharat Venkitesh, Madeline Smith, Jon Ander Campos, Yi Chern Tan, Kelly Marchisio, Max Bartolo, Sebastian Ruder, Acyr Locatelli, Julia Kreutzer, Nick Frosst, Aidan N. Gomez, Phil Blunsom, Marzieh Fadaee, Ahmet Üstün, Sara Hooker:
Aya 23: Open Weight Releases to Further Multilingual Progress. CoRR abs/2405.15032 (2024) - [i85]Holy Lovenia, Rahmad Mahendra, Salsabil Maulana Akbar, Lester James V. Miranda, Jennifer Santoso, Elyanah Aco, Akhdan Fadhilah, Jonibek Mansurov, Joseph Marvin Imperial, Onno Pepijn Kampman, Joel Ruben Antony Moniz, Muhammad Ravi Shulthan Habibi, Frederikus Hudi, Railey Montalan, Ryan Ignatius, Joanito Agili Lopo, William Nixon, Börje F. Karlsson, James Jaya, Ryandito Diandaru, Yuze Gao, Patrick Amadeus Irawan, Bin Wang, Jan Christian Blaise Cruz, Chenxi Whitehouse, Ivan Halim Parmonangan, Maria Khelli, Wenyu Zhang, Lucky Susanto, Reynard Adha Ryanda, Sonny Lazuardi Hermawan, Dan John Velasco, Muhammad Dehan Al Kautsar, Willy Fitra Hendria, Yasmin Moslem, Noah Flynn, Muhammad Farid Adilazuarda, Haochen Li, Johanes Lee, R. Damanhuri, Shuo Sun, Muhammad Reza Qorib, Amirbek Djanibekov, Wei Qi Leong, Quyet V. Do, Niklas Muennighoff, Tanrada Pansuwan, Ilham Firdausi Putra, Yan Xu, Ngee Chia Tai, Ayu Purwarianti, Sebastian Ruder, William-Chandra Tjhi, Peerat Limkonchotiwat, Alham Fikri Aji, Sedrick Keh, Genta Indra Winata, Ruochen Zhang, Fajri Koto, Zheng Xin Yong, Samuel Cahyawijaya:
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages. CoRR abs/2406.10118 (2024) - [i84]Kelly Marchisio, Wei-Yin Ko, Alexandre Bérard, Théo Dehaze, Sebastian Ruder:
Understanding and Mitigating Language Confusion in LLMs. CoRR abs/2406.20052 (2024) - [i83]Luísa Shimabucoro, Sebastian Ruder, Julia Kreutzer, Marzieh Fadaee, Sara Hooker:
LLM See, LLM Do: Guiding Data Generation to Target Non-Differentiable Objectives. CoRR abs/2407.01490 (2024) - [i82]Kelly Marchisio, Saurabh Dash, Hongyu Chen, Dennis Aumiller, Ahmet Üstün, Sara Hooker, Sebastian Ruder:
How Does Quantization Affect Multilingual LLMs? CoRR abs/2407.03211 (2024) - [i81]Qizhen Zhang, Nikolas Gritsch, Dwaraknath Gnaneshwar, Simon Guo, David Cairuz, Bharat Venkitesh, Jakob N. Foerster, Phil Blunsom, Sebastian Ruder, Ahmet Üstün, Acyr Locatelli:
BAM! Just Like That: Simple and Efficient Parameter Upcycling for Mixture of Experts. CoRR abs/2408.08274 (2024) - [i80]Srishti Gureja, Lester James V. Miranda, Shayekh Bin Islam, Rishabh Maheshwary, Drishti Sharma, Gusti Winata, Nathan Lambert, Sebastian Ruder, Sara Hooker, Marzieh Fadaee:
M-RewardBench: Evaluating Reward Models in Multilingual Settings. CoRR abs/2410.15522 (2024) - 2023
- [j4]Priyanka Agrawal, Chris Alberti, Fantine Huot, Joshua Maynez, Ji Ma, Sebastian Ruder, Kuzman Ganchev, Dipanjan Das, Mirella Lapata:
QAmeleon: Multilingual QA with Only 5 Examples. Trans. Assoc. Comput. Linguistics 11: 1754-1771 (2023) - [j3]Jonas Pfeiffer, Sebastian Ruder, Ivan Vulic, Edoardo M. Ponti:
Modular Deep Learning. Trans. Mach. Learn. Res. 2023 (2023) - [c66]Ester Hlavnova, Sebastian Ruder:
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features. ACL (1) 2023: 7181-7198 - [c65]Samuel Cahyawijaya, Holy Lovenia, Alham Fikri Aji, Genta Indra Winata, Bryan Wilie, Fajri Koto, Rahmad Mahendra, Christian Wibisono, Ade Romadhony, Karissa Vincentio, Jennifer Santoso, David Moeljadi, Cahya Wirawan, Frederikus Hudi, Muhammad Satrio Wicaksono, Ivan Halim Parmonangan, Ika Alfina, Ilham Firdausi Putra, Samsul Rahmadani, Yulianti Oenang, Ali Akbar Septiandri, James Jaya, Kaustubh D. Dhole, Arie Ardiyanti Suryani, Rifki Afina Putri, Dan Su, Keith Stevens, Made Nindyatama Nityasya, Muhammad Farid Adilazuarda, Ryan Hadiwijaya, Ryandito Diandaru, Tiezheng Yu, Vito Ghifari, Wenliang Dai, Yan Xu, Dyah Damapuspita, Haryo Akbarianto Wibowo, Cuk Tho, Ichwanul Muslim Karo Karo, Tirana Fatyanosa, Ziwei Ji, Graham Neubig, Timothy Baldwin, Sebastian Ruder, Pascale Fung, Herry Sujaini, Sakriani Sakti, Ayu Purwarianti:
NusaCrowd: Open Source Initiative for Indonesian NLP Resources. ACL (Findings) 2023: 13745-13818 - [c64]Simran Khanuja, Sebastian Ruder, Partha Talukdar:
Evaluating the Diversity, Equity, and Inclusion of NLP Technology: A Case Study for Indian Languages. EACL (Findings) 2023: 1718-1732 - [c63]Benjamin Muller, John Wieting, Jonathan H. Clark, Tom Kwiatkowski, Sebastian Ruder, Livio Soares, Roee Aharoni, Jonathan Herzig, Xinyi Wang:
Evaluating and Modeling Attribution for Cross-Lingual Question Answering. EMNLP 2023: 144-157 - [c62]Clifton Poth, Hannah Sterz, Indraneil Paul, Sukannya Purkayastha, Leon Engländer, Timo Imhof, Ivan Vulic, Sebastian Ruder, Iryna Gurevych, Jonas Pfeiffer:
Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning. EMNLP (Demos) 2023: 149-160 - [c61]Sebastian Gehrmann, Sebastian Ruder, Vitaly Nikolaev, Jan A. Botha, Michael Chavinda, Ankur P. Parikh, Clara Rivera:
TaTA: A Multilingual Table-to-Text Dataset for African Languages. EMNLP (Findings) 2023: 1719-1740 - [c60]Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean Michel A. Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L. Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Ifeoluwa Adelani, Vera Axelrod, Isaac Caswell, Colin Cherry, Dan Garrette, R. Reeve Ingle, Melvin Johnson, Dmitry Panteleev, Partha Talukdar:
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages. EMNLP (Findings) 2023: 1856-1884 - [c59]Jonas Pfeiffer, Francesco Piccinno, Massimo Nicosia, Xinyi Wang, Machel Reid, Sebastian Ruder:
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations. EMNLP (Findings) 2023: 1978-2008 - [c58]Sukannya Purkayastha, Sebastian Ruder, Jonas Pfeiffer, Iryna Gurevych, Ivan Vulic:
Romanization-based Large-scale Adaptation of Multilingual Language Models. EMNLP (Findings) 2023: 7996-8005 - [c57]Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Abinew Ali Ayele, Nedjma Ousidhoum, David Ifeoluwa Adelani, Seid Muhie Yimam, Ibrahim Said Ahmad, Meriem Beloucif, Saif M. Mohammad, Sebastian Ruder, Oumaima Hourrane, Alípio Jorge, Pavel Brazdil, Felermino Dário Mário António Ali, Davis David, Salomey Osei, Bello Shehu Bello, Falalu Ibrahim Lawan, Tajuddeen Gwadabe, Samuel Rutunda, Tadesse Destaw Belay, Wendimu Baye Messelle, Hailu Beshada Balcha, Sisay Adugna Chala, Hagos Tesfahun Gebremichael, Bernard Opoku, Stephen Arthur:
AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages. EMNLP 2023: 13968-13981 - [c56]Odunayo Ogundepo, Tajuddeen Gwadabe, Clara Rivera, Jonathan H. Clark, Sebastian Ruder, David Ifeoluwa Adelani, Bonaventure Dossou, Abdou Aziz Diop, Claytone Sikasote, Gilles Hacheme, Happy Buzaaba, Ignatius Ezeani, Rooweither Mabuya, Salomey Osei, Chris Emezue, Albert Kahira, Shamsuddeen Hassan Muhammad, Akintunde Oladipo, Abraham Toluwase Owodunni, Atnafu Lambebo Tonja, Iyanuoluwa Shode, Akari Asai, Aremu Anuoluwapo, Ayodele Awokoya, Bernard Opoku, Chiamaka Chukwuneke, Christine Mwase, Clemencia Siro, Stephen Arthur, Tunde Ajayi, Verrah Otiende, Andre Niyongabo Rubungo, Boyd Sinkala, Daniel A. Ajisafe, Emeka Onwuegbuzia, Falalu Ibrahim Lawan, Ibrahim Said Ahmad, Jesujoba O. Alabi, Chinedu E. Mbonu, Mofetoluwa Adeyemi, Mofya Phiri, Orevaoghene Ahia, Ruqayya Nasir Iro, Sonia Adhiambo:
Cross-lingual Open-Retrieval Question Answering for African Languages. EMNLP (Findings) 2023: 14957-14972 - [c55]Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei:
Language models are multilingual chain-of-thought reasoners. ICLR 2023 - [c54]Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Seid Muhie Yimam, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Nedjma Ousidhoum, Abinew Ali Ayele, Saif M. Mohammad, Meriem Beloucif, Sebastian Ruder:
SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval). SemEval@ACL 2023: 2319-2337 - [i79]Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Abinew Ali Ayele, Nedjma Ousidhoum, David Ifeoluwa Adelani, Seid Muhie Yimam, Ibrahim Said Ahmad, Meriem Beloucif, Saif M. Mohammad, Sebastian Ruder, Oumaima Hourrane, Pavel Brazdil, Felermino Dário Mário António Ali, Davis David, Salomey Osei, Bello Shehu Bello, Falalu Ibrahim, Tajuddeen Gwadabe, Samuel Rutunda, Tadesse Destaw Belay, Wendimu Baye Messelle, Hailu Beshada Balcha, Sisay Adugna Chala, Hagos Tesfahun Gebremichael, Bernard Opoku, Steven Arthur:
AfriSenti: A Twitter Sentiment Analysis Benchmark for African Languages. CoRR abs/2302.08956 (2023) - [i78]Jonas Pfeiffer, Sebastian Ruder, Ivan Vulic, Edoardo Maria Ponti:
Modular Deep Learning. CoRR abs/2302.11529 (2023) - [i77]Shamsuddeen Hassan Muhammad, Idris Abdulmumin, Seid Muhie Yimam, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Nedjma Ousidhoum, Abinew Ali Ayele, Saif M. Mohammad, Meriem Beloucif, Sebastian Ruder:
SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval). CoRR abs/2304.06845 (2023) - [i76]Sukannya Purkayastha, Sebastian Ruder, Jonas Pfeiffer, Iryna Gurevych, Ivan Vulic:
Romanization-based Large-scale Adaptation of Multilingual Language Models. CoRR abs/2304.08865 (2023) - [i75]Odunayo Ogundepo, Tajuddeen R. Gwadabe, Clara E. Rivera, Jonathan H. Clark, Sebastian Ruder, David Ifeoluwa Adelani, Bonaventure F. P. Dossou, Abdou Aziz Diop, Claytone Sikasote, Gilles Hacheme, Happy Buzaaba, Ignatius Ezeani, Rooweither Mabuya, Salomey Osei, Chris Emezue, Albert Njoroge Kahira, Shamsuddeen Hassan Muhammad, Akintunde Oladipo, Abraham Toluwase Owodunni, Atnafu Lambebo Tonja, Iyanuoluwa Shode, Akari Asai, Tunde Oluwaseyi Ajayi, Clemencia Siro, Steven Arthur, Mofetoluwa Adeyemi, Orevaoghene Ahia, Aremu Anuoluwapo, Oyinkansola Awosan, Chiamaka Chukwuneke, Bernard Opoku, Awokoya Ayodele, Verrah Otiende, Christine Mwase, Boyd Sinkala, Andre Niyongabo Rubungo, Daniel A. Ajisafe, Emeka Felix Onwuegbuzia, Habib Mbow, Emile Niyomutabazi, Eunice Mukonde, Falalu Ibrahim Lawan, Ibrahim Said Ahmad, Jesujoba O. Alabi, Martin Namukombo, Chinedu Emmanuel Mbonu, Mofya Phiri, Neo Putini, Ndumiso Mngoma, Priscilla A. Amuok, Ruqayya Nasir Iro, Sonia Adhiambo:
AfriQA: Cross-lingual Open-Retrieval Question Answering for African Languages. CoRR abs/2305.06897 (2023) - [i74]Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernández Ábrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan A. Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vladimir Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, et al.:
PaLM 2 Technical Report. CoRR abs/2305.10403 (2023) - [i73]Sebastian Ruder, Jonathan H. Clark, Alexander Gutkin, Mihir Kale, Min Ma, Massimo Nicosia, Shruti Rijhwani, Parker Riley, Jean Michel A. Sarr, Xinyi Wang, John Wieting, Nitish Gupta, Anna Katanova, Christo Kirov, Dana L. Dickinson, Brian Roark, Bidisha Samanta, Connie Tao, David Ifeoluwa Adelani, Vera Axelrod, Isaac Caswell, Colin Cherry, Dan Garrette, R. Reeve Ingle, Melvin Johnson, Dmitry Panteleev, Partha Talukdar:
XTREME-UP: A User-Centric Scarce-Data Benchmark for Under-Represented Languages. CoRR abs/2305.11938 (2023) - [i72]Jonas Pfeiffer, Francesco Piccinno, Massimo Nicosia, Xinyi Wang, Machel Reid, Sebastian Ruder:
mmT5: Modular Multilingual Pre-Training Solves Source Language Hallucinations. CoRR abs/2305.14224 (2023) - [i71]Benjamin Muller, John Wieting, Jonathan H. Clark, Tom Kwiatkowski, Sebastian Ruder, Livio Baldini Soares, Roee Aharoni, Jonathan Herzig, Xinyi Wang:
Evaluating and Modeling Attribution for Cross-Lingual Question Answering. CoRR abs/2305.14332 (2023) - [i70]Akari Asai, Sneha Kudugunta, Xinyan Velocity Yu, Terra Blevins, Hila Gonen, Machel Reid, Yulia Tsvetkov, Sebastian Ruder, Hannaneh Hajishirzi:
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer. CoRR abs/2305.14857 (2023) - [i69]Ester Hlavnova, Sebastian Ruder:
Empowering Cross-lingual Behavioral Testing of NLP Models with Typological Features. CoRR abs/2307.05454 (2023) - [i68]Alexandra Chronopoulou, Jonas Pfeiffer, Joshua Maynez, Xinyi Wang, Sebastian Ruder, Priyanka Agrawal:
Language and Task Arithmetic with Parameter-Efficient Layers for Zero-Shot Summarization. CoRR abs/2311.09344 (2023) - [i67]Clifton Poth, Hannah Sterz, Indraneil Paul, Sukannya Purkayastha, Leon Engländer, Timo Imhof, Ivan Vulic, Sebastian Ruder, Iryna Gurevych, Jonas Pfeiffer:
Adapters: A Unified Library for Parameter-Efficient and Modular Transfer Learning. CoRR abs/2311.11077 (2023) - 2022
- [c53]Yanan Zheng, Jing Zhou, Yujie Qian, Ming Ding, Chonghua Liao, Li Jian, Ruslan Salakhutdinov, Jie Tang, Sebastian Ruder, Zhilin Yang:
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding. ACL (1) 2022: 501-516 - [c52]Xinyi Wang, Sebastian Ruder, Graham Neubig:
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation. ACL (1) 2022: 863-877 - [c51]Sebastian Ruder, Ivan Vulic, Anders Søgaard:
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold. ACL (Findings) 2022: 2340-2354 - [c50]Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin, Jey Han Lau, Sebastian Ruder:
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia. ACL (1) 2022: 7226-7249 - [c49]Michael Tänzer, Sebastian Ruder, Marek Rei:
Memorisation versus Generalisation in Pre-trained Language Models. ACL (1) 2022: 7564-7578 - [c48]David Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder, Shruti Rijhwani, Michael Beukman, Chester Palen-Michel, Constantine Lignos, Jesujoba O. Alabi, Shamsuddeen Hassan Muhammad, Peter Nabende, Cheikh M. Bamba Dione, Andiswa Bukula, Rooweither Mabuya, Bonaventure F. P. Dossou, Blessing K. Sibanda, Happy Buzaaba, Jonathan Mukiibi, Godson Kalipe, Derguene Mbaye, Amelia V. Taylor, Fatoumata Ouoba Kabore, Chris Chinenye Emezue, Aremu Anuoluwapo, Perez Ogayo, Catherine Gitau, Edwin Munkoh-Buabeng, Victoire Memdjokam Koagne, Allahsera Auguste Tapo, Tebogo Macucwa, Vukosi Marivate, Elvis Mboning, Tajuddeen Gwadabe, Tosin P. Adewumi, Orevaoghene Ahia, Joyce Nakatumba-Nabende, Neo L. Mokono, Ignatius Ezeani, Chiamaka Chukwuneke, Mofetoluwa Adeyemi, Gilles Hacheme, Idris Abdulmumin, Odunayo Ogundepo, Oreen Yousuf, Tatiana Moteu Ngoli, Dietrich Klakow:
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition. EMNLP 2022: 4488-4508 - [c47]Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord, Sebastian Ruder:
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer. EMNLP 2022: 7934-7949 - [c46]Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler:
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning. ICLR 2022 - [c45]Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler:
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization. ICLR 2022 - [c44]Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson:
XTREME-S: Evaluating Cross-lingual Speech Representations. INTERSPEECH 2022: 3248-3252 - [c43]Daan van Esch, Tamar Lucassen, Sebastian Ruder, Isaac Caswell, Clara Rivera:
Writing System and Speaker Metadata for 2, 800+ Language Varieties. LREC 2022: 5035-5046 - [e6]Yulan He, Heng Ji, Yang Liu, Sujian Li, Chia-Hui Chang, Soujanya Poria, Chenghua Lin, Wray L. Buntine, Maria Liakata, Hanqi Yan, Zonghan Yan, Sebastian Ruder, Xiaojun Wan, Miguel Arana-Catania, Zhongyu Wei, Hen-Hsen Huang, Jheng-Long Wu, Min-Yuh Day, Pengfei Liu, Ruifeng Xu:
Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2022 - Volume 1: Long Papers, Online Only, November 20-23, 2022. Association for Computational Linguistics 2022, ISBN 978-1-955917-65-0 [contents] - [e5]Yulan He, Heng Ji, Yang Liu, Sujian Li, Chia-Hui Chang, Soujanya Poria, Chenghua Lin, Wray L. Buntine, Maria Liakata, Hanqi Yan, Zonghan Yan, Sebastian Ruder, Xiaojun Wan, Miguel Arana-Catania, Zhongyu Wei, Hen-Hsen Huang, Jheng-Long Wu, Min-Yuh Day, Pengfei Liu, Ruifeng Xu:
Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2022 - Volume 2: Short Papers, Online only, November 20-23, 2022. Association for Computational Linguistics 2022, ISBN 978-1-955917-64-3 [contents] - [e4]Hanqi Yan, Zonghan Yang, Sebastian Ruder, Xiaojun Wan:
Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing, AACL/IJCNLP 2022 - Student Research Workshop, Online, November 20, 2022. Association for Computational Linguistics 2022, ISBN 978-1-955917-56-8 [contents] - [e3]Yulan He, Heng Ji, Yang Liu, Sujian Li, Chia-Hui Chang, Soujanya Poria, Chenghua Lin, Wray L. Buntine, Maria Liakata, Hanqi Yan, Zonghan Yan, Sebastian Ruder, Xiaojun Wan, Miguel Arana-Catania, Zhongyu Wei, Hen-Hsen Huang, Jheng-Long Wu, Min-Yuh Day, Pengfei Liu, Ruifeng Xu:
Findings of the Association for Computational Linguistics: AACL-IJCNLP 2022, Online only, November 20-23, 2022. Association for Computational Linguistics 2022, ISBN 978-1-959429-04-3 [contents] - [e2]Alon Albalak, Chunting Zhou, Colin Raffel, Deepak Ramachandran, Sebastian Ruder, Xuezhe Ma:
Transfer Learning for Natural Language Processing Workshop, 03 December 2022, New Orleans, Louisiana, USA. Proceedings of Machine Learning Research 203, PMLR 2022 [contents] - [i66]Shamsuddeen Hassan Muhammad, David Ifeoluwa Adelani, Sebastian Ruder, Ibrahim Said Ahmad, Idris Abdulmumin, Bello Shehu Bello, Monojit Choudhury, Chris Chinenye Emezue, Saheed Abdullahi Salahudeen, Aremu Anuoluwapo, Alípio Jeorge, Pavel Brazdil:
NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis. CoRR abs/2201.08277 (2022) - [i65]Xinyi Wang, Sebastian Ruder, Graham Neubig:
Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation. CoRR abs/2203.09435 (2022) - [i64]Alexis Conneau, Ankur Bapna, Yu Zhang, Min Ma, Patrick von Platen, Anton Lozhkov, Colin Cherry, Ye Jia, Clara Rivera, Mihir Kale, Daan van Esch, Vera Axelrod, Simran Khanuja, Jonathan H. Clark, Orhan Firat, Michael Auli, Sebastian Ruder, Jason Riesa, Melvin Johnson:
XTREME-S: Evaluating Cross-lingual Speech Representations. CoRR abs/2203.10752 (2022) - [i63]Alham Fikri Aji, Genta Indra Winata, Fajri Koto, Samuel Cahyawijaya, Ade Romadhony, Rahmad Mahendra, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Timothy Baldwin, Jey Han Lau, Sebastian Ruder:
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia. CoRR abs/2203.13357 (2022) - [i62]Ahmet Üstün, Arianna Bisazza, Gosse Bouma, Gertjan van Noord, Sebastian Ruder:
Hyper-X: A Unified Hypernetwork for Multi-Task Multilingual Transfer. CoRR abs/2205.12148 (2022) - [i61]Simran Khanuja, Sebastian Ruder, Partha P. Talukdar:
Evaluating Inclusivity, Equity, and Accessibility of NLP Technology: A Case Study for Indian Languages. CoRR abs/2205.12676 (2022) - [i60]Genta Indra Winata, Alham Fikri Aji, Samuel Cahyawijaya, Rahmad Mahendra, Fajri Koto, Ade Romadhony, Kemal Kurniawan, David Moeljadi, Radityo Eko Prasojo, Pascale Fung, Timothy Baldwin, Jey Han Lau, Rico Sennrich, Sebastian Ruder:
NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages. CoRR abs/2205.15960 (2022) - [i59]Sebastian Ruder, Ivan Vulic, Anders Søgaard:
Square One Bias in NLP: Towards a Multi-Dimensional Exploration of the Research Manifold. CoRR abs/2206.09755 (2022) - [i58]Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, Jason Wei:
Language Models are Multilingual Chain-of-Thought Reasoners. CoRR abs/2210.03057 (2022) - [i57]David Ifeoluwa Adelani, Graham Neubig, Sebastian Ruder, Shruti Rijhwani, Michael Beukman, Chester Palen-Michel, Constantine Lignos, Jesujoba O. Alabi, Shamsuddeen Hassan Muhammad, Peter Nabende, Cheikh M. Bamba Dione, Andiswa Bukula, Rooweither Mabuya, Bonaventure F. P. Dossou, Blessing K. Sibanda, Happy Buzaaba, Jonathan Mukiibi, Godson Kalipe, Derguene Mbaye, Amelia V. Taylor, Fatoumata Ouoba Kabore, Chris Chinenye Emezue, Aremu Anuoluwapo, Perez Ogayo, Catherine Gitau, Edwin Munkoh-Buabeng, Victoire Memdjokam Koagne, Allahsera Auguste Tapo, Tebogo Macucwa, Vukosi Marivate, Elvis Mboning, Tajuddeen Gwadabe, Tosin P. Adewumi, Orevaoghene Ahia, Joyce Nakatumba-Nabende, Neo L. Mokono, Ignatius Ezeani, Chiamaka Chukwuneke, Mofetoluwa Adeyemi, Gilles Hacheme, Idris Abdulmumin, Odunayo Ogundepo, Oreen Yousuf, Tatiana Moteu Ngoli, Dietrich Klakow:
MasakhaNER 2.0: Africa-centric Transfer Learning for Named Entity Recognition. CoRR abs/2210.12391 (2022) - [i56]Sebastian Gehrmann, Sebastian Ruder, Vitaly Nikolaev, Jan A. Botha, Michael Chavinda, Ankur P. Parikh, Clara Rivera:
TaTa: A Multilingual Table-to-Text Dataset for African Languages. CoRR abs/2211.00142 (2022) - [i55]Priyanka Agrawal, Chris Alberti, Fantine Huot, Joshua Maynez, Ji Ma, Sebastian Ruder, Kuzman Ganchev, Dipanjan Das, Mirella Lapata:
QAmeleon: Multilingual QA with Only 5 Examples. CoRR abs/2211.08264 (2022) - [i54]Samuel Cahyawijaya, Holy Lovenia, Alham Fikri Aji, Genta Indra Winata, Bryan Wilie, Rahmad Mahendra, Christian Wibisono, Ade Romadhony, Karissa Vincentio, Fajri Koto, Jennifer Santoso, David Moeljadi, Cahya Wirawan, Frederikus Hudi, Ivan Halim Parmonangan, Ika Alfina, Muhammad Satrio Wicaksono, Ilham Firdausi Putra, Samsul Rahmadani, Yulianti Oenang, Ali Akbar Septiandri, James Jaya, Kaustubh D. Dhole, Arie Ardiyanti Suryani, Rifki Afina Putri, Dan Su, Keith Stevens, Made Nindyatama Nityasya, Muhammad Farid Adilazuarda, Ryan Ignatius, Ryandito Diandaru, Tiezheng Yu, Vito Ghifari, Wenliang Dai, Yan Xu, Dyah Damapuspita, Cuk Tho, Ichwanul Muslim Karo Karo, Tirana Noor Fatyanosa, Ziwei Ji, Pascale Fung, Graham Neubig, Timothy Baldwin, Sebastian Ruder, Herry Sujaini, Sakriani Sakti, Ayu Purwarianti:
NusaCrowd: Open Source Initiative for Indonesian NLP Resources. CoRR abs/2212.09648 (2022) - 2021
- [j2]David Ifeoluwa Adelani, Jade Z. Abbott, Graham Neubig, Daniel D'souza, Julia Kreutzer, Constantine Lignos, Chester Palen-Michel, Happy Buzaaba, Shruti Rijhwani, Sebastian Ruder, Stephen Mayhew, Israel Abebe Azime, Shamsuddeen Hassan Muhammad, Chris Chinenye Emezue, Joyce Nakatumba-Nabende, Perez Ogayo, Aremu Anuoluwapo, Catherine Gitau, Derguene Mbaye, Jesujoba O. Alabi, Seid Muhie Yimam, Tajuddeen Gwadabe, Ignatius Ezeani, Rubungo Andre Niyongabo, Jonathan Mukiibi, Verrah Otiende, Iroro Orife, Davis David, Samba Ngom, Tosin P. Adewumi, Paul Rayson, Mofetoluwa Adeyemi, Gerald Muriuki, Emmanuel Anebi, Chiamaka Chukwuneke, Nkiruka Odu, Eric Peter Wairagala, Samuel Oyerinde, Clemencia Siro, Tobius Saul Bateesa, Temilola Oloyede, Yvonne Wambui, Victor Akinode, Deborah Nabagereka, Maurice Katusiime, Ayodele Awokoya, Mouhamadane Mboup, Dibora Gebreyohannes, Henok Tilaye, Kelechi Nwaike, Degaga Wolde, Abdoulaye Faye, Blessing K. Sibanda, Orevaoghene Ahia, Bonaventure F. P. Dossou, Kelechi Ogueji, Thierno Ibrahima Diop, Abdoulaye Diallo, Adewale Akinfaderin, Tendai Marengereke, Salomey Osei:
MasakhaNER: Named Entity Recognition for African Languages. Trans. Assoc. Comput. Linguistics 9: 1116-1131 (2021) - [c42]Nicolas Garneau, Mareike Hartmann, Anders Sandholm, Sebastian Ruder, Ivan Vulic, Anders Søgaard:
Analogy Training Multilingual Encoders. AAAI 2021: 12884-12892 - [c41]Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, James Henderson:
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks. ACL/IJCNLP (1) 2021: 565-576 - [c40]Phillip Rust, Jonas Pfeiffer, Ivan Vulic, Sebastian Ruder, Iryna Gurevych:
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models. ACL/IJCNLP (1) 2021: 3118-3135 - [c39]Xinyi Wang, Yulia Tsvetkov, Sebastian Ruder, Graham Neubig:
Efficient Test Time Adapter Ensembling for Low-resource Language Varieties. EMNLP (Findings) 2021: 730-737 - [c38]Alan Ansell, Edoardo Maria Ponti, Jonas Pfeiffer, Sebastian Ruder, Goran Glavas, Ivan Vulic, Anna Korhonen:
MAD-G: Multilingual Adapter Generation for Efficient Cross-Lingual Transfer. EMNLP (Findings) 2021: 4762-4781 - [c37]Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung:
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation. EMNLP (1) 2021: 8875-8898 - [c36]Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder:
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts. EMNLP (1) 2021: 10186-10203 - [c35]Sebastian Ruder, Noah Constant, Jan A. Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Dan Garrette, Graham Neubig, Melvin Johnson:
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. EMNLP (1) 2021: 10215-10245 - [c34]Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder:
Rethinking Embedding Coupling in Pre-trained Language Models. ICLR 2021 - [c33]Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler:
Long Range Arena : A Benchmark for Efficient Transformers. ICLR 2021 - [c32]Xinyi Wang, Sebastian Ruder, Graham Neubig:
Multi-view Subword Regularization. NAACL-HLT 2021: 473-482 - [c31]Stefan Daniel Dumitrescu, Petru Rebeja, Beáta Lorincz, Mihaela Gaman, Andrei-Marius Avram, Mihai Ilie, Andrei Pruteanu, Adriana Stan, Lorena Rosia, Cristina Iacobescu, Luciana Morogan, George Dima, Gabriel Marchidan, Traian Rebedea, Madalina Chitez, Dani Yogatama, Sebastian Ruder, Radu Tudor Ionescu, Razvan Pascanu, Viorica Patraucean:
LiRo: Benchmark and leaderboard for Romanian language tasks. NeurIPS Datasets and Benchmarks 2021 - [c30]Rabeeh Karimi Mahabadi, James Henderson, Sebastian Ruder:
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers. NeurIPS 2021: 1022-1035 - [c29]Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Tomás Kociský, Sebastian Ruder, Dani Yogatama, Kris Cao, Susannah Young, Phil Blunsom:
Mind the Gap: Assessing Temporal Generalization in Neural Language Models. NeurIPS 2021: 29348-29363 - [i53]Angeliki Lazaridou, Adhiguna Kuncoro, Elena Gribovskaya, Devang Agrawal, Adam Liska, Tayfun Terzi, Mai Gimenez, Cyprien de Masson d'Autume, Sebastian Ruder, Dani Yogatama, Kris Cao, Tomás Kociský, Susannah Young, Phil Blunsom:
Pitfalls of Static Language Modelling. CoRR abs/2102.01951 (2021) - [i52]Xinyi Wang, Sebastian Ruder, Graham Neubig:
Multi-view Subword Regularization. CoRR abs/2103.08490 (2021) - [i51]David Ifeoluwa Adelani, Jade Z. Abbott, Graham Neubig, Daniel D'souza, Julia Kreutzer, Constantine Lignos, Chester Palen-Michel, Happy Buzaaba, Shruti Rijhwani, Sebastian Ruder, Stephen Mayhew, Israel Abebe Azime, Shamsuddeen Hassan Muhammad, Chris Chinenye Emezue, Joyce Nakatumba-Nabende, Perez Ogayo, Aremu Anuoluwapo, Catherine Gitau, Derguene Mbaye, Jesujoba O. Alabi, Seid Muhie Yimam, Tajuddeen Gwadabe, Ignatius Ezeani, Rubungo Andre Niyongabo, Jonathan Mukiibi, Verrah Otiende, Iroro Orife, Davis David, Samba Ngom, Tosin P. Adewumi, Paul Rayson, Mofetoluwa Adeyemi, Gerald Muriuki, Emmanuel Anebi, Chiamaka Chukwuneke, Nkiruka Odu, Eric Peter Wairagala, Samuel Oyerinde, Clemencia Siro, Tobius Saul Bateesa, Temilola Oloyede, Yvonne Wambui, Victor Akinode, Deborah Nabagereka, Maurice Katusiime, Ayodele Awokoya, Mouhamadane Mboup, Dibora Gebreyohannes, Henok Tilaye, Kelechi Nwaike, Degaga Wolde, Abdoulaye Faye, Blessing K. Sibanda, Orevaoghene Ahia, Bonaventure F. P. Dossou, Kelechi Ogueji, Thierno Ibrahima Diop, Abdoulaye Diallo, Adewale Akinfaderin, Tendai Marengereke, Salomey Osei:
MasakhaNER: Named Entity Recognition for African Languages. AfricaNLP 2021 - [i50]Sebastian Ruder, Noah Constant, Jan A. Botha, Aditya Siddhant, Orhan Firat, Jinlan Fu, Pengfei Liu, Junjie Hu, Graham Neubig, Melvin Johnson:
XTREME-R: Towards More Challenging and Nuanced Multilingual Evaluation. CoRR abs/2104.07412 (2021) - [i49]Samuel Cahyawijaya, Genta Indra Winata, Bryan Wilie, Karissa Vincentio, Xiaohong Li, Adhiguna Kuncoro, Sebastian Ruder, Zhi Yuan Lim, Syafri Bahar, Masayu Leylia Khodra, Ayu Purwarianti, Pascale Fung:
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation. CoRR abs/2104.08200 (2021) - [i48]Michael Tänzer, Sebastian Ruder, Marek Rei:
BERT memorisation and pitfalls in low-resource scenarios. CoRR abs/2105.00828 (2021) - [i47]Rabeeh Karimi Mahabadi, Sebastian Ruder, Mostafa Dehghani, James Henderson:
Parameter-efficient Multi-task Fine-tuning for Transformers via Shared Hypernetworks. CoRR abs/2106.04489 (2021) - [i46]Rabeeh Karimi Mahabadi, James Henderson, Sebastian Ruder:
Compacter: Efficient Low-Rank Hypercomplex Adapter Layers. CoRR abs/2106.04647 (2021) - [i45]Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Prakash Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler:
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization. CoRR abs/2106.12672 (2021) - [i44]Xinyi Wang, Yulia Tsvetkov, Sebastian Ruder, Graham Neubig:
Efficient Test Time Adapter Ensembling for Low-resource Language Varieties. CoRR abs/2109.04877 (2021) - [i43]Yanan Zheng, Jing Zhou, Yujie Qian, Ming Ding, Jian Li, Ruslan Salakhutdinov, Jie Tang, Sebastian Ruder, Zhilin Yang:
FewNLU: Benchmarking State-of-the-Art Methods for Few-Shot Natural Language Understanding. CoRR abs/2109.12742 (2021) - [i42]Paul Michel, Sebastian Ruder, Dani Yogatama:
Balancing Average and Worst-case Accuracy in Multitask Learning. CoRR abs/2110.05838 (2021) - [i41]Vamsi Aribandi, Yi Tay, Tal Schuster, Jinfeng Rao, Huaixiu Steven Zheng, Sanket Vaibhav Mehta, Honglei Zhuang, Vinh Q. Tran, Dara Bahri, Jianmo Ni, Jai Prakash Gupta, Kai Hui, Sebastian Ruder, Donald Metzler:
ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning. CoRR abs/2111.10952 (2021) - [i40]Kaustubh D. Dhole, Varun Gangal, Sebastian Gehrmann, Aadesh Gupta, Zhenhao Li, Saad Mahamood, Abinaya Mahendiran, Simon Mille, Ashish Srivastava, Samson Tan, Tongshuang Wu, Jascha Sohl-Dickstein, Jinho D. Choi, Eduard H. Hovy, Ondrej Dusek, Sebastian Ruder, Sajant Anand, Nagender Aneja, Rabin Banjade, Lisa Barthe, Hanna Behnke, Ian Berlot-Attwell, Connor Boyle, Caroline Brun, Marco Antonio Sobrevilla Cabezudo, Samuel Cahyawijaya, Emile Chapuis, Wanxiang Che, Mukund Choudhary, Christian Clauss, Pierre Colombo, Filip Cornell, Gautier Dagan, Mayukh Das, Tanay Dixit, Thomas Dopierre, Paul-Alexis Dray, Suchitra Dubey, Tatiana Ekeinhor, Marco Di Giovanni, Tanya Goyal, Rishabh Gupta, Louanes Hamla, Sang Han, Fabrice Harel-Canada, Antoine Honore, Ishan Jindal, Przemyslaw K. Joniak, Denis Kleyko, Venelin Kovatchev, Kalpesh Krishna, Ashutosh Kumar, Stefan Langer, Seungjae Ryan Lee, Corey James Levinson, Hualou Liang, Kaizhao Liang, Zhexiong Liu, Andrey Lukyanenko, Vukosi Marivate, Gerard de Melo, Simon Meoni, Maxime Meyer, Afnan Mir, Nafise Sadat Moosavi, Niklas Muennighoff, Timothy Sum Hon Mun, Kenton Murray, Marcin Namysl, Maria Obedkova, Priti Oli, Nivranshu Pasricha, Jan Pfister, Richard Plant, Vinay Prabhu, Vasile Pais, Libo Qin, Shahab Raji, Pawan Kumar Rajpoot, Vikas Raunak, Roy Rinberg, Nicholas Roberts, Juan Diego Rodriguez, Claude Roux, Paulo Henrique Santos Vasconcellos, Ananya B. Sai, Robin M. Schmidt, Thomas Scialom, Tshephisho Sefara, Saqib Shamsi, Xudong Shen, Yiwen Shi, Haoyue Shi, Anna Shvets, Nick Siegel, Damien Sileo, Jamie Simon, Chandan Singh, Roman Sitelew, Priyank Soni, Taylor Sorensen, William Soto, Aman Srivastava, K. V. Aditya Srivatsa, Tony Sun, Mukund Varma T., A. Tabassum, Fiona Anting Tan, Ryan Teehan, Mo Tiwari, Marie Tolkiehn, Athena Wang, Zijian Wang, Zijie J. Wang, Gloria Wang, Fuxuan Wei, Bryan Wilie, Genta Indra Winata, Xinyi Wu, Witold Wydmanski, Tianbao Xie, Usama Yaseen, Michael A. Yee, Jing Zhang, Yue Zhang:
NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation. CoRR abs/2112.02721 (2021) - 2020
- [c28]Mikel Artetxe, Sebastian Ruder, Dani Yogatama:
On the Cross-lingual Transferability of Monolingual Representations. ACL 2020: 4623-4637 - [c27]Mikel Artetxe, Sebastian Ruder, Dani Yogatama, Gorka Labaka, Eneko Agirre:
A Call for More Rigor in Unsupervised Cross-lingual Learning. ACL 2020: 7375-7388 - [c26]Paula Czarnowska, Sebastian Ruder, Ryan Cotterell, Ann A. Copestake:
Morphologically Aware Word-Level Translation. COLING 2020: 2847-2860 - [c25]Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, Aishwarya Kamath, Ivan Vulic, Sebastian Ruder, Kyunghyun Cho, Iryna Gurevych:
AdapterHub: A Framework for Adapting Transformers. EMNLP (Demos) 2020: 46-54 - [c24]Ivan Vulic, Sebastian Ruder, Anders Søgaard:
Are All Good Word Vector Spaces Isomorphic? EMNLP (1) 2020: 3178-3192 - [c23]Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder:
MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual Transfer. EMNLP (1) 2020: 7654-7673 - [c22]Marcin Kardas, Piotr Czapla, Pontus Stenetorp, Sebastian Ruder, Sebastian Riedel, Ross Taylor, Robert Stojnic:
AxCell: Automatic Extraction of Results from Machine Learning Papers. EMNLP (1) 2020: 8580-8594 - [c21]Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson:
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation. ICML 2020: 4411-4421 - [i39]Junjie Hu, Sebastian Ruder, Aditya Siddhant, Graham Neubig, Orhan Firat, Melvin Johnson:
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization. CoRR abs/2003.11080 (2020) - [i38]Ivan Vulic, Sebastian Ruder, Anders Søgaard:
Are All Good Word Vector Spaces Isomorphic? CoRR abs/2004.04070 (2020) - [i37]Marcin Kardas, Piotr Czapla, Pontus Stenetorp, Sebastian Ruder, Sebastian Riedel, Ross Taylor, Robert Stojnic:
AxCell: Automatic Extraction of Results from Machine Learning Papers. CoRR abs/2004.14356 (2020) - [i36]Mikel Artetxe, Sebastian Ruder, Dani Yogatama, Gorka Labaka, Eneko Agirre:
A Call for More Rigor in Unsupervised Cross-lingual Learning. CoRR abs/2004.14958 (2020) - [i35]Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder:
MAD-X: An Adapter-based Framework for Multi-task Cross-lingual Transfer. CoRR abs/2005.00052 (2020) - [i34]Jonas Pfeiffer, Andreas Rücklé, Clifton Poth, Aishwarya Kamath, Ivan Vulic, Sebastian Ruder, Kyunghyun Cho, Iryna Gurevych:
AdapterHub: A Framework for Adapting Transformers. CoRR abs/2007.07779 (2020) - [i33]Hyung Won Chung, Thibault Févry, Henry Tsai, Melvin Johnson, Sebastian Ruder:
Rethinking embedding coupling in pre-trained language models. CoRR abs/2010.12821 (2020) - [i32]Yi Tay, Mostafa Dehghani, Samira Abnar, Yikang Shen, Dara Bahri, Philip Pham, Jinfeng Rao, Liu Yang, Sebastian Ruder, Donald Metzler:
Long Range Arena: A Benchmark for Efficient Transformers. CoRR abs/2011.04006 (2020) - [i31]Paula Czarnowska, Sebastian Ruder, Ryan Cotterell, Ann A. Copestake:
Morphologically Aware Word-Level Translation. CoRR abs/2011.07593 (2020) - [i30]Jonas Pfeiffer, Ivan Vulic, Iryna Gurevych, Sebastian Ruder:
UNKs Everywhere: Adapting Multilingual Language Models to New Scripts. CoRR abs/2012.15562 (2020) - [i29]Phillip Rust, Jonas Pfeiffer, Ivan Vulic, Sebastian Ruder, Iryna Gurevych:
How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models. CoRR abs/2012.15613 (2020)
2010 – 2019
- 2019
- [b1]Anders Søgaard, Ivan Vulic, Sebastian Ruder, Manaal Faruqui:
Cross-Lingual Word Embeddings. Synthesis Lectures on Human Language Technologies, Morgan & Claypool Publishers 2019, ISBN 978-3-031-01043-9 - [j1]Sebastian Ruder, Ivan Vulic, Anders Søgaard:
A Survey of Cross-lingual Word Embedding Models. J. Artif. Intell. Res. 65: 569-631 (2019) - [c20]Sebastian Ruder, Joachim Bingel, Isabelle Augenstein, Anders Søgaard:
Latent Multi-Task Architecture Learning. AAAI 2019: 4822-4829 - [c19]Victor Sanh, Thomas Wolf, Sebastian Ruder:
A Hierarchical Multi-Task Approach for Learning Embeddings from Semantic Tasks. AAAI 2019: 6949-6956 - [c18]Sebastian Ruder, Anders Søgaard, Ivan Vulic:
Unsupervised Cross-Lingual Representation Learning. ACL (4) 2019: 31-38 - [c17]Goran Glavas, Robert Litschko, Sebastian Ruder, Ivan Vulic:
How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions. ACL (1) 2019: 710-721 - [c16]Paula Czarnowska, Sebastian Ruder, Edouard Grave, Ryan Cotterell, Ann A. Copestake:
Don't Forget the Long Tail! A Comprehensive Analysis of Morphological Generalization in Bilingual Lexicon Induction. EMNLP/IJCNLP (1) 2019: 974-983 - [c15]Julian Eisenschlos, Sebastian Ruder, Piotr Czapla, Marcin Kardas, Sylvain Gugger, Jeremy Howard:
MultiFiT: Efficient Multi-lingual Language Model Fine-tuning. EMNLP/IJCNLP (1) 2019: 5701-5706 - [c14]Sebastian Ruder, Matthew E. Peters, Swabha Swayamdipta, Thomas Wolf:
Transfer Learning in Natural Language Processing. NAACL-HLT (Tutorial Abstracts) 2019: 15-18 - [c13]Cyprien de Masson d'Autume, Sebastian Ruder, Lingpeng Kong, Dani Yogatama:
Episodic Memory in Lifelong Language Learning. NeurIPS 2019: 13122-13131 - [c12]Matthew E. Peters, Sebastian Ruder, Noah A. Smith:
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks. RepL4NLP@ACL 2019: 7-14 - [e1]Isabelle Augenstein, Spandana Gella, Sebastian Ruder, Katharina Kann, Burcu Can, Johannes Welbl, Alexis Conneau, Xiang Ren, Marek Rei:
Proceedings of the 4th Workshop on Representation Learning for NLP, RepL4NLP@ACL 2019, Florence, Italy, August 2, 2019. Association for Computational Linguistics 2019, ISBN 978-1-950737-35-2 [contents] - [i28]Goran Glavas, Robert Litschko, Sebastian Ruder, Ivan Vulic:
How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptions. CoRR abs/1902.00508 (2019) - [i27]Matthew E. Peters, Sebastian Ruder, Noah A. Smith:
To Tune or Not to Tune? Adapting Pretrained Representations to Diverse Tasks. CoRR abs/1903.05987 (2019) - [i26]Cyprien de Masson d'Autume, Sebastian Ruder, Lingpeng Kong, Dani Yogatama:
Episodic Memory in Lifelong Language Learning. CoRR abs/1906.01076 (2019) - [i25]Paula Czarnowska, Sebastian Ruder, Edouard Grave, Ryan Cotterell, Ann A. Copestake:
Don't Forget the Long Tail! A Comprehensive Analysis of Morphological Generalization in Bilingual Lexicon Induction. CoRR abs/1909.02855 (2019) - [i24]Jonas Pfeiffer, Aishwarya Kamath, Iryna Gurevych, Sebastian Ruder:
What do Deep Networks Like to Read? CoRR abs/1909.04547 (2019) - [i23]Julian Eisenschlos, Sebastian Ruder, Piotr Czapla, Marcin Kardas, Sylvain Gugger, Jeremy Howard:
MultiFiT: Efficient Multi-lingual Language Model Fine-tuning. CoRR abs/1909.04761 (2019) - [i22]Mikel Artetxe, Sebastian Ruder, Dani Yogatama:
On the Cross-lingual Transferability of Monolingual Representations. CoRR abs/1910.11856 (2019) - 2018
- [c11]Jeremy Howard, Sebastian Ruder:
Universal Language Model Fine-tuning for Text Classification. ACL (1) 2018: 328-339 - [c10]Anders Søgaard, Sebastian Ruder, Ivan Vulic:
On the Limitations of Unsupervised Bilingual Dictionary Induction. ACL (1) 2018: 778-788 - [c9]Sebastian Ruder, Barbara Plank:
Strong Baselines for Neural Semi-Supervised Learning under Domain Shift. ACL (1) 2018: 1044-1054 - [c8]Yova Kementchedjhieva, Sebastian Ruder, Ryan Cotterell, Anders Søgaard:
Generalizing Procrustes Analysis for Better Bilingual Dictionary Induction. CoNLL 2018: 211-220 - [c7]Sebastian Ruder, Ryan Cotterell, Yova Kementchedjhieva, Anders Søgaard:
A Discriminative Latent-Variable Model for Bilingual Lexicon Induction. EMNLP 2018: 458-468 - [c6]Sebastian Ruder, John Glover, Afshin Mehrabani, Parsa Ghaffari:
360° Stance Detection. NAACL-HLT (Demonstrations) 2018: 31-35 - [c5]Isabelle Augenstein, Sebastian Ruder, Anders Søgaard:
Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces. NAACL-HLT 2018: 1896-1906 - [i21]Jeremy Howard, Sebastian Ruder:
Fine-tuned Language Models for Text Classification. CoRR abs/1801.06146 (2018) - [i20]Isabelle Augenstein, Sebastian Ruder, Anders Søgaard:
Multi-task Learning of Pairwise Sequence Classification Tasks Over Disparate Label Spaces. CoRR abs/1802.09913 (2018) - [i19]Sebastian Ruder, John Glover, Afshin Mehrabani, Parsa Ghaffari:
360° Stance Detection. CoRR abs/1804.00982 (2018) - [i18]Sebastian Ruder, Barbara Plank:
Strong Baselines for Neural Semi-supervised Learning under Domain Shift. CoRR abs/1804.09530 (2018) - [i17]Anders Søgaard, Sebastian Ruder, Ivan Vulic:
On the Limitations of Unsupervised Bilingual Dictionary Induction. CoRR abs/1805.03620 (2018) - [i16]Sebastian Ruder, Ryan Cotterell, Yova Kementchedjhieva, Anders Søgaard:
A Discriminative Latent-Variable Model for Bilingual Lexicon Induction. CoRR abs/1808.09334 (2018) - [i15]Yova Kementchedjhieva, Sebastian Ruder, Ryan Cotterell, Anders Søgaard:
Generalizing Procrustes Analysis for Better Bilingual Dictionary Induction. CoRR abs/1809.00064 (2018) - [i14]Chris Hokamp, Sebastian Ruder, John Glover:
Off-the-Shelf Unsupervised NMT. CoRR abs/1811.02278 (2018) - [i13]Victor Sanh, Thomas Wolf, Sebastian Ruder:
A Hierarchical Multi-task Approach for Learning Embeddings from Semantic Tasks. CoRR abs/1811.06031 (2018) - 2017
- [c4]Sebastian Ruder, Barbara Plank:
Learning to select data for transfer learning with Bayesian Optimization. EMNLP 2017: 372-382 - [i12]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
Knowledge Adaptation: Teaching to Adapt. CoRR abs/1702.02052 (2017) - [i11]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
Data Selection Strategies for Multi-Domain Sentiment Analysis. CoRR abs/1702.02426 (2017) - [i10]Sebastian Ruder, Joachim Bingel, Isabelle Augenstein, Anders Søgaard:
Sluice networks: Learning what to share between loosely related tasks. CoRR abs/1705.08142 (2017) - [i9]Sebastian Ruder:
A survey of cross-lingual embedding models. CoRR abs/1706.04902 (2017) - [i8]Sebastian Ruder:
An Overview of Multi-Task Learning in Deep Neural Networks. CoRR abs/1706.05098 (2017) - [i7]Sebastian Ruder, Barbara Plank:
Learning to select data for transfer learning with Bayesian Optimization. CoRR abs/1707.05246 (2017) - 2016
- [c3]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis. EMNLP 2016: 999-1005 - [c2]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
INSIGHT-1 at SemEval-2016 Task 4: Convolutional Neural Networks for Sentiment Classification and Quantification. SemEval@NAACL-HLT 2016: 178-182 - [c1]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
INSIGHT-1 at SemEval-2016 Task 5: Deep Learning for Multilingual Aspect-based Sentiment Analysis. SemEval@NAACL-HLT 2016: 330-336 - [i6]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
A Hierarchical Model of Reviews for Aspect-based Sentiment Analysis. CoRR abs/1609.02745 (2016) - [i5]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
INSIGHT-1 at SemEval-2016 Task 4: Convolutional Neural Networks for Sentiment Classification and Quantification. CoRR abs/1609.02746 (2016) - [i4]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
INSIGHT-1 at SemEval-2016 Task 5: Deep Learning for Multilingual Aspect-based Sentiment Analysis. CoRR abs/1609.02748 (2016) - [i3]Sebastian Ruder:
An overview of gradient descent optimization algorithms. CoRR abs/1609.04747 (2016) - [i2]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
Character-level and Multi-channel Convolutional Neural Networks for Large-scale Authorship Attribution. CoRR abs/1609.06686 (2016) - [i1]Sebastian Ruder, Parsa Ghaffari, John G. Breslin:
Towards a continuous modeling of natural language domains. CoRR abs/1610.09158 (2016)
Coauthor Index
manage site settings
To protect your privacy, all features that rely on external API calls from your browser are turned off by default. You need to opt-in for them to become active. All settings here will be stored as cookies with your web browser. For more information see our F.A.Q.
Unpaywalled article links
Add open access links from 
to the list of external document links (if available).
Privacy notice: By enabling the option above, your browser will contact the API of unpaywall.org to load hyperlinks to open access articles. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Unpaywall privacy policy.
Archived links via Wayback Machine
For web page which are no longer available, try to retrieve content from the 
of the Internet Archive (if available).
Privacy notice: By enabling the option above, your browser will contact the API of archive.org to check for archived content of web pages that are no longer available. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Internet Archive privacy policy.
Reference lists
Add a list of references from 
, 
, and 
to record detail pages.
load references from crossref.org and opencitations.net
Privacy notice: By enabling the option above, your browser will contact the APIs of crossref.org, opencitations.net, and semanticscholar.org to load article reference information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the Crossref privacy policy and the OpenCitations privacy policy, as well as the AI2 Privacy Policy covering Semantic Scholar.
Citation data
Add a list of citing articles from and to record detail pages.
load citations from opencitations.net
Privacy notice: By enabling the option above, your browser will contact the API of opencitations.net and semanticscholar.org to load citation information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the OpenCitations privacy policy as well as the AI2 Privacy Policy covering Semantic Scholar.
OpenAlex data
Load additional information about publications from 
.
Privacy notice: By enabling the option above, your browser will contact the API of openalex.org to load additional information. Although we do not have any reason to believe that your call will be tracked, we do not have any control over how the remote server uses your data. So please proceed with care and consider checking the information given by OpenAlex.
last updated on 2024-12-13 19:12 CET by the dblp team
all metadata released as open data under CC0 1.0 license
see also: Terms of Use | Privacy Policy | Imprint
dblp was originally created in 1993 at:
since 2018, dblp has been operated and maintained by:
the dblp computer science bibliography is funded and supported by:
