Zhiyang Xu Chao Feng Rulin Shao Trevor Ashby Ying Shen Di Jin Yu Cheng Qifan Wang Lifu Huang Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning. 2024 abs/2402.11690 CoRR https://doi.org/10.48550/arXiv.2402.11690 db/journals/corr/corr2402.html#abs-2402-11690
Samir Yitzhak Gadre Georgios Smyrnis Vaishaal Shankar Suchin Gururangan Mitchell Wortsman Rulin Shao Jean Mercat Alex Fang Jeffrey Li Sedrick Keh Rui Xin Marianna Nezhurina Igor Vasiljevic Jenia Jitsev Alexandros G. Dimakis Gabriel Ilharco Shuran Song Thomas Kollar Yair Carmon Achal Dave Reinhard Heckel Niklas Muennighoff Ludwig Schmidt Language models scale reliably with over-training and on downstream tasks. 2024 abs/2403.08540 CoRR https://doi.org/10.48550/arXiv.2403.08540 db/journals/corr/corr2403.html#abs-2403-08540
Jeffrey Li Alex Fang Georgios Smyrnis Maor Ivgi Matt Jordan Samir Yitzhak Gadre Hritik Bansal Etash Kumar Guha Sedrick Keh Kushal Arora Saurabh Garg Rui Xin Niklas Muennighoff Reinhard Heckel Jean Mercat Mayee Chen Suchin Gururangan Mitchell Wortsman Alon Albalak Yonatan Bitton Marianna Nezhurina Amro Abbas Cheng-Yu Hsieh Dhruba Ghosh Josh Gardner 0001 Maciej Kilian Hanlin Zhang Rulin Shao Sarah M. Pratt Sunny Sanyal Gabriel Ilharco Giannis Daras Kalyani Marathe Aaron Gokaslan Jieyu Zhang Khyathi Raghavi Chandu Thao Nguyen Igor Vasiljevic Sham M. Kakade Shuran Song Sujay Sanghavi Fartash Faghri Sewoong Oh Luke Zettlemoyer Kyle Lo Alaaeldin El-Nouby Hadi Pouransari Alexander Toshev Stephanie Wang Dirk Groeneveld Luca Soldaini Pang Wei Koh Jenia Jitsev Thomas Kollar Alexandros G. Dimakis Yair Carmon Achal Dave Ludwig Schmidt Vaishaal Shankar DataComp-LM: In search of the next generation of training sets for language models. 2024 abs/2406.11794 CoRR https://doi.org/10.48550/arXiv.2406.11794 db/journals/corr/corr2406.html#abs-2406-11794 streams/journals/corr
Rulin Shao Jacqueline He Akari Asai Weijia Shi Tim Dettmers Sewon Min Luke Zettlemoyer Pang Wei Koh Scaling Retrieval-Based Language Models with a Trillion-Token Datastore. 2024 abs/2407.12854 CoRR https://doi.org/10.48550/arXiv.2407.12854 db/journals/corr/corr2407.html#abs-2407-12854 streams/journals/corr
Jingyuan Qi Zhiyang Xu Rulin Shao Yang Chen Di Jin Yu Cheng Qifan Wang Lifu Huang RoRA-VLM: Robust Retrieval-Augmented Vision Language Models. 2024 abs/2410.08876 CoRR https://doi.org/10.48550/arXiv.2410.08876 db/journals/corr/corr2410.html#abs-2410-08876 streams/journals/corr
Yonatan Bitton Hritik Bansal Jack Hessel Rulin Shao Wanrong Zhu Anas Awadalla Josh Gardner 0001 Rohan Taori Ludwig Schmidt VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Use. 2023 abs/2308.06595 CoRR https://doi.org/10.48550/arXiv.2308.06595 db/journals/corr/corr2308.html#abs-2308-06595
Dacheng Li Rulin Shao Anze Xie Eric P. Xing Joseph E. Gonzalez Ion Stoica Xuezhe Ma Hao Zhang 0108 LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers. 2023 abs/2310.03294 CoRR https://doi.org/10.48550/arXiv.2310.03294 db/journals/corr/corr2310.html#abs-2310-03294
Rulin Shao Zhouxing Shi Jinfeng Yi Pin-Yu Chen Cho-Jui Hsieh On the Adversarial Robustness of Vision Transformers. 2022 2022 Trans. Mach. Learn. Res. https://openreview.net/forum?id=lE7K4n1Esk db/journals/tmlr/tmlr2022.html#ShaoSYCH22
Dacheng Li Rulin Shao Hongyi Wang 0001 Han Guo Eric P. Xing Hao Zhang MPCFormer: fast, performant and private Transformer inference with MPC. 2022 abs/2211.01452 CoRR https://doi.org/10.48550/arXiv.2211.01452 db/journals/corr/corr2211.html#abs-2211-01452
Rohan Pandey Rulin Shao Paul Pu Liang Ruslan Salakhutdinov Louis-Philippe Morency Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment. 2022 abs/2212.10549 CoRR https://doi.org/10.48550/arXiv.2212.10549 db/journals/corr/corr2212.html#abs-2212-10549
Rulin Shao Zhouxing Shi Jinfeng Yi Pin-Yu Chen Cho-Jui Hsieh Robust Text CAPTCHAs Using Adversarial Examples. 2021 abs/2101.02483 CoRR https://arxiv.org/abs/2101.02483 db/journals/corr/corr2101.html#abs-2101-02483
Rulin Shao Zhouxing Shi Jinfeng Yi Pin-Yu Chen Cho-Jui Hsieh On the Adversarial Robustness of Visual Transformers. 2021 abs/2103.15670 CoRR https://arxiv.org/abs/2103.15670 db/journals/corr/corr2103.html#abs-2103-15670
Rulin Shao Jinfeng Yi Pin-Yu Chen Cho-Jui Hsieh How and When Adversarial Robustness Transfers in Knowledge Distillation? 2021 abs/2110.12072 CoRR https://arxiv.org/abs/2110.12072 db/journals/corr/corr2110.html#abs-2110-12072
Rulin Shao Hui Liu Dianbo Liu Privacy Preserving Stochastic Channel-Based Federated Learning with Neural Network Pruning. 2019 abs/1910.02115 CoRR http://arxiv.org/abs/1910.02115 db/journals/corr/corr1910.html#abs-1910-02115
Rulin Shao Hongyu He Hui Liu Dianbo Liu Stochastic Channel-Based Federated Learning for Medical Data Privacy Preserving. 2019 abs/1910.11160 CoRR http://arxiv.org/abs/1910.11160 db/journals/corr/corr1910.html#abs-1910-11160
