Shuming Ma

Best Publications

• Language Is Not All You Need: Aligning Perception with Language Models

  Unknown

  387
  Citations

• Kosmos-2: Grounding Multimodal Large Language Models to the World

  Unknown

  264
  Citations

• DeepNet: Scaling Transformers to 1,000 Layers

  Unknown

  174
  Citations

• Global Encoding for Abstractive Summarization

  Unknown

  162
  Citations

• The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

  Unknown

  157
  Citations

• DeepNet: Scaling Transformers to 1, 000 Layers

  Unknown

  151
  Citations

• Retentive Network: A Successor to Transformer for Large Language Models

  Unknown

  140
  Citations

• Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers

  Unknown

  131
  Citations

• meProp: sparsified back propagation for accelerated deep learning with reduced overfitting

  Xu Sun;Xuancheng Ren;Shuming Ma;Houfeng Wang

  129
  Citations

• Bag-of-Words as Target for Neural Machine Translation

  Unknown

  88
  Citations

• Language Models are General-Purpose Interfaces

  Unknown

  87
  Citations

• Alternating Language Modeling for Cross-Lingual Pre-Training

  Jian Yang;Shuming Ma;Dongdong Zhang;ShuangZhi Wu

  79
  Citations

• XLM-E: Cross-lingual Language Model Pre-training via ELECTRA

  Zewen Chi;Shaohan Huang;Li Dong;Shuming Ma

  72
  Citations

• Query and Output: Generating Words by Querying Distributed Word Representations for Paraphrase Generation

  Shuming Ma;Xu Sun;Wei Li;Sujian Li

  68
  Citations

• Improving Semantic Relevance for Sequence-to-Sequence Learning of Chinese Social Media Text Summarization

  Shuming Ma;Xu Sun;Jingjing Xu;Houfeng Wang

  67
  Citations

• LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens

  Unknown

  66
  Citations

• A Simple and Effective Unified Encoder for Document-Level Machine Translation

  Shuming Ma;Dongdong Zhang;Ming Zhou

  64
  Citations

• A Deep Reinforced Sequence-to-Set Model for Multi-Label Text Classification

  Unknown

  59
  Citations

• Semantic-Unit-Based Dilated Convolution for Multi-Label Text Classification

  Unknown

  57
  Citations

• meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting

  Xu Sun;Xuancheng Ren;Shuming Ma;Houfeng Wang

  56
  Citations