D-Index & Metrics Best Publications
Research.com 2022 Rising Star of Science Award Badge

D-Index & Metrics D-index (Discipline H-index) only includes papers and citation values for an examined discipline in contrast to General H-index which accounts for publications across all disciplines.

Discipline name D-index D-index (Discipline H-index) only includes papers and citation values for an examined discipline in contrast to General H-index which accounts for publications across all disciplines. Citations Publications World Ranking National Ranking
Rising Stars D-index 39 Citations 6,858 97 World Ranking 628 National Ranking 131
Computer Science D-index 43 Citations 6,954 118 World Ranking 5069 National Ranking 2492

Research.com Recognitions

Awards & Achievements

2022 - Research.com Rising Star of Science Award

Overview

What is he best known for?

The fields of study he is best known for:

  • Artificial intelligence
  • Machine learning
  • Statistics

Tengyu Ma mostly deals with Artificial intelligence, Artificial neural network, Algorithm, Gradient descent and Machine learning. His work deals with themes such as Residual and Natural language processing, which intersect with Artificial intelligence. His Artificial neural network study incorporates themes from Paraphrase, Generative grammar, Generative model and Mathematical optimization.

His Generative model research integrates issues from Smoothing, Speech recognition, Sentence, Unsupervised learning and Transfer of learning. His work on Communication complexity and Data point as part of his general Algorithm study is frequently connected to Function and Upper and lower bounds, thereby bridging the divide between different branches of science. Tengyu Ma has included themes like Time complexity, Stochastic gradient descent and Conjecture in his Gradient descent study.

His most cited work include:

  • A Simple but Tough-to-Beat Baseline for Sentence Embeddings (720 citations)
  • Matrix Completion has No Spurious Local Minimum (362 citations)
  • Generalization and Equilibrium in Generative Adversarial Nets (GANs) (297 citations)

What are the main themes of his work throughout his whole career to date?

His primary areas of study are Artificial neural network, Artificial intelligence, Mathematical optimization, Algorithm and Machine learning. His Gradient descent and Stochastic gradient descent study in the realm of Artificial neural network connects with subjects such as Polynomial and Metric. His research investigates the connection with Gradient descent and areas like Combinatorics which intersect with concerns in Regret.

His work in Artificial intelligence addresses subjects such as Pattern recognition, which are connected to disciplines such as Noise reduction. His biological study spans a wide range of topics, including Normalization, Estimator, Latent variable and Inference. His studies deal with areas such as Theoretical computer science and Natural language processing as well as Word.

He most often published in these fields:

  • Artificial neural network (31.30%)
  • Artificial intelligence (29.01%)
  • Mathematical optimization (16.79%)

What were the highlights of his more recent work (between 2019-2021)?

  • Artificial intelligence (29.01%)
  • Artificial neural network (31.30%)
  • Regularization (14.50%)

In recent papers he was focusing on the following fields of study:

The scientist’s investigation covers issues in Artificial intelligence, Artificial neural network, Regularization, Machine learning and Stochastic gradient descent. His Artificial intelligence study integrates concerns from other disciplines, such as Standard model and Pattern recognition. Tengyu Ma interconnects Margin and Combinatorics in the investigation of issues within Artificial neural network.

The Regularization study combines topics in areas such as Sample size determination, Linear regression and Deep neural networks. His research integrates issues of Data point and Conjugate gradient method in his study of Machine learning. His work carried out in the field of Stochastic gradient descent brings together such families of science as Mathematical optimization, Leverage and Applied mathematics.

Between 2019 and 2021, his most popular works were:

  • MOPO: Model-based Offline Policy Optimization (50 citations)
  • Optimal Regularization Can Mitigate Double Descent (27 citations)
  • Understanding Self-Training for Gradual Domain Adaptation (18 citations)

In his most recent research, the most cited papers focused on:

  • Artificial intelligence
  • Machine learning
  • Statistics

His primary scientific interests are in Regularization, Applied mathematics, Stochastic gradient descent, Upper and lower bounds and Algorithm. His Regularization research is multidisciplinary, incorporating perspectives in Artificial neural network and Gradient descent. His Artificial neural network study combines topics from a wide range of disciplines, such as Sample size determination and Linear regression.

The various areas that Tengyu Ma examines in his Applied mathematics study include Stability and Deep neural networks. His Stochastic gradient descent study combines topics in areas such as Covariance and Gaussian noise. Tengyu Ma focuses mostly in the field of Algorithm, narrowing it down to matters related to MNIST database and, in some cases, Classifier and Sharpening.

This overview was generated by a machine learning system which analysed the scientist’s body of work. If you have any feedback, you can contact us here.

Best Publications

A Simple but Tough-to-Beat Baseline for Sentence Embeddings

Sanjeev Arora;Yingyu Liang;Tengyu Ma.
international conference on learning representations (2017)

1034 Citations

Matrix Completion has No Spurious Local Minimum

Rong Ge;Jason D. Lee;Tengyu Ma.
neural information processing systems (2016)

507 Citations

Generalization and Equilibrium in Generative Adversarial Nets (GANs)

Sanjeev Arora;Rong Ge;Yingyu Liang;Tengyu Ma.
international conference on machine learning (2017)

484 Citations

Provable Bounds for Learning Some Deep Representations

Sanjeev Arora;Aditya Bhaskara;Rong Ge;Tengyu Ma.
international conference on machine learning (2014)

320 Citations

A Latent Variable Model Approach to PMI-based Word Embeddings

Sanjeev Arora;Yuanzhi Li;Yingyu Liang;Tengyu Ma.
Transactions of the Association for Computational Linguistics (2016)

310 Citations

Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss

Kaidi Cao;Colin Wei;Adrien Gaidon;Nikos Arechiga.
neural information processing systems (2019)

294 Citations

Identity Matters in Deep Learning

Moritz Hardt;Tengyu Ma.
international conference on learning representations (2016)

273 Citations

Finding approximate local minima faster than gradient descent

Naman Agarwal;Zeyuan Allen-Zhu;Brian Bullins;Elad Hazan.
symposium on the theory of computing (2017)

187 Citations

Algorithmic Regularization in Over-parameterized Matrix Sensing and Neural Networks with Quadratic Activations

Yuanzhi Li;Tengyu Ma;Hongyang Zhang.
conference on learning theory (2018)

176 Citations

Fixup Initialization: Residual Learning Without Normalization

Hongyi Zhang;Yann N. Dauphin;Tengyu Ma.
international conference on learning representations (2019)

172 Citations

If you think any of the details on this page are incorrect, let us know.

Contact us

Best Scientists Citing Tengyu Ma

Quanquan Gu

Quanquan Gu

University of California, Los Angeles

Publications: 36

Jason D. Lee

Jason D. Lee

Princeton University

Publications: 35

Michael I. Jordan

Michael I. Jordan

University of California, Berkeley

Publications: 28

Nathan Srebro

Nathan Srebro

Toyota Technological Institute at Chicago

Publications: 25

Ohad Shamir

Ohad Shamir

Weizmann Institute of Science

Publications: 24

Sanjeev Arora

Sanjeev Arora

Princeton University

Publications: 22

John Wright

John Wright

Columbia University

Publications: 21

Sham M. Kakade

Sham M. Kakade

Harvard University

Publications: 20

Yingbin Liang

Yingbin Liang

The Ohio State University

Publications: 19

Andrea Montanari

Andrea Montanari

Stanford University

Publications: 19

Benjamin Recht

Benjamin Recht

University of California, Berkeley

Publications: 17

Peter L. Bartlett

Peter L. Bartlett

Google (United States)

Publications: 16

Tianbao Yang

Tianbao Yang

Texas A&M University

Publications: 16

John C. Duchi

John C. Duchi

Stanford University

Publications: 16

Sergey Levine

Sergey Levine

University of California, Berkeley

Publications: 16

Daniel Soudry

Daniel Soudry

Technion – Israel Institute of Technology

Publications: 15

Trending Scientists

Gang-Jin Wang

Gang-Jin Wang

Hunan University

Greg Corrado

Greg Corrado

Google (United States)

Bruno Brunone

Bruno Brunone

University of Perugia

Ling-Yi Kong

Ling-Yi Kong

China Pharmaceutical University

Armando Jacinto Aguilar-Caballero

Armando Jacinto Aguilar-Caballero

Autonomous University of Yucatán

Keith C. Behnke

Keith C. Behnke

Kansas State University

Ira M. Herman

Ira M. Herman

Tufts University

Klaus Becker

Klaus Becker

University of Hohenheim

Susana Campino

Susana Campino

London School of Hygiene & Tropical Medicine

Markus D. Petters

Markus D. Petters

North Carolina State University

Ralf Toumi

Ralf Toumi

Imperial College London

Brian M. Johnstone

Brian M. Johnstone

University of Western Australia

Jonathan Cebon

Jonathan Cebon

La Trobe University

Pasquale Montagna

Pasquale Montagna

University of Bologna

Christos Pitsavos

Christos Pitsavos

National and Kapodistrian University of Athens

Something went wrong. Please try again later.