World's Best Scientists 2026 revealed!
Doina Precup

Doina Precup

D-Index & Metrics

Computer Science

D-Index
62
Citations
27205
World Ranking
2827
National Ranking
106

Overview

Doina Precup is affiliated with McGill University in Canada and has made extensive contributions to the field of computer science, specializing primarily in artificial intelligence. Their research spans a broad spectrum of topics, with a particular focus on reinforcement learning and its applications in robotics.

Major areas of study include:

  • Artificial Intelligence
  • Management Science and Operations Research
  • Computational Theory and Mathematics
  • Molecular Biology
  • Materials Chemistry

Their work covers a range of specific topics related to machine learning and algorithm development:

  • Reinforcement Learning in Robotics
  • Advanced Bandit Algorithms Research
  • Machine Learning and Algorithms
  • Adversarial Robustness in Machine Learning
  • Topic Modeling
  • Explainable Artificial Intelligence (XAI)
  • Advanced Graph Neural Networks

Precup has collaborated frequently with several researchers, highlighting interdisciplinary and cooperative research efforts. Notable frequent co-authors include:

  • Khimya Khetarpal
  • Sitao Luan
  • Xiao-Wen Chang
  • David Meger
  • Yoshua Bengio

Their scholarly output has been published in various venues, with a strong presence in both conference proceedings and journals:

  • arXiv (Cornell University)
  • Proceedings of the AAAI Conference on Artificial Intelligence
  • Journal of Artificial Intelligence Research
  • Computing in cardiology
  • Neural Networks

Recent papers authored or co-authored by Precup demonstrate engagement with current topics in reinforcement learning:

  • "Off-Policy Deep Reinforcement Learning without Exploration," 2024, TIB Data Manager
  • "Deep learning, reinforcement learning, and world models," 2022, Neural Networks
  • "Towards Continual Reinforcement Learning: A Review and Perspectives," 2022, Journal of Artificial Intelligence Research
  • "Reward is enough," 2021, Artificial Intelligence
  • "Fast reinforcement learning with generalized policy updates," 2020, Proceedings of the National Academy of Sciences

Overall, Precup's research integrates computational methods with practical applications in robotics and artificial intelligence, contributing to advancements in learning algorithms and their robustness.

Best Publications

  • The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)

    Bjoern H. Menze;Andras Jakab;Stefan Bauer;Jayashree Kalpathy-Cramer

  • Between MDPs and semi-MDPs: a framework for temporal abstraction in reinforcement learning

    Richard S. Sutton;Doina Precup;Satinder Singh

  • Deep Reinforcement Learning That Matters

    Peter Henderson;Riashat Islam;Philip Bachman;Joelle Pineau

  • The Option-Critic Architecture

    Pierre-Luc Bacon;Jean Harb;Doina Precup

  • Eligibility Traces for Off-Policy Policy Evaluation

    Doina Precup;Richard S. Sutton;Satinder P. Singh

  • Fast gradient-descent methods for temporal-difference learning with linear function approximation

    Richard S. Sutton;Hamid Reza Maei;Doina Precup;Shalabh Bhatnagar

  • Off-Policy Deep Reinforcement Learning without Exploration

    Scott Fujimoto;David Meger;Doina Precup

  • Deep learning, reinforcement learning, and world models

    Unknown

  • Horde: a scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction

    Richard S. Sutton;Joseph Modayil;Michael Delp;Thomas Degris

  • Exploring uncertainty measures in deep networks for Multiple sclerosis lesion detection and segmentation.

    Tanya Nair;Doina Precup;Douglas L. Arnold;Tal Arbel

  • Learning with Pseudo-Ensembles

    Phil Bachman;Ouais Alsharif;Doina Precup

  • Off-Policy Temporal Difference Learning with Function Approximation

    Doina Precup;Richard S. Sutton;Sanjoy Dasgupta

  • Learning Options in Reinforcement Learning

    Martin Stolle;Doina Precup

  • Reward is enough

    David Silver;Satinder P. Singh;Doina Precup;Richard S. Sutton

  • Temporal abstraction in reinforcement learning

    Doina Precup;Richard S. Sutton

  • Convergent Temporal-Difference Learning with Arbitrary Smooth Function Approximation

    Shalabh Bhatnagar;Doina Precup;David Silver;Richard S Sutton

  • Algorithms for multi-armed bandit problems.

    Volodymyr Kuleshov;Doina Precup

  • Metrics for finite Markov decision processes

    Norm Ferns;Prakash Panangaden;Doina Precup

  • Conditional Computation in Neural Networks for faster models

    Emmanuel Bengio;Pierre-Luc Bacon;Joelle Pineau;Doina Precup

  • Reproducibility of Benchmarked Deep Reinforcement Learning Tasks for Continuous Control

    Riashat Islam;Peter Henderson;Maziar Gomrokchi;Doina Precup

  • Towards Continual Reinforcement Learning: A Review and Perspectives.

    Khimya Khetarpal;Matthew Riemer;Irina Rish;Doina Precup

  • Off-policy Learning with Options and Recognizers

    Doina Precup;Cosmin Paduraru;Anna Koop;Richard S Sutton

Frequent Co-Authors

Joelle Pineau
Joelle Pineau McGill University
Prakash Panangaden
Prakash Panangaden McGill University
Tal Arbel
Tal Arbel McGill University
Robert E. Kearney
Robert E. Kearney McGill University
Richard S. Sutton
Richard S. Sutton University of Alberta
Satinder Singh
Satinder Singh DeepMind (United Kingdom)
Shie Mannor
Shie Mannor Technion – Israel Institute of Technology
Yoshua Bengio
Yoshua Bengio University of Montreal
Douglas L. Arnold
Douglas L. Arnold Montreal Neurological Institute and Hospital
David Silver
David Silver DeepMind (United Kingdom)

If you think any of the details on this page are incorrect, let us know.

Report an issue

We appreciate your kind effort to assist us to improve this page, it would be helpful providing us with as much detail as possible in the text box below:

Related Online Degrees & Career Pathways

Exploring Computer Science unlocks a variety of versatile career opportunities in technology and beyond. Many students also consider related fields that rank among the top 10 best majors for the future, such as Data Science, Information Technology, and Cybersecurity. These disciplines continue to offer strong job prospects and competitive salaries.

For those seeking advanced credentials, pursuing postgraduate degrees can enhance career growth. Some may prefer programs known to be less demanding yet still valuable. If you’re looking for flexible options, exploring easy masters degrees online can be a wise choice, especially while balancing work and family commitments.

Doctoral-level credentials can significantly advance your expertise. Many affordable choices exist, including cheap doctorate degree online programs that make top qualifications more accessible.

Additionally, if your focus is on education leadership, there are easiest edd programs available through fast-track online formats, presenting a pathway to rapid academic and career progression.

Best Scientists Citing Doina Precup

Trending Scientists

Recently Published Articles