World's Best Scientists 2026 revealed!
Award Badge
Mathematics
India
2026

D-Index & Metrics

Mathematics

D-Index
55
Citations
14676
World Ranking
782
National Ranking
7

Electronics and Electrical Engineering

D-Index
52
Citations
14188
World Ranking
2481
National Ranking
18

Research.com Recognitions

  • 2026 - Research.com Mathematics in India Leader Award
  • 2025 - Research.com Mathematics in India Leader Award
  • 2023 - Research.com Mathematics in India Leader Award
  • 2013 - Fellow of the American Mathematical Society
  • 2012 - Fellow, The World Academy of Sciences
  • 2002 - IEEE Fellow For contributions to stochastic and adaptive control.
  • Fellow of the Indian National Academy of Engineering (INAE)
  • Fellow of the Indian National Academy of Engineering (INAE)
  • Fellow of the Indian National Academy of Engineering (INAE)
  • Fellow of the Indian National Academy of Engineering (INAE)
  • Fellow of the Indian National Academy of Engineering (INAE)
  • Fellow of the Indian National Academy of Engineering (INAE)
  • Fellow of the Indian National Academy of Engineering (INAE)
  • Fellow of the Indian National Academy of Engineering (INAE)
  • Fellow of the Indian National Academy of Engineering (INAE)

Overview

Vivek S. Borkar is affiliated with the Indian Institute of Technology Bombay in India. The primary fields of study for this researcher include Computer Science and Engineering, with substantial contributions spanning these disciplines. Their work extensively covers subfields such as Artificial Intelligence, Electrical and Electronic Engineering, Management Science and Operations Research, Computational Theory and Mathematics, and Statistics and Probability.

Their recent published papers reflect a focus on control theory, reinforcement learning, and optimization. Notable publications include:

  • Whittle index based Q-learning for restless bandits with average reward, 2022, Automatica
  • Equation of State Calculations by Fast Computing Machines, 2022, Resonance
  • User Association in Dense mmWave Networks as Restless Bandits, 2022, IEEE Transactions on Vehicular Technology
  • A Variational Characterization of the Risk-Sensitive Average Reward for Controlled Diffusions on ℝ^d, 2020, SIAM Journal on Control and Optimization
  • Ergodic risk-sensitive control-A survey, 2023, Annual Reviews in Control

Their frequent co-authors indicate collaborative research relationships with Konstantin Avrachenkov, Siddharth Chandak, K. S. Mallikarjuna Rao, Gaurav S. Kasbekar, and Ari Arapostathis. These collaborations highlight interdisciplinary engagements primarily within control systems and stochastic processes.

Publication venues for this researcher include:

  • arXiv (Cornell University)
  • Resonance
  • Systems & Control Letters
  • SIAM Journal on Control and Optimization
  • SSRN Electronic Journal

Vivek S. Borkar's book publications have appeared through the outlets "Texts and readings in mathematics" and "Hindustan Book Agency." Titles include "Elementary Convexity with Optimization" (2023) and "Stochastic Approximation: A Dynamical Systems Viewpoint" (2022, 2023), reflecting ongoing contributions to foundational mathematical and computational methods. The book "Stochastic Approximation: A Dynamical Systems Viewpoint" has received notable citations.

The researcher's work focuses on advanced topics such as:

  • Reinforcement Learning in Robotics
  • Markov Chains and Monte Carlo Methods
  • Stochastic processes and financial applications
  • Advanced Bandit Algorithms Research
  • Smart Grid Energy Management
  • Advanced MIMO Systems Optimization
  • Optimization and Variational Analysis

Recognitions awarded include Fellowships from the American Mathematical Society (2013), The World Academy of Sciences (2012), the Indian National Academy of Engineering (INAE), and the IEEE in 2002, where the fellowship was granted for contributions to stochastic and adaptive control.

Best Publications

  • A unified framework for hybrid control: model and optimal control theory

    M.S. Branicky;V.S. Borkar;S.K. Mitter

  • Stochastic Approximation: A Dynamical Systems Viewpoint

    Vivek S. Borkar

  • Discrete-time controlled Markov processes with average cost criterion: a survey

    Aristotle Arapostathis;Vivek S. Borkar;Emmanuel Fernández-Gaucherand;Mrinal K. Ghosh

  • The O.D. E. Method for Convergence of Stochastic Approximation and Reinforcement Learning

    V. S. Borkar;S. P. Meyn

  • Stochastic approximation with two time scales

    Vivek S. Borkar

  • Asymptotic agreement in distributed estimation

    V. Borkar;P. Varaiya

  • A unified framework for hybrid control

    M.S. Branicky;V.S. Borkar;S.K. Mitter

  • A Theory of QoS for Wireless

    I.-H. Hou;V. Borkar;P. R. Kumar

  • Actor-Critic--Type Learning Algorithms for Markov Decision Processes

    Vijaymohan R. Konda;Vivek S. Borkar

  • A New Distributed Time Synchronization Protocol for Multihop Wireless Networks

    Roberto Solis;Vivek S. Borkar;P. R. Kumar

  • Ergodic Control of Diffusion Processes

    Vivek S. Borkar

  • Optimal Control of Diffusion Processes

    Vivek S. Borkar

  • Learning Algorithms for Markov Decision Processes with Average Cost

    J. Abounadi;D. Bertsekas;V. S. Borkar

  • Probability Theory: An Advanced Course

    Vivek S. Borkar

  • An actor-critic algorithm for constrained Markov decision processes

    Vivek S. Borkar

  • Topics in controlled Markov chains

    Vivek S. Borkar

  • Distributed Asynchronous Incremental Subgradient Methods

    A. Nedić;D. P. Bertsekas;V. S. Borkar

  • Asynchronous Stochastic Approximations

    Vivek S. Borkar

  • Adaptive control of Markov chains, I: Finite parameter set

    V. Borkar;P. Varaiya

  • LQG Control with Communication Constraints

    V. S. Borkar;Sanjoy K. Mitter

  • Controlled diffusion processes

    Vivek Borkar

  • Controlled diffusion processes

    Vivek S. Borkar

Frequent Co-Authors

Konstantin Avrachenkov
Konstantin Avrachenkov French Institute for Research in Computer Science and Automation - INRIA
Pravin Varaiya
Pravin Varaiya University of California, Berkeley
Eitan Altman
Eitan Altman French Institute for Research in Computer Science and Automation - INRIA
P. R. Kumar
P. R. Kumar Texas A&M University
Venkat Anantharam
Venkat Anantharam University of California, Berkeley
Sean P. Meyn
Sean P. Meyn University of Florida
Michael S. Branicky
Michael S. Branicky University of Kansas
Dimitri P. Bertsekas
Dimitri P. Bertsekas Arizona State University

If you think any of the details on this page are incorrect, let us know.

Report an issue

We appreciate your kind effort to assist us to improve this page, it would be helpful providing us with as much detail as possible in the text box below:

Related Online Degrees & Career Pathways

Mathematics is a versatile field that opens doors to various online degrees and career options. For professionals looking to expand their business acumen alongside quantitative skills, an fastest MBA online program can provide a quick transition into managerial roles without a long break from work.

For those interested in combining analytical strengths with creative marketing strategies, pursuing an online marketing degree is a cost-effective option that often leads to lucrative careers in digital marketing and data-driven advertising.

Many students seeking an accelerated path choose one year MBA programs, which can enhance leadership skills rapidly while leveraging mathematical expertise for data analysis and strategic planning.

Additionally, for learners with prior coursework, exploring an online MBA with transfer credits accepted can reduce time and tuition costs, making graduate education more accessible and aligned with career goals in fields like finance, operations, or tech.

Best Scientists Citing Vivek S. Borkar

Trending Scientists

Recently Published Articles