World's Best Scientists 2026 revealed!

D-Index & Metrics

Computer Science

D-Index
39
Citations
11328
World Ranking
9524
National Ranking
4035

Overview

Kyriakos G. Vamvoudakis is affiliated with the Georgia Institute of Technology in the United States. Their research primarily spans the fields of Engineering and Computer Science, with notable contributions in subfields such as Control and Systems Engineering, Artificial Intelligence, Computational Theory and Mathematics, Aerospace Engineering, and Electrical and Electronic Engineering.

Their research topics include:

  • Adaptive Dynamic Programming Control
  • Reinforcement Learning in Robotics
  • Smart Grid Security and Resilience
  • Adaptive Control of Nonlinear Systems
  • Fault Detection and Control Systems
  • Advanced Control Systems Optimization
  • Extremum Seeking Control Systems

Vamvoudakis has published extensively in various respected venues. Frequent publication venues include:

  • arXiv (Cornell University)
  • IEEE Transactions on Neural Networks and Learning Systems
  • Automatica
  • IEEE Control Systems Letters
  • International Journal of Robust and Nonlinear Control

Among Vamvoudakis's recent papers are:

  • "Safe reinforcement learning for dynamical games", 2020, International Journal of Robust and Nonlinear Control
  • "Cooperative Finitely Excited Learning for Dynamical Games", 2023, IEEE Transactions on Cybernetics
  • "A comprehensive survey of research towards AI-enabled unmanned aerial systems in pre-, active-, and post-wildfire management", 2024, Information Fusion
  • "Safe Intermittent Reinforcement Learning With Static and Dynamic Event Generators", 2020, IEEE Transactions on Neural Networks and Learning Systems
  • "Hamiltonian-Driven Adaptive Dynamic Programming With Approximation Errors", 2021, IEEE Transactions on Cybernetics

Their frequent collaborators include:

  • Filippos Fotiadis
  • Aris Kanellopoulos
  • Lijing Zhai
  • Nick-Marios T. Kokolakis
  • Yongliang Yang

Best Publications

  • Online actor-critic algorithm to solve the continuous-time infinite horizon optimal control problem

    Kyriakos G. Vamvoudakis;Frank L. Lewis

  • Reinforcement Learning and Feedback Control: Using Natural Decision Methods to Design Optimal Adaptive Controllers

    F. L. Lewis;D. Vrabie;K. G. Vamvoudakis

  • Optimal and Autonomous Control Using Reinforcement Learning: A Survey

    Bahare Kiumarsi;Kyriakos G. Vamvoudakis;Hamidreza Modares;Frank L. Lewis

  • A novel actor-critic-identifier architecture for approximate optimal control of uncertain nonlinear systems

    S. Bhasin;R. Kamalapurkar;M. Johnson;K. G. Vamvoudakis

  • Multi-agent differential graphical games: Online adaptive learning solution for synchronization with optimality

    Kyriakos G. Vamvoudakis;Frank L. Lewis;Greg R. Hudas

  • Reinforcement Learning for Partially Observable Dynamic Processes: Adaptive Dynamic Programming Using Measured Output Data

    F L Lewis;K G Vamvoudakis

  • Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton-Jacobi equations

    Kyriakos G. Vamvoudakis;Frank L. Lewis

  • Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles

    Draguna L. Vrabie;Kyriakos G. Vamvoudakis;Frank L. Lewis

  • Event-triggered optimal adaptive control algorithm for continuous-time nonlinear systems

    Kyriakos G. Vamvoudakis

  • Online solution of nonlinear two-player zero-sum games using synchronous policy iteration

    Kyriakos G. Vamvoudakis;F.L. Lewis

  • Multi-agent discrete-time graphical games and reinforcement learning solutions

    Mohammed I. Abouheaf;Frank L. Lewis;Kyriakos G. Vamvoudakis;Sofie Haesaert

  • Q-learning for continuous-time linear systems: A model-free infinite horizon optimal control approach

    Kyriakos G. Vamvoudakis

  • Multi-agent zero-sum differential graphical games for disturbance rejection in distributed control

    Qiang Jiao;Hamidreza Modares;Shengyuan Xu;Frank L. Lewis

  • Asymptotically Stable Adaptive–Optimal Control Algorithm With Saturating Actuators and Relaxed Persistence of Excitation

    Kyriakos G. Vamvoudakis;Marcio Fantini Miranda;Joao P. Hespanha

  • Game Theory-Based Control System Algorithms with Real-Time Reinforcement Learning: How to Solve Multiplayer Games Online

    Kyriakos G. Vamvoudakis;Hamidreza Modares;Bahare Kiumarsi;Frank L. Lewis

  • Online adaptive algorithm for optimal control with integral reinforcement learning

    Kyriakos G. Vamvoudakis;Draguna Vrabie;Frank L. Lewis

  • Event‐triggered optimal tracking control of nonlinear systems

    Kyriakos G. Vamvoudakis;Arman Mojoodi;Henrique Ferraz

  • Model-free event-triggered control algorithm for continuous-time linear systems with optimal performance

    Kyriakos G. Vamvoudakis;Henrique Ferraz

  • Cooperative Finitely Excited Learning for Dynamical Games.

    Unknown

  • Detection in Adversarial Environments

    Kyriakos G. Vamvoudakis;João Pedro Hespanha;Bruno Sinopoli;Yilin Mo

  • Non-zero sum Nash Q-learning for unknown deterministic continuous-time linear systems

    Kyriakos G. Vamvoudakis

Frequent Co-Authors

Frank L. Lewis
Frank L. Lewis The University of Texas at Arlington
Hamidreza Modares
Hamidreza Modares Michigan State University
Joao P. Hespanha
Joao P. Hespanha University of California, Santa Barbara
Donald C. Wunsch
Donald C. Wunsch Missouri University of Science and Technology
Warren E. Dixon
Warren E. Dixon University of Florida
Zhong-Ping Jiang
Zhong-Ping Jiang New York University
Vijay Gupta
Vijay Gupta Purdue University West Lafayette
Wassim M. Haddad
Wassim M. Haddad Georgia Institute of Technology
Shengyuan Xu
Shengyuan Xu Nanjing University of Science and Technology
Magnus Egerstedt
Magnus Egerstedt University of North Carolina at Chapel Hill

If you think any of the details on this page are incorrect, let us know.

Report an issue

We appreciate your kind effort to assist us to improve this page, it would be helpful providing us with as much detail as possible in the text box below:

Related Online Degrees & Career Pathways

Exploring related fields and flexible pathways can enhance your Computer Science journey in the USA. For those interested in blending tech and analytics, consider online courses in data science. If affordability is a concern, finding what is the cheapest data science course in the US? can help you make a budget-friendly decision.

Electrical engineering is another closely linked discipline, offering robust online programs with various admission requirements. Learn about electrical engineering degree online admissions to discover how you can broaden your career prospects alongside a Computer Science degree.

For a quicker entry into the tech workforce, some students pursue easy certifications to get online. These certifications can boost employability and earning potential without the commitment of a full degree.

Finally, if you’re focused on advancing quickly, check out the shortest masters degree programs available online. These accelerated options make it possible to earn an advanced credential in less time, helping you fast-track your tech career.

Best Scientists Citing Kyriakos G. Vamvoudakis

Trending Scientists

Recently Published Articles