filler

This page contains a representative selection of my publications, categorized and arranged in reverse chronological order. Use the "»" button to reveal an abstract of each publication, and "«" to hide the abstract again (requires Javascript).

Books

  • L. Busoniu, L. Tamas (editors), Handling Uncertainty and Networked Structure in Robot Control, Springer, Series Studies in Systems, Decision and Control. February 2016, ISBN 978-3-319-26327-4. »
  • L. Busoniu, R. Babuska, B. De Schutter, D. Ernst, Reinforcement Learning and Dynamic Programming Using Function Approximators, CRC Press, Series Automation and Control Engineering. April 2010, 280 pages, ISBN 978-1439821084. »

Journal papers

  • L. Busoniu, J. Daafouz, M.-C. Bragagnolo, C. Morarescu, Planning for optimal control and performance certification in nonlinear systems with controlled or uncontrolled switches. Automatica, vol. 78, pages 297–308, 2017. In press. »
  • R. Postoyan, L. Busoniu, D. Nesic, J. Daafouz, Stability Analysis of Discrete-Time Infinite-Horizon Optimal Control with Discounted Cost. IEEE Transactions on Automatic Control, 2016. In press. »
  • L. Busoniu, A. Daniels, R. Babuska, Online Learning for Optimistic Planning. Engineering Applications of Artificial Intelligence, vol. 55, pages 60–72, 2016. »
  • L. Busoniu, R. Postoyan, J. Daafouz, Near-optimal Strategies for Nonlinear and Uncertain Networked Control Systems. IEEE Transactions on Automatic Control, vol. 61, no. 8, pages 2124–2139, 2016. In press. »
  • K. Mathe, L. Busoniu, Vision and Control for UAVs: A Survey of General Methods and of Inexpensive Platforms for Infrastructure Inspection. Sensors, vol. 15, no. 7, pages 14887–14916, 2015. »
  • L. Busoniu, C. Morarescu, Topology-Preserving Flocking of Nonlinear Agents Using Optimistic Planning. Control Theory and Technology, vol. 13, no. 1, pages 70–81, 2015. »
  • L. Busoniu, C. Morarescu, Consensus for Black-Box Nonlinear Agents Using Optimistic Optimization. Automatica, vol. 50, no. 4, pages 1201–1208, 2014. »
  • I. Grondman, L. Busoniu, G. Lopes, R. Babuska, A Survey of Actor-Critic Reinforcement Learning: Standard and Natural Policy Gradients. IEEE Transactions on Systems, Man, and Cybernetics—Part C: Applications and Reviews, vol. 42, no. 6, pages 1291–1307, 2012. »
  • I. Grondman, M. Vaandrager, L. Busoniu, R. Babuska, E. Schuitema, Efficient Model Learning Methods for Actor-Critic Control. IEEE Transactions on Systems, Man, and Cybernetics—Part B: Cybernetics, vol. 42, no. 3, pages 591–602, 2012. »
  • S. Adam, L. Busoniu, R. Babuska, Experience Replay for Real-Time Reinforcement Learning Control. IEEE Transactions on Systems, Man, and Cybernetics—Part C: Applications and Reviews, vol. 42, no. 2, pages 201–212, 2012. »
  • L. Busoniu, D. Ernst, B. De Schutter, R. Babuska, Cross-Entropy Optimization of Control Policies with Adaptive Basis Functions. IEEE Transactions on Systems, Man, and Cybernetics—Part B: Cybernetics, vol. 41, no. 1, pages 196–209, 2011. »
  • L. Busoniu, D. Ernst, B. De Schutter, R. Babuska, Approximate Dynamic Programming with a Fuzzy Parametrization. Automatica, vol. 46, no. 5, pages 804–814, 2010. »
  • L. Busoniu, R. Babuska, B. De Schutter, A Comprehensive Survey of Multi-Agent Reinforcement Learning. IEEE Transactions on Systems, Man, and Cybernetics — Part C: Applications and Reviews, vol. 38, no. 2, pages 156–172, 2008. Recipient of the 2009 Andrew P. Sage Award for the best paper published annually in the IEEE Transactions on Systems, Man and Cybernetics. »

Contributions to books

  • E. Pall, L. Tamas, L. Busoniu, Vision-Based Quadcopter Navigation in Structured Environments. In Handling Uncertainty and Structure in Robot Control, L. Busoniu, L. Tamas, Editors, pages 265–290. Springer, 2016. »
  • M. Bragagnolo, C. Morarescu, L. Busoniu, P. Riedinger, Decentralized Formation Control in Fleets of Nonholonomic Robots with a Clustered Pattern. In Handling Uncertainty and Structure in Robot Control, L. Busoniu, L. Tamas, Editors, pages 313–333. Springer, 2016. »
  • L. Busoniu, R. Munos, R. Babuska, A Review of Optimistic Planning in Markov Decision Processes. In Reinforcement Learning and Adaptive Dynamic Programming for Feedback Control, F. Lewis, D. Liu, Editors, series Computational Intelligence, pages 494–516. Wiley, 2012. »
  • L. Busoniu, A. Lazaric, M. Ghavamzadeh, R. Munos, R. Babuska, B. De Schutter, Least-Squares Methods for Policy Iteration. In Reinforcement Learning: State of the Art, M. Wiering, M. van Otterlo, Editors, series Adaptation, Learning, and Optimization, no. 12, pages 75–109. Springer, 2012. »
  • L. Busoniu, R. Babuska, B. De Schutter, Multi-Agent Reinforcement Learning: An Overview. In Innovations in Multi-Agent Systems and Applications, D. Srinivasan, L. Jain, Editors, series Studies in Computational Intelligence, no. 310, pages 183–221. Springer, 2010. »
  • L. Busoniu, B. De Schutter, R. Babuska, Approximate Dynamic Programming and Reinforcement Learning. In Interactive Collaborative Information Systems, R. Babuska, F.C.A. Groen, Editors, series Studies in Computational Intelligence, no. 281, pages 3–44. Springer, 2010. »
  • L. Busoniu, D. Ernst, B. De Schutter, R. Babuska, Continuous-State Reinforcement Learning with Fuzzy Approximation. In Adaptive Agents and Multi-Agent Systems III, K. Tuyls, A. Nowe, Z. Guessoum, D. Kudenko, Editors, series Lecture Notes in Computer Science (Lecture Notes in Artificial Intelligence), vol. 4865, pages 27–43. Springer, 2008. »

Conference papers

  • J. Ben Rejeb, L. Busoniu, I.-C. Morarescu, J. Daafouz, Near-Optimal Control of Nonlinear Switched Systems with Non-Cooperative Switching Rules. Accepted at IEEE American Control Conference (ACC-17), Seattle, USA, 24–26 May 2017. »
  • S. Sabau, I.-C. Morarescu, L. Busoniu, A. Jadbabaie, Decoupled-Dynamics Distributed Control for Strings of Nonlinear Autonomous Agents. Accepted at IEEE American Control Conference (ACC-17), Seattle, USA, 24–26 May 2017. »
  • E. Pall, L. Tamas, L. Busoniu, Analysis and a Home Assistance Application of Online AEMS2 Planning. In Proceedings IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-16), Daejeon, Korea, 9–14 October 2016. »
  • J. Xu, T. van den Boom, L. Busoniu, B. De Schutter, Model Predictive Control for Continuous Piecewise Affine Systems Using Optimistic Optimization. In Proceedings IEEE American Control Conference (ACC-16), Boston, USA, 6–8 July 2016. »
  • L. Busoniu, E. Pall, R. Munos, Discounted Near-Optimal Control of General Continuous-Action Nonlinear Systems Using Optimistic Planning. In Proceedings IEEE American Control Conference (ACC-16), Boston, USA, 6–8 July 2016. »
  • K. Mathe, L. Busoniu, L. Barabas, L. Miclea, J. Braband, C. Iuga, Vision-Based Control of a Quadrotor for an Object Inspection Scenario. In Proceedings 2016 International Conference on Unmanned Aircraft Systems (ICUAS-16), pages 849–857, Arlington, USA, 7–10 June 2016. »
  • J. Xu, L. Busoniu, T. van den Boom, B. De Schutter, Receding-Horizon Control for Max-Plus Linear Systems with Discrete Actions Using Optimistic Planning. In Proceedings 13th International Workshop on Discrete Event Systems (WODES-16), pages 398–403, Xi'an, China, 30 May – 1 June 2016. »
  • L. Busoniu, M.-C. Bragagnolo, J. Daafouz, C. Morarescu, Planning Methods for the Optimal Control and Performance Certification of General Nonlinear Switched Systems. In Proceedings 54th IEEE Conference on Decision and Control (CDC-15), Osaka, Japan, 15–18 December 2015. »
  • T. Wensveen, L. Busoniu, R. Babuska, Real-Time Optimistic Planning with Action Sequences. In Proceedings 20th International Conference on Control Systems and Computer Science (CSCS-15), pages 923–930, Bucharest, Romania, 27–29 May 2015. »
  • R. Postoyan, L. Busoniu, D. Nesic, J. Daafouz, Stability of Infinite-Horizon Optimal Control with Discounted Cost. In Proceedings 53rd IEEE Conference on Decision and Control (CDC-14), pages 3903–3908, Los Angeles, USA, 15–17 December 2014. »
  • K. Mathe, L. Busoniu, R. Munos, B. De Schutter, Optimistic Planning with a Limited Number of Action Switches for Near-Optimal Nonlinear Control. In Proceedings 53rd IEEE Conference on Decision and Control (CDC-14), pages 3518–3523, Los Angeles, USA, 15–17 December 2014. »
  • L. Busoniu, R. Munos, Elod Pall, An Analysis of Optimistic, Best-First Search for Minimax Sequential Decision Making. In Proceedings IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-14), pages 1–8, Orlando, USA, 10–13 December 2014. »
  • L. Busoniu, L. Tamas, Optimistic Planning for the Near-Optimal Control of General Nonlinear Systems with Continuous Transition Distributions. In Proceedings 19th IFAC World Congress (IFAC-14), pages 1910–1915, Cape Town, South Africa, 24–29 August 2014. »
  • K. Mathe, L. Busoniu, L. Miclea, Optimistic Planning with Long Sequences of Identical Actions for Near-Optimal Nonlinear Control. In Proceedings 2014 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR-14), Cluj-Napoca, Romania, 22–24 May 2014. »
  • E. Pall, K. Mathe, L. Tamas, L. Busoniu, Railway Track Following with the AR.Drone Using Vanishing Point Detection. In Proceedings 2014 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR-14), Cluj-Napoca, Romania, 22–24 May 2014. »
  • L. Busoniu, C. Morarescu, Consensus for Agents with General Dynamics Using Optimistic Optimization. In Proceedings 2013 Conference on Decision and Control (CDC-13), Florence, Italy, 10–13 December 2013. »
  • L. Busoniu, R. Postoyan, J. Daafouz, Near-Optimal Strategies for Nonlinear Networked Control Systems Using Optimistic Planning. In Proceedings 2013 American Control Conference (ACC-13), Washington DC, US, 17–19 June 2013. »
  • L. Busoniu, C. Morarescu, Optimistic Planning for Consensus. In Proceedings 2013 American Control Conference (ACC-13), Washington DC, US, 17–19 June 2013. »
  • L. Busoniu, A. Daniels, R. Munos, R. Babuska, Optimistic Planning for Continuous-Action Deterministic Systems. In Proceedings 2013 Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-13), Singapore, 15–19 April 2013. »
  • R. Fonteneau, L. Busoniu, R. Munos, Optimistic Planning for Belief-Augmented Markov Decision Processes. In Proceedings 2013 Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-13), Singapore, 15–19 April 2013. »
  • I. Grondman, L. Busoniu, R. Babuska, Model-Learning Actor-Critic Algorithms: Performance Evaluation in a Motion Control Task. In Proceedings 51st IEEE Conference on Decision and Control (CDC-12), pages 5272–5277, Maui, Hawaii, 10–13 December 2012. »
  • M. Vaandrager, R. Babuska, L. Busoniu, G. Lopes, Imitation Learning with Non-Parametric Regression. In Proceedings 2012 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR-12), pages 91–96, Cluj-Napoca, Romania, 24–27 May 2012. »
  • L. Busoniu, R. Munos, Optimistic Planning for Markov Decision Processes. In Proceedings 15th International Conference on Artificial Intelligence and Statistics (AISTATS-12), pages 182–189, La Palma, Canary Islands, Spain, 21–23 April 2012. »
  • S. Norrouzadeh, L. Busoniu, R. Babuska, Efficient Knowledge Transfer in Shaping Reinforcement Learning. In Proceedings 18th IFAC World Congress (IFAC-11), Milano, Italy, 22 August–2 September 2011. »
  • I. Grondman, M. Vaandrager, L. Busoniu, R. Babuska, E. Schuitema, Actor-Critic Control with Reference Model Learning. In Proceedings 18th IFAC World Congress (IFAC-11), pages 14723–14728, Milano, Italy, 22 August–2 September 2011. »
  • L. Busoniu, R. Munos, B. De Schutter, R. Babuska, Optimistic Planning for Sparsely Stochastic Systems. In Proceedings 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11), pages 48–55, Paris, France, 11–15 April 2011. Part of the Special Session on Active Reinforcement Learning. »
  • L. Busoniu, D. Ernst, B. De Schutter, R. Babuska, Approximate Reinforcement Learning: An Overview. In Proceedings 2011 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-11), pages 1–8, Paris, France, 11–15 April 2011. »
  • E. Schuitema, L. Busoniu, R. Babuska, P. Jonker, Control Delay in Reinforcement Learning for Real-Time Dynamic Systems: A Memoryless Approach. In Proceedings 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-10), pages 3226–3231, Taipei, Taiwan, 18–22 October 2010. »
  • L. Busoniu, D. Ernst, B. De Schutter, R. Babuska, Online Least-Squares Policy Iteration for Reinforcement Learning Control. In Proceedings 2010 American Control Conference (ACC-10), pages 486–491, Baltimore, United States, 30 June – 2 July 2010. »
  • L. Busoniu, B. De Schutter, R. Babuska, D. Ernst, Using Prior Knowledge to Accelerate Online Least-Squares Policy Iteration. In Proceedings 2010 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR-10), Cluj-Napoca, Romania, 28–30 May 2010. »
  • L. Busoniu, D. Ernst, B. De Schutter, R. Babuska, Policy Search with Cross-Entropy Optimization of Basis Functions. In Proceedings 2009 IEEE International Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL-09), pages 153–160, Nashville, United States, 30 March – 2 April 2009. »
  • X. Yuan, L. Busoniu, R. Babuska, Reinforcement Learning for Elevator Control. In Proceedings 17th IFAC World Congress (IFAC-08), pages 2212–2217, Seoul, Korea, 6–11 July 2008. »
  • L. Busoniu, D. Ernst, B. De Schutter, R. Babuska, Fuzzy Partition Optimization for Approximate Fuzzy Q-iteration. In Proceedings 17th IFAC World Congress (IFAC-08), pages 5629–5634, Seoul, Korea, 6–11 July 2008. »
  • L. Busoniu, D. Ernst, R. Babuska, B. De Schutter, Consistency of Fuzzy Model-Based Reinforcement Learning. In Proceedings 2008 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-08), pages 518–524, Hong Kong, 1–6 June 2008. »
  • L. Busoniu, D. Ernst, R. Babuska, B. De Schutter, Fuzzy Approximation for Convergent Model-Based Reinforcement Learning. In 2007 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE-07), pages 968–973, London, United Kingdom, 23–26 July 2007. »
  • L. Busoniu, D. Ernst, R. Babuska, B. De Schutter, Continuous-State Reinforcement Learning with Fuzzy Approximation. In Adaptive Learning Agents and Multi-Agent Systems (ALAMAS-07) Symposium, pages 21–35, Maastricht, The Netherlands, 2–3 April 2007. »
  • L. Busoniu, B. De Schutter, R. Babuska, Decentralized Reinforcement Learning Control of a Robotic Manipulator. In Proceedings 9th IEEE International Conference on Control, Automation, Robotics and Vision (ICARCV-06), pages 1347–1352, Singapore, 5–8 December 2006. »
  • L. Busoniu, R. Babuska, B. De Schutter, Multi-Agent Reinforcement Learning: A Survey. In Proceedings 9th IEEE International Conference on Control, Automation, Robotics and Vision (ICARCV-06), pages 527–532, Singapore, 5–8 December 2006. »
  • L. Busoniu, B. De Schutter, R. Babuska, Multiagent Reinforcement Learning with Adaptive State Focus. In Proceedings 17th Belgian-Dutch Conference on Artificial Intelligence (BNAIC-05), pages 35–42, Brussels, Belgium, 17–18 October 2005. »

Theses

  • L. Busoniu, Optimistic Planning for Nonlinear Optimal Control and Networked Systems, habilitation thesis, 2015, 155 pages. »
  • L. Busoniu, Reinforcement Learning in Continuous State and Action Spaces, PhD thesis, 2008, 190 pages, ISBN 978-90-9023754-1. »

National journal papers

  • K. Mathe, L. Busoniu, L. Miclea, Optimistic Planning with Long Sequences of Identical Actions: An Extended Theoretical and Experimental Study. Acta Electrotehnica, vol. 56, no. 4, pages 27–34, 2015. »
  • L. Busoniu, B. De Schutter, R. Babuska, D. Ernst, Exploiting Policy Knowledge in Online Least-Squares Policy Iteration: An Empirical Study. Automation, Computers, Applied Mathematics, vol. 19, no. 4, pages 521–529, 2010. »

Abstracts, workshop presentations

  • L. Busoniu, A. Daniels, R. Munos, R. Babuska, Optimistic Planning for Continuous-Action Deterministic Systems. Presented at the 8emes Journees Francophones sur la Planification, la Decision et l'Apprentissage pour la conduite de systemes (JFPDA-13), Lille, France, 1–2 July 2013. »
  • L. Busoniu, R. Munos, B. De Schutter, R. Babuska, Optimistic Planning for Sparsely Stochastic Systems. Presented at the 2011 Workshop on Monte-Carlo Tree Search: Theory and Applications, within the 21st International Conference on Automated Planning and Scheduling (ICAPS-11), Freiburg, Germany, 12 June 2011. »

Disclaimer: The following applies to the papers that are directly available for download as PDF files. This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each copyright holder. In most cases, these works may not be reposted without the explicit permission of the copyright holder. Additionally, the following applies to IEEE material: Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works, must be obtained from the IEEE.