Publications

2026

  1. NeurIPS
    2026
    Dynamic Regret in Online Convex Optimization with Indicator Switching Costs
    N. Mhaisen, G. Iosifidis
    To appear in Advances in Neural Information Processing Systems (NeurIPS), 2026
    Preprint
  2. Partially Lazy Gradient Descent for Smoothed Online Learning
    Partially Lazy Gradient Descent for Smoothed Online Learning
    N. Mhaisen, G. Iosifidis
    In Proceedings of the 29th International Conference on Artificial Intelligence and Statistics (AISTATS)
    Code Poster Preprint
  3. DRONE-RL: Dynamic Reinforcement Learning for Online Navigation of UAVs in Evolving Environments
    DRONE-RL: Dynamic Reinforcement Learning for Online Navigation of UAVs in Evolving Environments
    N. Khial, M. S. Allahham, N. Mhaisen, L. Ismail, M. A. Mabrok, A. Mohamed
    Knowledge-Based Systems, 334:115147
    Preprint

2025

  1. PhD Thesis, TU Delft
    2025
    Optimistic Learning with Applications to Caching Networks
    N. Mhaisen
    Ph.D. Thesis, Delft University of Technology
    PDF Recording
  2. On the Dynamic Regret of Following the Regularized Leader: Optimism with History Pruning
    On the Dynamic Regret of Following the Regularized Leader: Optimism with History Pruning
    N. Mhaisen, G. Iosifidis
    In Proceedings of the 42nd International Conference on Machine Learning (ICML)
    Code Poster Preprint
  3. IEEE ICC
    2025
    Multi-Target Path Planning with Probabilistic Detection in Cluttered Environments
    N. Khial, N. Mhaisen, L. Ismail, M. A. Mabrok, A. Mohamed
    In Proceedings of ICC 2025 - IEEE International Conference on Communications, 1298-1303
  4. Slicing for AI: An Online Learning Framework for Network Slicing Supporting AI Services
    Slicing for AI: An Online Learning Framework for Network Slicing Supporting AI Services
    M. Helmy, A. A. Abdellatif, N. Mhaisen, A. Mohamed, A. Erbad
    IEEE Transactions on Network and Service Management, 22(6):5239-5254
    Preprint
  5. Optimistic Learning for Communication Networks
    Optimistic Learning for Communication Networks
    G. Iosifidis, N. Mhaisen, D. J. Leith
    Foundations and Trends in Networking (accepted, expected Q3 2026)
    Preprint
  6. An Online Learning Framework for UAV Search Mission in Adversarial Environments
    An Online Learning Framework for UAV Search Mission in Adversarial Environments
    N. Khial, N. Mhaisen, M. A. Mabrok, A. Mohamed
    Expert Systems with Applications, 267:126136

2024

  1. IEEE CCECE
    2024
    An Online Learning Framework for UAV Target Search Missions in Non-stationary Environments
    N. Khial, N. Mhaisen, M. A. Mabrok, A. Mohamed
    In 2024 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), 753-758
  2. L4DC
    2024
    Adaptive Online Non-stochastic Control
    N. Mhaisen, G. Iosifidis
    In Proceedings of the 6th Annual Learning for Dynamics and Control Conference (L4DC), PMLR 242:248-259
    Code Poster Preprint
  3. Online Caching with no Regret: Optimistic Learning via Recommendations
    Online Caching with no Regret: Optimistic Learning via Recommendations
    N. Mhaisen, G. Iosifidis, D. J. Leith
    IEEE Transactions on Mobile Computing, 23(5):5949-5965
    Code Preprint
  4. Optimistic Online Non-stochastic Control via FTRL
    Optimistic Online Non-stochastic Control via FTRL
    N. Mhaisen, G. Iosifidis
    In Proceedings of a 63rd Conference on Decision and Control (IEEE CDC)
    Code Slides Preprint

2023

  1. Reinforcement Learning for Intelligent Healthcare Systems: A Review
    Reinforcement Learning for Intelligent Healthcare Systems: A Review
    A. A. Abdellatif, N. Mhaisen, A. Mohamed, A. Erbad, M. Guizani
    IEEE Internet of Things Journal, 10(24):21982-22007
    Preprint
  2. US Patent
    2023
    Data Storage Methods and Systems
    Q. Malluhi, N. Mhaisen
    U.S. Patent 11,748,197
  3. IEEE WCNC
    2023
    Federated Learning for Online Resource Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach
    J. Zheng, K. Li, N. Mhaisen, W. Ni, E. Tovar, M. Guizani
    In 2023 IEEE Wireless Communications and Networking Conference (WCNC), 1-6

2022

  1. US Patent
    2022
    Data Storage Methods and Systems
    Q. Malluhi, N. Mhaisen
    U.S. Patent 11,531,647
  2. Optimistic No-regret Algorithms for Discrete Caching
    Optimistic No-regret Algorithms for Discrete Caching
    N. Mhaisen, A. Sinha, G. Paschos, G. Iosifidis
    In Proc. ACM Meas. Anal. Comput. Syst. (POMACS), 6(3), Article 48 / ACM SIGMETRICS 2023
    Code Preprint
  3. IEEE IoT-J
    2022
    Exploring Deep Reinforcement Learning-Assisted Federated Learning for Online Resource Allocation in Privacy-Preserving EdgeIoT
    J. Zheng, K. Li, N. Mhaisen, W. Ni, E. Tovar, M. Guizani
    IEEE Internet of Things Journal, 9(21):21099-21110
    Preprint
  4. Pervasive AI for IoT Applications: A Survey on Resource-Efficient Distributed Artificial Intelligence
    Pervasive AI for IoT Applications: A Survey on Resource-Efficient Distributed Artificial Intelligence
    E. Baccour, N. Mhaisen, A. A. Abdellatif, A. Erbad, A. Mohamed, M. Hamdi, M. Guizani
    IEEE Communications Surveys & Tutorials, 24(4):2366-2418
    Preprint
  5. IFIP Networking
    2022
    Online Caching with Optimistic Learning
    N. Mhaisen, G. Iosifidis, D. J. Leith
    In 2022 IFIP Networking Conference (IFIP Networking), 1-9
    Code Slides Preprint
  6. IEEE TCCN
    2022
    Multi-Agent Reinforcement Learning for Network Selection and Resource Allocation in Heterogeneous Multi-RAT Networks
    M. S. Allahham, A. A. Abdellatif, N. Mhaisen, A. Mohamed, A. Erbad, M. Guizani
    IEEE Transactions on Cognitive Communications and Networking, 8(2):1287-1300
    Preprint
  7. FGCS
    2022
    Communication-Efficient Hierarchical Federated Learning for IoT Heterogeneous Systems
    A. A. Abdellatif, N. Mhaisen, A. Mohamed, A. Erbad, M. Guizani, Z. Dawy, W. Nasreddine
    Future Generation Computer Systems, 128:406-419
    Code Preprint

2021

  1. IEEE TNSE
    2021
    On Designing Smart Agents for Service Provisioning in Blockchain-Powered Systems
    N. Mhaisen, M. S. Allahham, A. Mohamed, A. Erbad, M. Guizani
    IEEE Transactions on Network Science and Engineering, 9(2):401-415
  2. IEEE ICC
    2021
    Rational Contracts: Data-Driven Service Provisioning in Blockchain-Powered Systems
    N. Mhaisen, A. Mohamed, A. Erbad, M. Guizani
    In ICC 2021 - IEEE International Conference on Communications, 1-6
  3. IEEE TNSE
    2021
    Optimal User-Edge Assignment in Hierarchical Federated Learning
    N. Mhaisen, A. A. Abdellatif, A. Mohamed, A. Erbad, M. Guizani
    IEEE Transactions on Network Science and Engineering
    Preprint

2020

  1. FGCS
    2020
    To Chain or Not to Chain: A Reinforcement Learning Approach for Blockchain-Enabled IoT Monitoring
    N. Mhaisen, N. Fetais, A. Erbad, A. Mohamed, M. Guizani
    Future Generation Computer Systems, 111:39-51
  2. IEEE Access
    2020
    Data Consistency in Multi-Cloud Storage Systems with Passive Servers and Non-Communicating Clients
    N. Mhaisen, Q. M. Malluhi
    IEEE Access, 8:164977-164986
    Code
  3. MSc Thesis, Qatar University
    2020
    Novel Techniques for Blockchain-Enabled IoT Systems Leveraging Reinforcement Learning
    N. Mhaisen
    M.Sc. Thesis, Qatar University
  4. IEEE ICIoT
    2020
    Real-Time Scheduling for Electric Vehicles Charging/Discharging Using Reinforcement Learning
    N. Mhaisen, N. Fetais, A. Massoud
    In 2020 IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT), 1-6

2019

  1. Alex. Eng. J.
    2019
    Secure Smart Contract-Enabled Control of Battery Energy Storage Systems against Cyber-Attacks
    N. Mhaisen, N. Fetais, A. Massoud
    Alexandria Engineering Journal, 58(4):1291-1300
  2. IEEE GCC
    2019
    A Reconfigurable Multipurpose System on Chip Platform for Metal Detection
    N. Mhaisen, O. Abazeed, Y. Al-Hariri, N. Nawaz, A. Amira
    In 2019 IEEE 10th GCC Conference & Exhibition (GCC), 1-5

2018

  1. IEEE ICCA
    2018
    Self-Powered IoT-Enabled Water Monitoring System
    N. Mhaisen, O. Abazeed, Y. A. Hariri, A. Alsalemi, O. Halabi
    In 2018 International Conference on Computer and Applications (ICCA), 41-45
  2. QFARC
    2018
    Almost BPXOR Coding Technique for Tolerating Three Disk Failures in RAID7 Architectures
    N. Mhaisen, M. Punkar, Y. Wang, Y. Desmedt, Q. Malluhi
    In Qatar Foundation Annual Research Conference Proceedings, 2018(3):ICTPP756
  3. QFARC
    2018
    A Reconfigurable Multipurpose SoC Mobile Platform for Metal Detection
    O. A. R. Abazeed, N. Mhaisen, Y. Al-Hariri, N. Nawaz, A. Amira
    In Qatar Foundation Annual Research Conference Proceedings, 2018(3)