Sustainable and cost-effective power supply for IoT devices is critical to sustain their wireless connections. RF-based wireless power transfer (WPT) is viewed as a promising techonology to replenish batteries of the IoT devices, because of a few remarkable advantages: 1) It is based on far-field radiation and thus allows for better mobility and scalability of the IoT networks. 2) It reuses the same set of antennas for information communication, enabling simultaneous information and power transfer. This supports the design of always-online wireless systems for IoT applications. 3) The reuse of antennas also supports highly integrated design to minimize the size and improve the reliability of IoT devices.

One of the main challenges in wireless powered communication lies in that the low efficiency in energy harvesting cannot fulfill the high-power consumption in legacy transceivers. Compared to the conventional active radios, the backscatter radios consume orders of magnitude less power, enabling wireless power transfer a cost-effective and a feasible solution to sustain wireless communications for IoT devices. The integration of active and passive radios in one network opens a new paradigm of radio resource allocation and network optimization. The difference between the passive and active radio modes makes it possible for them to complement each other in data transmission. It also makes the resource allocation more complicated and requires innovative design for transmission scheduling and access control strategies in a hybrid radio network.

he integration of DRL into future wireless networks will revolutionize the conventional model-based network optimization to model-free approaches and meet various application demands. DRL provides an autonomous decision-making mechanism for the network entities to solve non-convex, complex model-free problems, e.g., spectrum access, handover, scheduling, caching, data offloading, and resource allocation. There are still domain-specific challenges that require further investigation. These may include the design of proper DNN architectures to capture the characteristics of 5G network optimization problems, the state explosion in dense networks, multi-agent learning in dynamic networks, limited training data and exploration space in practical networks, the inaccessibility and high cost of network information, as well as the balance between information quality and learning performance.

1. [BOOK] Dinh Thai Hoang, Dusit Niyato, Dong In Kim, Nguyen Van Huynh, and Shimin Gong, Ambient Backscatter Communication Networks, Cambridge University Press, April 2020
2. [CHAPTER] Lin Gao, Lingjie Duan, Shimin Gong, and Q. Zhang, "Matching for Cooperative Spectrum Sharing," chapter in Encyclopedia of Wireless Networks (Editor-in-Chief: Sherman Shen), Springer, 2018
3. [CHAPTER] Shimin Gong, Ping Wang, and Jianwei Huang, "Robust performance of spectrum sensing in cognitive radio networks," chapter in Cognitive Radio and Interference Management: Technology and Strategy. IGI Global Publisher, 2012.

1. [TCOM] Shimin Gong, Jianye Lin, Jinbei Zhang, Dusit Niyato, Dong In Kim, Mohsen Guizani, "Optimization-driven Machine Learning for Intelligent Reflecting Surfaces Assisted Wireless Networks," under review in IEEE Communications Magazine
2. [TCOM] Shimin Gong, Yuze Zou, Jing Xu, Dinh Thai Hoang, Bin Lyu, Dusit Niyato, "Optimization-driven Hierarchical Learning Framework for Wireless Powered Backscatter-aided Relay Communications," under review in IEEE Transactions on Wireless Communications
3. [TCOM] Bin Lyu, Parisa Ramezani, Dinh Thai Hoang, Shimin Gong, Zhen Yang, and Abbas Jamalipour, "Optimized Energy and Information Relaying in SelfSustainable IRS-Empowered WPCN," under review in IEEE Transactions on Communications
4. [TVT] Yuze Zou, Shimin Gong, Jing Xu, Wenqing Cheng, Dinh Thai Hoang and Dusit Niyato, "Wireless Powered Intelligent Reflecting Surfaces for Enhancing Wireless Communications," to appear in IEEE Transactions on Vehicular Technology
5. [COMST] Shimin Gong, X. Lu, D. T. Hoang, D. Niyato, L. Shu, D. I. Kim, Y.-C. Liang, "Towards Smart Radio Environment for Wireless Communications via Intelligent Reflecting Surfaces: A Comprehensive Survey," IEEE Communications Surveys and Tutorials, DOI: 10.1109/COMST.2020.3004197 (IF > 22)
6. [IoT] Shimin Gong, Y. Zou, D. T. Hoang, J. Xu, W. Cheng, D. Niyato, "Capitalizing Backscatter-Aided Hybrid Relay Communications with Wireless Energy Harvesting," IEEE IoT Journal, May. 2020. DOI: 10.1109/JIOT.2020.2995512. (IF > 9.5)
7. [NET] Shimin Gong, Yutong Xie, Jing Xu, Dusit Niyato, and Y.-C. Liang, "Deep Reinforcement Learning for Backscatter-Aided Data Offloading in Mobile Edge Computing," IEEE Network (IF > 7.5)
8. [WCL] Bin Lyu, Dinh Thai Hoang, Shimin Gong(*), Dusit Niyato, and Dong In Kim, "IRS-based Wireless Jamming Attacks: When Jammers can Attack without Power," IEEE Wireless Communications Letters (IF > 3.54)
9. [IoT] Zhe Yu, Yanmin Gong, Shimin Gong, and Yuanxiong Guo, "Joint Task Offloading and Resource Allocation in UAV-Enabled Mobile Edge Computing," IEEE Internet of Things Journal, Jan. 2020 (DOI: 10.1109/JIOT.2020.2965898) (IF > 9)
10. [WCM] Dinh Thai Hoang, Diep N. Nguyen, Mohammad Abu Alsheikh, Shimin Gong(*), Eryk Dutkiewicz, Dusit Niyato, and Zhu Han, "Borrowing Arrows with Thatched Boats: The Art of Defeating Reactive Jammers in IoT Networks," IEEE Wireless Communications Magazine, 2020. (IF = 11)
11. [TCCN] Jing Xu, Shimin Gong(*), Yuze Zou, Wei Liu, and Dusit Niyato, "Redundant Sniffer Deployment for Multi-Channel Wireless Network Forensics with Unreliable Conditions," IEEE Transactions on Cognitive Communications and Networking, vol.6, no.1, pp. 394-407, Aug. 2019.
12. [IoT] Jing Xu, Jiachen Li, Shimin Gong(*), Kun Zhu, and Dusit Niyato, "Passive Relaying Game for Wireless Powered Internet of Things in Backscatter-Aided Hybrid Radio Networks," IEEE Internet of Things Journal, vol.5, no.5, pp. 8933-8944, Jun. 2019 (IF > 9)
13. [TCCN] Shimin Gong, Lin Gao, Jing Xu, Yuanxiong Guo, Dinh Thai Hoang, and Dusit Niyato, "Exploiting Backscatter-Aided Relay Communications with Hybrid Access Model in Device-to-Device Networks," IEEE Transactions on Cognitive Communication and Networking, vol.5, no.4, pp. 835-848, Jun. 2019.
14. [COMST] Nguyen C. Luong, Dinh Thai Hoang, Shimin Gong, Dusit Niyato, Ping Wang, Ying-Chang Liang, and Dong In Kim, "Applications of Deep Reinforcement Learning in Communications and Networking: A Survey," IEEE Communications Surveys and Tutorials, vol.21, no.4, pp. 3133-3174, Fourthquarter, 2019. (ESI Highly Cited Paper, IF > 22)
15. [NETWORK] Shimin Gong, Jing Xu, Dusit Niyato, and Xiaoxia Huang, "Backscatter-Aided Cooperative Relay Communications in Wireless-Powered Hybrid Radio Networks," IEEE Network, vo.33, no.5, pp. 234-241, May 2019. (IF > 7.5)
16. [TCOM] Jing Xu, Yuze Zou, Shimin Gong(*), Gao Lin, Dusit Niyato, and Wenqing Cheng, "Robust Transmissions in Wireless Powered Multi-Relay Networks with Channel Interference Constraints," IEEE Transactions on Communications, vol.67, no.2 pp. 973-987, Feb. 2019. (IF > 5.6)
17. [TKDE] Pan Zhou, Chen Wang, Kehao Wang, Linke Guo, and Shimin Gong, "A Privacy-Preserving Contextual Distributed Online Learning Framework with Big Data Support in Social Recommender Systems," IEEE Transactions on Knowledge and Data Engineering, Aug. 2019 (DOI: 10.1109/TKDE.2019.2936565) (IF > 3.8)
18. [ACCESS] Yanyan Shen, Bo Yang, Shuqiang Wang, Shimin Gong, Liang Xue, and Xinping Guan, "Sum Rate Maximization for Multi-Carrier SWIPT Relay System With Non-Ideal Power Amplifier and Circuit Power Consumption," IEEE Access, Vol.7, pp. 89805-89820, Jul. 2019.
19. [TGCN] Dapeng Li, Lin Gao, Xinghua Sun, Fen Hou, and Shimin Gong, "A Cellular Backhaul Virtualization Market Design for Green Small-Cell Networks," IEEE Transactions on Green Communications and Networking, vol.3, no.2, pp. 468-482, Mar. 2019.
20. [TCOM] Shimin Gong, X. Huang, J. Xu, W. Liu, P. Wang, and Dusit Niyato, "Backscatter Relay Communications Powered by Wireless Energy Beamforming," IEEE Transactions on Communications, vol.66, no.7, pp. 3187-3200, Jul. 2018. (IF > 5.6)
21. [ACCESS] W. Chen, P. Zhou, S. Dong, and Shimin Gong, "Tree-based Contextual Learning for Online Job or Candidate Recommendation with Big Data Support in Professional Social Networks," IEEE Access, vol.6 pp.77725 - 77739, 2018.
22. [ACCESS] Wenbo Xu, Jing Xu, Jiachen Li, Wei Liu, Shimin Gong, and Kai Zeng, "Robust Spectrum Monitoring in Cognitive Radio Networks with Uncertain Traffic Information," IEEE Access, vol.6 pp.34696 - 34706, 2018. (IF > 4)
23. [WCMC] Longteng Xu, Kun Zhu, Ran Wang, and Shimin Gong, "Performance Analysis of RF-Powered Cognitive Radio Networks with Integrated Ambient Backscatter Communications," Wireless Communications and Mobile Computing, 2018.
24. [ACCESS] C. Li, S. Gong, Z. Ning, P. Lai, Q. Jiang, and P. Zhou, "Robust Caching Control in Crowdsourced Content-Centric Mobile Networking," IEEE Access, vol.6 pp.59811 - 59821, 2018.
25. [TWC] Shimin Gong, S. X. Wu, A. M. C. So and X. Huang, "Distributionally Robust Collaborative Beamforming in D2D Relay Networks With Interference Constraints," IEEE Transactions on Wireless Communications, 16(8): 5048 - 5060, 2017. (IF > 6.3)
26. [ACCESS] C. Li, S. Gong, X. Wang, L. Wang, Q. Jiang, and Koji Okamura, "Secure and Efficient Content Distribution in Crowdsourced Vehicular Content-Centric Networking," IEEE Access, vol.6 pp.5727 - 5739, 2017.
27. [TWC] Shimin Gong, Lingjie Duan, and Natarajan Gautam, "Optimal Scheduling and Beamforming in Relay Networks with Energy Harvesting Constraints," IEEE Transactions on Wireless Communications, 15(2): 1226 - 1238, 2016. (IF > 6.3)
28. [TWC] Shimin Gong, Ping Wang, and Lingjie Duan, "Distributed power control with robust protection for PUs in cognitive radio networks," IEEE Transactions on Wireless Communications, 14(6): 3247 - 3258, 2015. (IF > 6.3)
29. [TWC] Shimin Gong, Ping Wang, and Jianwei Huang, "Robust performance of spectrum sensing in cognitive radio networks," IEEE Transactions on Wireless Communications, 12(5): 2217 - 2227, 2013. (IF > 6.3)
30. [JSAC] Shimin Gong, Ping Wang, Yongkang Liu and Weihua Zhuang, "Robust power control with distribution uncertainty in cognitive radio networks," IEEE Journal on Selected Areas in Communications, 31(11): 2397 - 2408, 2013. (IF > 9)
31. [WNET] Bo Xie, Shimin Gong, and Guang Tan, "LiPro: Light-based Indoor Positioning with Rotating Handheld Devices, Wireless Networks," Wireless Networks, 2016.
32. [JEPES] Ran Wang, Ping Wang, Gaoxi Xiao, and Shimin Gong, "Power Demand and Supply Management in Microgrids with Uncertainties of Renewable Energies," International Journal of Electrical Power and Energy Systems, vol.63, pp.260-269, Dec. 2014.

1. [WCNC] Jiaye Lin, Yuze Zou, Xiaoru Dong, Shimin Gong, H. Dinh, Dusit Niyato, "Deep Reinforcement Learning for Robust Beamforming in IRS-assisted Wireless Communications," in proc. IEEE GLOBECOM 2020.
2. [WCNC] B. Lyu, H. Dinh, Shimin Gong, and Z. Yang, "Intelligent Reflecting Surface Assisted Wireless Powered Communication Networks," in proc. IEEE WCNC 2020-workshop.
3. [WCNC] Y. Zou, Shimin Gong, J. Xu, W. Cheng, H. Dinh, and D. Niyato, "Joint Energy Beamforming and Optimization for Intelligent Reflecting Surface Enhanced Communications," in proc. IEEE WCNC 2020-workshop.
4. [WCNC] Y. Zou, Y. Xie, C. Zhang, L. Guo, Shimin Gong, H. Dinh, and D. Niyato, "Optimization-driven Hierarchical Deep Reinforcement Learning for Hybrid Relaying Communications," in proc. IEEE WCNC 2020.
5. [GLOBECOM] Y. Yu, S. Wang, S. Liu, L. Guo, Z. Ning, Shimin Gong, and M. Obaidat, "Secure Beamforming Design for MISO SWIPT Systems: An Indirectly Optimized Approach," in proc. IEEE GLOBECOM 2019.
6. [GLOBECOM] L. Nie, H. Wang, Shimin Gong, Z. Ning, M. Obaidat, and K. Hsiao, "Anomaly Detection Based on Spatio-Temporal and Sparse Features of Network Traffic in VANETs," in proc. IEEE GLOBECOM 2019.
7. [GLOBECOM] H. Dinh, M. Alsheikh, Shimin Gong, D. Niyato, Z. Han, and Y. Liang, "Defend Jamming Attacks: How to Make Enemies Become Friends," in proc. IEEE GLOBECOM 2019.
8. [GLOBECOM] Y. Zou, J. Xu, Shimin Gong(*), Y. Guo, D. Niyato, and W. Cheng, "Backscatter-Aided Hybrid Data Offloading for Wireless Powered Edge Sensor Network," in proc. IEEE GLOBECOM 2019.
9. [GLOBECOM] Y. Xie, Z. Xu, Y. Zhong, Shimin Gong(*), J. Xu, D. Hoang, and D. Niyato, "Backscatter-assisted Hybrid Relaying Strategy for Wireless Powered IoT Communications," in proc. IEEE GLOBECOM 2019.
10. [ICCC] Y. Xie, Z. Xu, Y. Zhong, J. Xu, Shimin Gong(*), and Y. Wang, "Backscatter-Assisted Computation Offloading for Energy Harvesting IoT Devices via Policy-based Deep Reinforcement Learning," in proc. IEEE/CIC ICCC 2019.
11. [MLICOM] Y. Xie, Z. Xu, J. Xu, Shimin Gong(*), and Y. Wang, "Backscatter-aided Hybrid Data Offloading in Mobile Edge Computing via Deep Reinforcement Learning," in proc. MLICOM 2019.
12. [WCNC] Xi Luo, J. Xu, Y. Zou, Shimin Gong(*), L. Gao, and Dusit Niyato, "Collaborative relay beamforming with direct links in wireless powered communications," in proc. IEEE WCNC 2019.
13. [WCNC] W. Chen, W. Liu, L. Gao, Shimin Gong(*), C. Li, and K. Zhu, "Collaborative relay beamforming with direct links in wireless powered communications," in proc. IEEE WCNC 2019. (BEST PAPER AWARD WCNC 2019)
14. [ICNC] Wenfan Chen, C. Li, Shimin Gong, L. Gao, and J. Xu, "Joint transmission scheduling and power allocation in wirelessly powered hybrid radio networks," in proc. IEEE ICNC 2019.
15. [GLOBECOM] Jiachen Li, Jing Xu, Shimin Gong(*), C. Li, and Dusit Niyato,, "A game theoretic approach for backscatter-aided relay communications in hybrid radio networks," in proc. IEEE Globecom 2018.
16. [GLOBECOM] Yuze Zou, Wei Liu, Shimin Gong(*), Kun Zhu, and Dusit Niyato, "Joint optimization of wireless power transfer and collaborative beamforming for relay communicationss," in proc. IEEE Globecom(workshop) 2018.
17. [WCNC] Shimin Gong, L. Gao, J. Xu, X. Huang, and W. Liu, "Passive Relaying via Backscatter Communications in Cooperative Wireless Networks," in proc. IEEE WCNC 2018.
18. [WCNC] Longteng Xu, Kun Zhu, Ran Wang, and Shimin Gong, "Performance Analysis of Ambient Backscatter Communications in RF-Powered Cognitive Radio Networks," in proc. IEEE WCNC 2018.
19. [MASS] Yixuan Zhong, Lin Gao, Tong, Wang, Shimin Gong, B. Zou, and D. Yu, "Achieving stable and optimal passenger-driver matching in ride-sharing system," in proc. IEEE MASS 2018.
20. [GLOBECOM] L. Li, X. Huang, and Shimin Gong, "Robust Cooperative Routing for Ambient Backscatter Wireless Sensor Networks," in proc. IEEE Globecom 2017.
21. [GLOBECOM] Jiachen Li, J. Xu, and Shimin Gong, "Robust Radio Mode Selection in Wirelessly Powered Communications with Uncertain Channel Information," in proc. IEEE Globecom 2017.
22. [CIT] Jiachen Li, Yue Mi, Shimin Gong(*), Jing Xu, Xiaoxia Huang and Yanyan Shen, "Cooperative multi-relay assisted multicast beamforming in wirelessly power communications," in proc. IEEE Int. Conf. Computer Inf. Techn. (CIT), 2017.
23. [CIT] Jiachen Li, Jing Xu, Wei Liu, Shimin Gong(*), and Kai Zeng, "Robust optimal spectrum patrolling for passive monitoring in cognitive radio networks," in proc. IEEE Int. Conf. Computer Inf. Techn. (CIT), 2017.
24. [VTC] Yanyan Shen, Xiaoxia Huang, Bo Yang, Shimin Gong, and Shuqiang Wang, "Fair resource allocation algorithm for chunk based OFDMA multi-User networks," in proc. IEEE VTC-Fall, 2017.
25. [QSHINE] C. Li, S. Gong, X. Wang, Z. Wang, and Q. Jiang, "Performance Analysis for Content Distribution in Crowdsourced Content-Centric Mobile Networking," n proc. EAI Int. Conf. Heterogeneous Networking for Quality, Reliability, Security and Robustness (Qshine) 2017.
26. [ISPA] S. Xia, B. Chen, K. Zhu, X. Zhai, and S. Gong, "Performance Analysis of Full-Duplex D2D Communications in Multi-tier Heterogeneous Wireless Networks," in proc. IEEE ISPA 2017.
27. [MSWiM] Shimin Gong, Sissi Xiaoxiao Wu, Anthony Man-Cho So, and Xiaoxia Huang, "Distributionally Robust Relay Beamforming in Wireless Communications," in proc. ACM MSWiM, Malta, 2016.
28. [GLOBECOM] Shimin Gong, Yanyan Shen, Xiaoxia Huang, Sissi X. Wu, A. M. So, "Robust Relay Beamforming in Device-to-Device Networks with Energy Harvesting Constraints," in proc. IEEE GLOBECOM, 2016.
29. [INFOCOM] Shimin Gong, Lingjie Duan, and Ping Wang, "Robust Design for Cognitive Radio Networks with Energy Harvesting Constraints," in proc. IEEE INFOCOM, 2015.
30. [GLOBECOM] Shimin Gong, Ping Wang, and Lingjie Duan, "A Game Theoretic Approach for Robust Power Control in Cognitive Radio Networks," in proc. IEEE Globecom, 2014.
31. [INFOCOM] Shimin Gong, Ping Wang, Wei Liu, and Weihua Zhuang, "Performance bounds of energy detection with signal uncertainty in cognitive radio networks," in proc. IEEE INFOCOM, 2013.
32. [WCNC] Shimin Gong, Ping Wang, Yongkang Liu, and Weihua Zhuang, "Robust power control in cognitive radio networks with channel uncertainty," in proc. IEEE WCNC, 2013.
33. [INFOCOM] Shimin Gong, Ping Wang, and Jianwei Huang, "Robust threshold design for cooperative sensing in cognitive radio networks," in proc. IEEE INFOCOM, 2012.
34. [ICC] Shimin Gong, Ping Wang, and Wei Liu, "Spectrum sensing under distribution uncertainty in cognitive radio networks," in proc. IEEE ICC, 2012.
35. [GLOBECOM] Shimin Gong, Ping Wang, and Jianwei Huang, "On-demand spectrum sharing by flexible time-slotted cognitive radio networks," in proc. IEEE Globecom, 2012.
36. [SmartGridComm] Q. Dong, Dusit Niyato, P. Wang, and Shimin Gong, "Deferrable load scheduling of smart meter with intermittent communication connection," in proc. IEEE SmartGridComm, 2012.
37. [ICC] W. Liu, Shimin Gong, Y. Zhou, and P.Wang, "Two-phase indoor positioning technique in wireless networking environment," in proc. IEEE ICC, 2010.
38. [GLOBECOM] Shimin Gong, P. Wang, W. Liu, and W. Yuan, "Maximize secondary user throughput via optimal sensing in multi-channel cognitive radio networks," in proc. IEEE Globecom, 2010.
39. [ICCS] Shimin Gong, P. Wang, and Dusit Niyato, "Optimal power control in interference-limited cognitive radio networks," in proc. IEEE ICCS (invited paper), 2010.