Offline RL Paper List (continued updating)
Published:
Offline RL paper list. Read more
Posts by Collection
blogs
portfolio
Portfolio item number 1
Short description of portfolio item number 1
Read more
Portfolio item number 2
Short description of portfolio item number 2 Read more
projects
Incorporating Household Decision Making with Dynamic Transportation Modeling in Hurricane Evacuation
Research project at Purdue University
2012-2015: Funded by National Science Foundation (NSF). Read more
The Use of Large Scale Datasets for Understand Traffic Network State
Research project at Purdue University
2012-2013: Sponsored by University Transportation Research Center - Region 2, US. Read more
Real Time Queue Length Estimation Using License-plate Recognition Data
Research project at Purdue University
2014-2015: Partially supported by National Natural Science Foundation of China, US National Science Foundation and National Key Technology R&D Program. Read more
Bridging Information, Uncertainty and Decision-Making in Hurricanes Using an Interdisciplinary Perspective
Research project at Purdue University
2015-2017: Funded by National Science Foundation (NSF). Read more
Citywide Traffic Volume Estimation Using Large-scale Trajectory Data
Research project at Microsoft Research Asia
2015-2016: Collaborated with Microsoft Research Asia. Read more
Traffic Signal Optimization: A Data-driven and Deep Reinforcement Learning Approach
Research project at Microsoft Research Asia
2017: Collaborated with Didi Chuxing. Read more
Collective Anomaly Detection for Large-Scale Complex Sensory Systems
Research project at JD Intelligent Cities Research
2018: Funded by CNH Energy and National Science Foundation (NSF). Read more
Artificial Intelligence-based Optimization System for Thermal Power Generating Units
Research project at JD Intelligent Cities Research
2018-2020: Funded by JD Intelligent Cities Research. Read more
5G Massive MIMO Wireless Network Optimization
Research project at Institute of AI Industry Research (AIR), Tsinghua University
2021-Present: Funded by AsiaInfo. Read more
Data-Driven Decision Making Under Complex Autonomous Driving Scenarios
Research project at Institute of AI Industry Research (AIR), Tsinghua University
2022-Present: Funded by Haomo.ai Read more
Data-driven Control Library
Research project at Institute of AI Industry Research (AIR), Tsinghua University
2022-Present Read more
publications_book
Checking the Urban Pulse: Social Media Data Analytics for Transportation Applications
Published:
Published in Best Practices for Transportation Agency Use of Social Media Data, 2014. Read more
Recommended citation: Ukkusuri, S. V., Hasan, S., and Zhan, X.. Checking the Urban Pulse: Social Media Data Analytics for Transportation Applications. Best Practices for Transportation Agency Use of Social Media Data. Taylor and Francis/CRC Press, 2013.
Characterizing Urban Dynamics Using Large Scale Taxicab Data
Published:
Published in Engineering and Applied Sciences Optimization, 2015. Read more
Recommended citation: Qian, X, Zhan, X., Ukkusuri, S. V. Characterizing Urban Dynamics Using Large Scale Taxicab Data. Engineering and Applied Sciences Optimization: Vol. 38, 17-32, Springer International Publishing, 2015.
publications_conference
Understanding Urban Human Activity and Mobility Patterns Using Large-scale Location-based Data from Online Social Media
Published:
Published in Proceedings of the 2nd ACM SIGKDD International Workshop on Urban Computing, 2013. Read more
Recommended citation: Hasan, S., Zhan, X., and Ukkusuri, S. V. Understanding Urban Human Activity and Mobility Patterns Using Large-scale Location-based Data from Online Social Media. Proceedings of the 2nd ACM SIGKDD International Workshop on Urban Computing, August, 2013.
Characterizing Urban Dynamics Using Large Scale Taxicab Data
Published:
Published in Proceedings of 93nd Transportation Research Board Meeting, 2014. Read more
Recommended citation: Qian, X., Zhan, X., Ukkusuri, S. Characterizing Urban Dynamics Using Large Scale Taxicab Data. In Proceedings of 93nd Transportation Research Board Meeting, Washington D.C., January 2014.
Multi-User Class, Simultaneous Route and Departure Time Choice Dynamic Traffic Assignment with an Embedded Spatial Queuing Model
Published:
Published in 5th International Symposium on Dynamic Traffic Assignment, 2014. Read more
Recommended citation: Zhan, X., Ukkusuri, S. V.. Multi-User Class, Simultaneous Route and Departure Time Choice Dynamic Traffic Assignment with an Embedded Spatial Queuing Model. 5th International Symposium on Dynamic Traffic Assignment. Salerno, Italy, June, 2014.
Measuring the Efficiency of Urban Taxi Service System
Published:
Published in Proceedings of the 3rd ACM SIGKDD International Workshop on Urban Computing, 2014. Read more
Recommended citation: Zhan, X., Qian, X., Ukkusuri, S. V. Measuring the Efficiency of Urban Taxi Service System. In Proceedings of the 3rd ACM SIGKDD International Workshop on Urban Computing, New York, August 2014.
A Probabilistic Urban Link Travel Time Estimation Model Using Large-scale Taxi Trip Data
Published:
Published in Proceedings of 94nd Transportation Research Board Meeting, 2015. Read more
Recommended citation: Zhan, X., Ukkusuri, S. V. A Probabilistic Urban Link Travel Time Estimation Model Using Large-scale Taxi Trip Data. In Proceedings of 94th Transportation Research Board Meeting, Washington D.C., January 2015.
Activity Chain Inference Using Travel Survey and Mobile Phone data
Published:
Published in Proceedings of 96nd Transportation Research Board Meeting, 2017. Read more
Recommended citation: Yang, C., Zhang, Y., Zhan, X., Ukkusuri, S. V., and Qiu, W. Activity Chain Inference Using Travel Survey and Mobile Phone data. In Proceedings of Transportation Research Board Meeting, Washington D.C., January 2017.
Evolution of Complex Network Topologies in Urban Water Infrastructure
Published:
Published in World Environmental and Water Resources Congress 2017, 2017. Read more
Recommended citation: Zischg, J., Klinkhamer, C., Zhan, X., Krueger, E., Ukkusuri, S., Rao, P. S. C., Rauch, W. and Sitzenfrei, R. Evolution of Complex Network Topologies in Urban Water Infrastructure. In World Environmental and Water Resources Congress, Sacramento, May 2017.
Robust Spatio-Temporal Purchase Prediction via Deep Meta Learning
Published:
Published in Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI2021). Read more
Recommended citation: Qin, H., Ke, S., Yang, X., Xu, H., Zhan, X. and Zheng, Y. Robust Spatio-Temporal Purchase Prediction via Deep Meta Learning. In Proceedings of the AAAI Conference on Artificial Intelligence 35 (5), 4312-4319, 2021.
Network-Wide Traffic States Imputation Using Self-interested Coalitional Learning
Published:
Published in SIGKDD 2021 (KDD2021). Read more
Recommended citation: Qin, H., Zhan, X., Li, Y., Yang, X. and Zheng, Y. Network-Wide Traffic States Imputation Using Self-interested Coalitional Learning. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD ’21), August 14–18, 2021, Virtual Event, Singapore. ACM, New York, NY, USA. https://doi.org/10.1145/3447548.3467424.
Constraints Penalized Q-Learning for Safe Offline Reinforcement Learning
Published:
Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI2022). Read more
Recommended citation: Xu, H., Zhan, X., and Zhu, X. Constraints Penalized Q-Learning for Safe Offline Reinforcement Learning. In the Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI2022).
DeepThermal: Combustion Optimization for Thermal Power Generating Units Using Offline Reinforcement Learning
Published:
Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI2022). Read more
Recommended citation: Zhan, X., Xu, H., Zhang, Y., Zhu, X. and Yin, H. DeepThermal: Combustion Optimization for Thermal Power Generating Units Using Offline Reinforcement Learning. In the Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI2022).
Model-Based Offline Planning with Trajectory Pruning
Published:
In IJCAI-22. Read more
Recommended citation: Zhan, X., Zhu, X. and Xu, H. Model-Based Offline Planning with Trajectory Pruning. In the 31st International Joint Conference on Artificial Intelligence (IJCAI-22), 3695-3701.
Discriminator-Weighted Offline Imitation Learning from Suboptimal Demonstrations
Published:
39th International Conference on Machine Learning (ICML 2022). Read more
Recommended citation: Xu, H., Zhan, X., Yin, H. and Qin, H. Discriminator-Weighted Offline Imitation Learning from Suboptimal Demonstrations. In the 39th International Conference on Machine Learning (ICML 2022).
Adversarial Contrastive Learning via Asymmetric InfoNCE
Published:
Accepted in the 17th European Conference on Computer Vision (ECCV 2022). Read more
Recommended citation: Yu, Q., Lou, J., Zhan, X., Li, Q., Liu, J., Zuo W. and Liu, Y. Adversarial Contrastive Learning via Asymmetric InfoNCE. In the 17th European Conference on Computer Vision (ECCV 2022).
ECoalVis: Visual Analysis of Control Strategies in Coal-fired Power Plants
Published:
IEEE VIS 2022. Read more
Recommended citation: Liu, S., Weng, D., Tian, Y., Deng, Z., Xu, H., Zhu, X., Yin, H., Zhan, X., Wu, Y. ECoalVis: Visual Analysis of Control Strategies in Coal-fired Power Plants. In IEEE Visualization Conference (VIS 2022).
Discriminator-Guided Model-Based Offline Imitation Learning
Published:
Conference on Robot Learning (CoRL 2022). Read more
Recommended citation: Zhang, W., Xu, H., Niu, H., Cheng, P, Li, M., Zhang, H., Zhou G., Zhan, X.. Discriminator-Guided Model-Based Offline Imitation Learning. In Conference on Robot Learning (CoRL 2022).
When to Trust Your Simulator: Dynamics-Aware Hybrid Offline-and-Online Reinforcement Learning
Published:
Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022). Read more
Recommended citation: Niu, H., Sharma, S., Qiu, Y., Li, M, Zhou G., Hu, J., Zhan, X.. When to Trust Your Simulator: Dynamics-Aware Hybrid Offline-and-Online Reinforcement Learning. In the Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022) (spotlight).
A Policy-Guided Imitation Approach for Offline Reinforcement Learning
Published:
Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022). Read more
Recommended citation: Xu, H., Li, J., Li, J., Zhan, X.. A Policy-Guided Imitation Approach for Offline Reinforcement Learning. In the Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS 2022) (oral).
Offline Multi-Agent Reinforcement Learning with Coupled Value Factorization
Published:
International Conference on Autonomous Agents and Multiagent Systems 2023 (AAMAS 2023). Read more
Recommended citation: Wang, X., and Zhan, X.. Offline Multi-Agent Reinforcement Learning with Coupled Value Factorization. In International Conference on Autonomous Agents and Multiagent Systems 2023 (AAMAS 2023) (Extended Abstract).
An Efficient Multi-Agent Optimization Approach for Coordinated Massive MIMO Beamforming
Published:
IEEE International Conference on Communications (ICC 2023). Read more
Recommended citation: Jiang, L., Wang, X., Yang, A., Wang, X., Jin, X., Wang, W., Ye, X., Ouyang, Y., and Zhan, X.. An Efficient Multi-Agent Optimization Approach for Coordinated Massive MIMO Beamforming. In IEEE International Conference on Communications (ICC 2023).
When Data Geometry Meets Deep Function: Generalizing Offline Reinforcement Learning
Published:
11th International Conference on Learning Representations (ICLR 2023). Read more
Recommended citation: Li, J., Zhan, X., Xu, H., Zhu, X., Liu, J., and Zhang, Y. Q. When Data Geometry Meets Deep Function: Generalizing Offline Reinforcement Learning. In the 11th International Conference on Learning Representations (ICLR 2023).
Offline RL with No OOD Actions: In-Sample Learning via Implicit Value Regularization
Published:
11th International Conference on Learning Representations (ICLR 2023). Read more
Recommended citation: Xu, H., Jiang, L., Li, J., Yang, Z., Wang, Z., Chan, V., W., K., and Zhan, X.. Offline RL with No OOD Actions: In-Sample Learning via Implicit Value Regularization. In the 11th International Conference on Learning Representations (ICLR 2023) (oral).
Mind the Gap: Offline Policy Optimization for Imperfect Rewards
Published:
11th International Conference on Learning Representations (ICLR 2023). Read more
Recommended citation: Li, J., Hu, X., Xu, H., Liu, J., Zhan, X., Jia, Q., and Zhang, Y. Q. Mind the Gap: Offline Policy Optimization for Imperfect Rewards. In the 11th International Conference on Learning Representations (ICLR 2023).
Offline Multi-Agent Reinforcement Learning with Implicit Global-to-Local Value Regularization
Published:
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023). Read more
Recommended citation: Wang, X., Xu, H., Zheng, Y., Zhan, X.. Offline Multi-Agent Reinforcement Learning with Implicit Global-to-Local Value Regularization. In the Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023).
Look Beneath the Surface: Exploiting Fundamental Symmetry for Sample-Efficient Offline RL
Published:
Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023). Read more
Recommended citation: Cheng, P.*, Zhan, X.*, Wu, Z., Zhang, W., Song, S., Wang, H., Lin, Y., & Jiang, L. Look Beneath the Surface: Exploiting Fundamental Symmetry for Sample-Efficient Offline RL. In the Thirty-seventh Conference on Neural Information Processing Systems (NeurIPS 2023).
Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Model
Published:
12th International Conference on Learning Representations (ICLR 2024). Read more
Recommended citation: Zheng, Y., Li, J., Yu, D., Yang, Y., Li, S., Zhan, X., Liu, J. Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Model. In the 12th International Conference on Learning Representations (ICLR 2024).
Revealing the Mystery of Distribution Correction Estimation via Orthogonal-gradient Update
Published:
12th International Conference on Learning Representations (ICLR 2024). Read more
Recommended citation: Mao, L., Xu, H., Zhang, W., Zhan, X. Revealing the Mystery of Distribution Correction Estimation via Orthogonal-gradient Update. In the 12th International Conference on Learning Representations (ICLR 2024)(spotlight).
OpenChat: Advancing Open-source Language Models with Mixed-Quality Data
Published:
12th International Conference on Learning Representations (ICLR 2024). Read more
Recommended citation: Wang, G., Cheng, S., Zhan, X., Li, X., Song, S., Liu, Y. OpenChat: Advancing Open-source Language Models with Mixed-Quality Data. In the 12th International Conference on Learning Representations (ICLR 2024).
Query-Policy Misalignment in Preference-Based Reinforcement Learning
Published:
12th International Conference on Learning Representations (ICLR 2024). Read more
Recommended citation: Hu, X., Li, J., Zhan, X., Jia, Q., and Zhang, Y. Q. Query-Policy Misalignment in Preference-Based Reinforcement Learning. In the 12th International Conference on Learning Representations (ICLR 2024)(spotlight).
A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agents
Published:
33rd International Joint Conference on Artificial Intelligence (IJCAI 2024). Read more
Recommended citation: Niu, H., Hu, J., Zhou, G., Zhan, X. A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agents. In the 33st International Joint Conference on Artificial Intelligence (IJCAI 2024) (oral).
Seizing Serendipity: Exploiting the Value of Past Success in Off-Policy Actor-Critic
Published:
41st International Conference on Machine Learning (ICML 2024). Read more
Recommended citation: Ji, T., Luo, Y., Sun, F., Zhan, X., Zhang, J., Xu, H. Seizing Serendipity: Exploiting the Value of Past Success in Off-Policy Actor-Critic. In the 41st International Conference on Machine Learning (ICML 2024).
Offline-Boosted Actor-Critic: Adaptively Blending Optimal Historical Behaviors in Deep Off-Policy RL
Published:
41st International Conference on Machine Learning (ICML 2024). Read more
Recommended citation: Luo, Y., Ji, T., Sun, F., Zhang, J., Xu, H., Zhan, X. Offline-Boosted Actor-Critic: Adaptively Blending Optimal Historical Behaviors in Deep Off-Policy RL. In the 41st International Conference on Machine Learning (ICML 2024).
OMPO: A Unified Framework for Reinforcement Learning under Policy and Dynamics Shifts
Published:
41st International Conference on Machine Learning (ICML 2024). Read more
Recommended citation: Luo, Y., Ji, T., Sun, F., Zhang, J., Xu, H., Zhan, X. OMPO: A Unified Framework for Reinforcement Learning under Policy and Dynamics Shifts. In the 41st International Conference on Machine Learning (ICML 2024) (oral).
DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning
Published:
41st International Conference on Machine Learning (ICML 2024). Read more
Recommended citation: Li, J., Zheng, J., Zheng, Y., Mao, L., Hu, X., Cheng, S., Niu, H., Liu, J., Liu, Y., Liu, J., Zhang, Y. Q., Zhan, X. DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning. In the 41st International Conference on Machine Learning (ICML 2024) (Outstanding paper award of ICML 2024 MFM-EAI Workshop).
Bidirectional-Reachable Hierarchical Reinforcement Learning with Mutually Responsive Policies
Published:
1st Reinforcement Learning Conference (RLC 2024). Read more
Recommended citation: Luo, Y., Sun, F., Ji, T., Zhan, X. Bidirectional-Reachable Hierarchical Reinforcement Learning with Mutually Responsive Policies. In the 1st Reinforcement Learning Conference (RLC 2024).
TESLA: Thermally Safe, Load-Aware, and Energy-Efficient Cooling Control System for Data Centers
Published:
53rd International Conference on Parallel Processing (ICPP 2024). Read more
Recommended citation: Geng, H., Sun, Y., Li, Y., Leng, J., Zhu, X., Zhan, X., Li, Y., Zhao, F., Liu, Y. TESLA: Thermally Safe, Load-Aware, and Energy-Efficient Cooling Control System for Data Centers. In the 53rd International Conference on Parallel Processing (ICPP 2024).
FlexSSL : A Generic and Efficient Framework for Semi-Supervised Learning
Published:
27th European Conference on Artificial Intelligence (ECAI-2024). Read more
Recommended citation: Qin, H., Zhan, X., Li, Y., Zheng, Y. FlexSSL : A Generic and Efficient Framework for Semi-Supervised Learning. In the 27th European Conference on Artificial Intelligence (ECAI-2024).
publications_journal
Urban Link Travel Time Estimation Using Large-scale Taxi Data with Partial Information
Published:
Published in Transportation Research Part C: Emerging Technologies, 2013. Read more
Recommended citation: Zhan, X., Hasan, S., Ukkusuri, S. V., Kamga, C., 2013. Urban Link Travel Time Estimation Using Large-scale Taxi Data with Partial Information. Transportation Research Part C: Emerging Technologies, 33, 37-49.
Exploring Crisis Informatics Using Social Media Data: A Study on 2013 Oklahoma Tornado
Published:
Published in Transportation Research Record, 2014. Read more
Recommended citation: Ukkusuri, S., Zhan, X., Sadri A., Ye, Q., 2013. Exploring Crisis Informatics Using Social Media Data: A Study on 2013 Oklahoma Tornado. Transportation Research Record, 2459, 110-118.
Inferring Urban Land Use Using Large-Scale Social Media Check-in Data
Published:
Published in Network and Spatial Economics, 2014. Read more
Recommended citation: Zhan, X., Ukkusuri, S., V., Zhu, F., 2014. Inferring Urban Land Use Using Large-Scale Social Media Check-in Data. Network and Spatial Economics, 14, 647-667.
Lane-based Real Time Queue Length Estimation Using License Plate Recognition Data
Published:
Published in Transportation Research Part C: Emerging Technologies, 2015. Read more
Recommended citation: Zhan, X., Li, R., Ukkusuri, S. V., 2015. Lane-based Real Time Queue Length Estimation Using License Plate Recognition Data. Transportation Research Part C: Emerging Technology, 57, 85-102.
An Efficient Parallel Sampling Technique for Multivariate Poisson-Lognormal Model: Analysis with Two Crash Count Datasets
Published:
Analytic Methods in Accident Research, 2015. Read more
Recommended citation: Zhan, X., Aziz, H. M., Ukkusuri, S. V., 2015. An Efficient Parallel Sampling Technique for Multivariate Poisson-Lognormal Model: Analysis with Two Crash Count Datasets. Analytic Methods in Accident Research, 8, 45-60.
Direct Transportation Economic Impacts of Highway Networks Disruptions Using Public Data from United States
Published:
Journal of Transportation Safety & Security, 2015. Read more
Recommended citation: Mesa-Arango, R., Zhan, X., Ukkusuri, S. V., Mitra, A., 2016. Direct Transportation Economic Impacts of Highway Networks Disruptions Using Public Data from United States. Journal of Transportation Safety & Security, 8(1), 36-55.
A Bayesian Mixture Model for Short-term Average Link Travel Time Estimation Using Large-scale Limited Information Trip-based Data
Published:
Automation in Construction, 2015. Read more
Recommended citation: Zhan, X., Ukkusuri, S., V., Yang, C., 2016. A Bayesian Mixture Model for Short-term Average Link Travel Time Estimation Using Large-scale Limited Information Trip-based Data. Automation in Construction, 72(3), 237-246.
A Graph Based Approach to Measure the Efficiency of Urban Taxi Service System
Published:
Published in IEEE Transactions on Intelligent Transportation Systems, 2016. Read more
Recommended citation: Zhan, X., Qian, X., Ukkusuri, S. V., 2016. A Graph Based Approach to Measure the Efficiency of Urban Taxi Service System. IEEE Transactions on Intelligent Transportation Systems, 17(9), 2479-2489.
Understanding Social Influence in Activity-Location Choice and Life-Style Patterns Using Geo-location Data from Social Media
Published:
Published in Frontiers in ICT, 2016. Read more
Recommended citation: Hasan, S., Ukkusuri, S., Zhan, X., 2016. Understanding Social Influence in Activity-Location Choice and Life-Style Patterns Using Geo-location Data from Social Media. Frontiers in ICT, 3:10.
A-RESCUE: An Agent-based Regional Evacuation Simulator Coupled with User Enriched Behavior
Published:
Published in Network and Spatial Economics, 2016. Read more
Recommended citation: Ukkusuri, S., Hasan, S., Doan, K., Luong, B., Zhan, X., Murray-Tuite, P., Yin, W., 2016. A-RESCUE: An Agent-based Regional Evacuation Simulator Coupled with User Enriched Behavior. Network and Spatial Economics, 17(1), 197-223.
Determining the Impact of Personal Mobility Carbon Allowance Schemes in Transportation Networks
Published:
Published in Network and Spatial Economics, 2016. Read more
Recommended citation: Aziz, H. M., Ukkusuri, S., Zhan, X., 2016. Determining the Impact of Personal Mobility Carbon Allowance Schemes in Transportation Networks. Network and Spatial Economics, 17(2), 505-545.
Citywide Traffic Volume Estimation Using Trajectory Data
Published:
Published in IEEE Transactions on Knowledge and Data Engineering (TKDE), 2016. Read more
Recommended citation: Zhan, X., Zheng, Y., Yi, X., and Ukkusuri, S. V., 2016. Citywide Traffic Volume Estimation Using Trajectory Data. IEEE Transactions on Knowledge and Data Engineering (TKDE), 29(2), 272-285.
Generic Patterns in the Evolution of Urban Water Networks: Evidence from a Large Asian City
Published:
Published in Physical Review E, 2017. Read more
Recommended citation: Kreuger, E., Klinkhamer, C., Urich C., Zhan, X., and Rao, S. C., 2017. Generic Patterns in the Evolution of Urban Water Networks: Evidence from a Large Asian City. Physical Review E, 95(3), 032312.
Multiclass, Simultaneous Route and Departure Time Choice Dynamic Traffic Assignment with an Embedded Spatial Queuing Model
Published:
Published in Transportmetrica B: Transport Dynamics, 2017. Read more
Recommended citation: Zhan, X., and Ukkusuri, S. V., 2019. Multiclass, Simultaneous Route and Departure Time Choice Dynamic Traffic Assignment with an Embedded Spatial Queuing Model. Transportmetrica B: Transport Dynamics, 7:1, 124-146.
Speed Profile Estimation Using License Plate Recognition Data
Published:
Published in Transportation Research Part C: Emerging Technology, 2017. Read more
Recommended citation: Mo, B., Li, R., Zhan, X., 2017. Speed Profile Estimation Using License Plate Recognition Data. Transportation Research Part C: Emerging Technology, 82, 358–378.
Simulation of Hard Shoulder Running Combined with Queue Warning During Traffic Accident with CTM model
Published:
Published in IET Intelligent Transport Systems, 2017. Read more
Recommended citation: Li, R. Ye, Z., Li. B. and Zhan, X., 2017. Simulation of Hard Shoulder Running Combined with Queue Warning During Traffic Accident with CTM model. IET Intelligent Transport Systems, 11(9), 553-560.
Dynamics of Functional Failures and Recovery in Complex Road Networks
Published:
Published in Physical Review E, 2017. Read more
Recommended citation: Zhan, X., Ukkusuri, S. V., and Rao, S. C., 2017. Dynamics of Functional Failures and Recovery in Complex Road Networks. Physical Review E, 96(5), 052301.
A-Rescue 2.0: A High Fidelity, Parallel, Agent-based Evacuation Simulator
Published:
Published in Journal of Computing in Civil Engineering, 2018. Read more
Recommended citation: Gehlot, H., Zhan, X., Qian, X., Thompson, C., Kulkarni, M. and Ukkusuri, S. V., 2018. A-Rescue 2.0: A High Fidelity, Parallel, Agent-based Evacuation Simulator. Journal of Computing in Civil Engineering, 33(2), 04018059.
A Century of Topological Co-Evolution of Complex Infrastructure Networks in an Alpine City
Published:
Published in Complexity, 2019. Read more
Recommended citation: Zischg, J., Klinkhamer, C., Zhan, X., Rao, S. C., and Sitzenfrei, R., 2019. A Century of Topological Co-Evolution of Complex Infrastructure Networks in an Alpine City. Complexity, 2019, 2096749.
Spatial Dependency of Urban Sprawl and the Underlying Road Network Structure
Published:
Published in Journal of Urban Planning and Development, 2019. Read more
Recommended citation: Zhan, X., and Ukkusuri, S. V., 2019. Spatial Dependency of Urban Sprawl and the Underlying Road Network Structure. Journal of Urban Planning and Development, 145(4), 04019014.
Link-based traffic state estimation and prediction for arterial networks using license-plate recognition data
Published:
Published in Transportation Research Part C: Emerging Technologies, 2020. Read more
Recommended citation: Zhan, X., Li, R., and Ukkusuri, S. V., 2020. Link-based traffic state estimation and prediction for arterial networks using license-plate recognition data. Transportation Research Part C: Emerging Technologies, 117, 102660.
Fusing Mobile Phone and Travel Survey Data to Model Urban Activity Dynamics
Published:
Published in Journal of Advanced Transportation, 2020. Read more
Recommended citation: Yang, C., Zhang, Y., Zhan, X., Ukkusuri, S. V. and Chen, Y., 2020. Fusing Mobile Phone and Travel Survey Data to Model Urban Activity Dynamics. Journal of Advanced Transportation, 2020, 5321385.
CSCAD: Correlation Structure-based Collective Anomaly Detection in Complex System
Published:
In IEEE Transactions on Knowledge and Data Engineering (TKDE). Read more
Recommended citation: Qin, H., Zhan, X., and Zheng, Y., 2022. CSCAD: Correlation Structure-based Collective Anomaly Detection in Complex System. In IEEE Transactions on Knowledge and Data Engineering (TKDE).
Curriculum Goal-Conditioned Imitation for Offline Reinforcement Learning
Published:
In IEEE Transactions on Games. Read more
Recommended citation: Feng, X., Jiang, L., Yu, X., Xu, H., Sun, X., Wang, J., Zhan, X. and Chan, W. K., 2023. Curriculum Goal-Conditioned Imitation for Offline Reinforcement Learning. In IEEE Transactions on Games.
publications_preprint
Offline Reinforcement Learning with Soft Behavior Regularization
Published:
Preprint, under review. Read more
Recommended citation: Xu, H., Zhan, X., Li, J., and Yin, H. Offline Reinforcement Learning with Soft Behavior Regularization. NeurIPS 2021 Offline RL Workshop.
A Versatile and Efficient Reinforcement Learning Framework for Autonomous Driving
Published:
Preprint, under review. Read more
Recommended citation: Wang, G., Niu, H., Zhu, D., Hu, J., Zhan, X., and Zhou, G. A Versatile and Efficient Reinforcement Learning Framework for Autonomous Driving. NeurIPS 2022 Reinforcement Learning for Real Life (RL4RealLife) Workshop.
H2O+: An Improved Framework for Hybrid Offline-and-Online RL with Dynamics Gaps
Published:
Preprint, under review. Read more
Recommended citation: Niu, H., Ji, T., Liu, B., Zhao, H., Zhu, X., Zheng, J., Huang, P., Zhou, G., Hu, J., Zhan, X. H2O+: An Improved Framework for Hybrid Offline-and-Online RL with Dynamics Gaps. ICLR 2024 Workshop on Data-centric Machine Learning Research (DMLR): Harnessing Momentum for Science.
Instruction-Guided Visual Masking
Published:
Preprint, under review. Read more
Recommended citation: Zheng, J., Li, J., Cheng, S., Zheng, Y., Li, J., Liu, J., Liu, Y., Liu, J., Zhan, X. Instruction-Guided Visual Masking. ICML2024 Workshop on Multi-modal Foundation Model meets Embodied AI (MFM-EAI) (Outstanding paper award).
publications_thesis
thesis Title Number 1
Published:
This paper is about the number 1. The number 2 is left for future work. Read more
Recommended citation: Your Name, You. (2009). "Paper Title Number 1." Journal 1. 1(1). http://academicpages.github.io/files/paper1.pdf
talks
Real Time Link Travel Time Estimation Using License-plate Recognition Data
Published:
Real Time Link Travel Time Estimation Using License-plate Recognition Data. INFORMS 2013, October 2013, Minneapolis. Read more
Multiclass Dynamic User Equilibrium with a Path Based Cell Transmission Model for General Traffic Networks
Published:
Multiclass Dynamic User Equilibrium with a Path Based Cell Transmission Model for General Traffic Networks. INFORMS 2013, October 2013, Minneapolis. Read more
Urban Link Travel Time Estimation Using Large-scale Taxi Data with Partial Information
Published:
Urban Link Travel Time Estimation Using Large-scale Taxi Data with Partial Information. MPE 2013+ Workshop on Sustainable Human Environments. April 2014, Rutgers University. Read more
Measuring the Efficiency of Urban Taxi Service System
Published:
Measuring the Efficiency of Urban Taxi Service System. KDD 2014 International Workshop on Urban Computing, August 2014, New York. More information here Read more
A Graph-based Approach to Measure the Efficiency of Urban Taxi Service System
Published:
A Graph-based Approach to Measure the Efficiency of Urban Taxi Service System. INFORMS 2015, November 2015, Philadelphia Read more
A Bayesian Mixture Model for Short-term Average Link Travel Time Estimation Using Large-scale Limited Information Trip-based Data
Published:
A Bayesian Mixture Model for Short-term Average Link Travel Time Estimation Using Large-scale Limited Information Trip-based Data. INFORMS 2015, November 2015, Philadelphia Read more
A Node Splitting-Recovery Model for Congestion Evolution Process on Road Networks
Published:
A Node Splitting-Recovery Model for Congestion Evolution Process on Road Networks. 4th International Symposium on Water, Feedbacks, and Complexity. March 2016, Purdue University. Read more
A Node Splitting-Recovery Model for Congestion Evolution Process on Road Networks
Published:
A Node Split-Recovery Model for Congestion Evolution Process on Road Networks. Resilience Week 2016. August 2016, Chicago. Read more
A Vertex Split-Recovery Model for Congestion Evolution Process on Road Networks
Published:
A Vertex Split-Recovery Model for Congestion Evolution Process on Road Networks. INFORMS 2016. November 2016, Nashville. Read more
Traffic State Estimation for Arterial Networks Using License-plate Recognition Data
Published:
Traffic State Estimation for Arterial Networks Using License-plate Recognition Data. INFORMS 2016. November 2016, Nashville. Read more
Data-driven Methods in Urban Transportation Applications
Published:
Data-driven Methods in Urban Transportation Applications. Invited talk at Tsinghua University. September 2017, Beijing, China. Read more
Data-driven Optimization Models for Logistics in Urban Applications
Published:
Data-driven Optimization Models for Logistics in Urban Applications. 3rd Workshop on Applications of the Mathematical Modeling in Enterprises. July 2018, University of Chinese Academy of Sciences, Beijing. Read more
Spatio-Temporal Deep Learning in Intelligent Cities
Published:
Spatio-Temporal Deep Learning in Intelligent Cities. Smart Cities and Urban Computing Forum, China National Computer Congress (CNCC 2018). October 2018, Hangzhou. Read more
Data-driven Methods in Urban Applications: New Problems, New Directions and New Approaches
Published:
Data-driven Methods in Urban Applications: New Problems, New Directions and New Approaches. Invited talk at Tsinghua University. December 2018, Beijing, China. Read more
Urban Computing: Building Intelligent Cities with Big Data and AI
Published:
Urban Computing: Building Intelligent Cities with Big Data and AI. Invited talk at Tsinghua University. November 2019, Beijing, China. Read more
Application of Deep Reinforcement Learning in Control Optimization of Thermal Power Plants
Published:
Application of Deep Reinforcement Learning in Control Optimization of Thermal Power Plants. IEEE Services - Industry Symposium. October 2020. Read more
Network-Wide Traffic State Inference Using Emerging Urban Data Sources
Published:
Network-Wide Traffic State Inference Using Emerging Urban Data Sources. Guest lecture at University of Central Florida. March 2021, online. Read more
Offline RL and Its Potential Applications in Healthcare Decision Making
Published:
Offline RL and Its Potential Applications in Healthcare Decision Making. Guest lecture at DeeCamp 2021. June 2021, online. Read more
Podcast Interview at TalkRL
Published:
Podcast interview at “ TalkRL: The Reinforcement Learning Podcast” with Robin Ranjit Singh Chauhan. Covering DeepThermal for controlling thermal power plants, the MORE algorithm for Model-based Offline RL, comparing AI in China and the US, and more! Read more
DeepThermal: Combustion Optimization for Thermal Power Generating Units Using Offline Reinforcement Learning
Published:
DeepThermal: Combustion Optimization for Thermal Power Generating Units Using Offline Reinforcement Learning.. Thirty-Sixth AAAI Conference on Artificial Intelligence (AAAI2022). February 2022. Read more
Data-Driven Decision Making for Real-World Scenarios
Published:
Data-Driven Decision Making for Real-World Scenarios. Invited talk at Haomo AI Day. April 2022, Beijing China. Read more
Data-Driven Decision Making for Real-World Scenarios
Published:
Data-Driven Decision Making for Real-World Scenarios. Invited guest talk at Didi Tech Salon. August 2022, Beijing China. Read more
Data-Driven Decision Making for Real-World Scenarios
Published:
Data-Driven Decision Making for Real-World Scenarios. Invited talk at DataFun Summit 2022. September 2022, Beijing China. Read more
Frontiers in Offline RL Research
Published:
Frontiers in Offline RL Research. Invited talk at iDLab, Tsinghua University. Jan 2023, Beijing China. Read more
Data-Driven Decision Making for Real-World Scenarios
Published:
Data-Driven Decision Making for Real-World Scenarios. Invited talk at UMNI Lab, Purdue University. April 2023. Read more
Offline RL and Beyond: Towards Generalizable Data-Driven Reinforcement Learning
Published:
Offline RL and Beyond: Towards Generalizable Data-Driven Reinforcement Learning. Invited talk at Institute of Automation, Chinese Academy of Sciences. August 2023. Read more
End-to-End Autonomous Driving: From a Decision-Making Perspective
Published:
End-to-End Autonomous Driving: From a Decision-Making Perspective. Talk at Haomo & AIR Open Course. Semptember 2023. Read more
Towards Generalizable and Data-Efficient Embodied Decision-Making
Published:
Towards Generalizable and Data-Efficient Embodied Decision-Making. Invited talk at ChinaMAS 2024. June 2024. Read more
Towards Generalizable and Data-Efficient Embodied Decision-Making
Published:
Towards Generalizable and Data-Efficient Embodied Decision-Making. Invited talk at Workshop on Computational Sustainability in Digital Infrastructure. June 2024. Read more
teaching
Teaching experience 1
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post. Read more
Teaching experience 2
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post. Read more