Computational Experiments for Complex Social Systems: Experiment Design and Generative Explanation

Xiao Xue; Deyu Zhou; Xiangning Yu; Gang Wang; Juanjuan Li; Xia Xie; Lizhen Cui; Fei-Yue Wang

doi:10.1109/JAS.2024.124221

Volume 11 Issue 4

Apr. 2024

IEEE/CAA Journal of Automatica Sinica

JCR Impact Factor: 11.8, Top 4% (SCI Q1)

CiteScore: 17.6, Top 3% (Q1)
Google Scholar h5-index: 77， TOP 5

Turn off MathJax

Article Contents

Article Navigation > IEEE/CAA Journal of Automatica Sinica > 2024 > 11(4): 1022-1038

X. Xue, D. Zhou, X. Yu, G. Wang, J. Li, X. Xie, L. Cui, and F.-Y. Wang, “Computational experiments for complex social systems: Experiment design and generative explanation,” IEEE/CAA J. Autom. Sinica, vol. 11, no. 4, pp. 1022–1038, Apr. 2024. doi: 10.1109/JAS.2024.124221

Citation:

X. Xue, D. Zhou, X. Yu, G. Wang, J. Li, X. Xie, L. Cui, and F.-Y. Wang, “Computational experiments for complex social systems: Experiment design and generative explanation,” IEEE/CAA J. Autom. Sinica, vol. 11, no. 4, pp. 1022–1038, Apr. 2024. doi: 10.1109/JAS.2024.124221

Citation:

PDF( 4958 KB)

Computational Experiments for Complex Social Systems: Experiment Design and Generative Explanation

doi: 10.1109/JAS.2024.124221

Funds: This work was supported in part by the National Key Research and Development Program of China (2021YFF0900800), the National Natural Science Foundation of China (61972276, 62206116, 62032016), the New Liberal Arts Reform and Practice Project of National Ministry of Education (2021170002), the Open Research Fund of the State Key Laboratory for Management and Control of Complex Systems (20210101), and Tianjin University Talent Innovation Reward Program for Literature and Science Graduate Student (C1-2022-010)

More Information

Author Bio:
Xiao Xue (Member, IEEE) received the Ph.D. degree in control theory and control engineering from the Institute of Automation, Chinese Academy of Sciences in 2007. From 2008 to 2012, he was a Post Doctor with the Department of Automation, Tsinghua University. From 2013 to 2014, he was a Visiting Scholar with the School of Computer Sciences, Carnegie Mellon University, USA. He is currently a Professor with the School of Computer Software, College of Intelligence and Computing, Tianjin University. He is also an Adjunct Professor with the Information School, Xi’an University of Financial and Economics. His research interests include service computing, computational experiment, and social computing

Deyu Zhou (Graduate Student Member, IEEE) is a Ph.D. candidate in artificial intelligence at the School of Software, Shandong University. Her research interests include service computing and computational experiment

Xiangning Yu (Graduate Student Member, IEEE) is a Ph.D. candidate at the College of Intelligence and Computing, Tianjin University. Her research interests include service computing and computational experiments

Gang Wang is a Professor at the Information School, Xi’an University of Financial and Economics. He is also a Postdoctoral Fellow for University of Texas at San Antonio, USA. His current research interests include trust management, privacy security and social computing, cloud computing and AIoT

Juanjuan Li (Member, IEEE) received the Ph.D. degree in control science and engineering from Beijing Institute of Technology in 2021. She is currently an Associate Professor with the State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences. Her research interests include blockchain, DAO, and decision intelligence

Xia Xie is a Professor at Hainan University in China. She received the Ph.D. degree in computer architecture from Huazhong University of Science and Technology in 2006. Her research interests include data mining and knowledge graph

Lizhen Cui (Member, IEEE) received the bachelor, M.Sc., and Ph.D. degrees from Shandong University in 1999, 2002, and 2005, respectively.In 2013, he was a Visiting Scholar with Georgia Tech, Atlanta, GA, USA. He is currently a Professor with the School of Software and the Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, and also a Visiting Professor with Nanyang Technological University, Singapore. He has authored or coauthored over 100 articles in journals and refereed conference proceedings. His research interests include big data management and analysis and AI theory and application

Fei-Yue Wang (Fellow, IEEE) received the Ph.D. degree in computer and systems engineering from the Rensselaer Polytechnic Institute, Troy, NY, USA, in 1990. He joined the University of Arizona in 1990 and became a Professor and the Director of the Robotics and Automation Laboratory and the Program in Advanced Research for Complex Systems. In 1999, he founded the Intelligent Control and Systems Engineering Center at the Institute of Automation, Chinese Academy of Sciences (CAS), Beijing, China, under the support of the Outstanding Chinese Talents Program from the State Planning Council, and in 2002, was appointed as the Director of the Key Laboratory of Complex Systems and Intelligence Science, CAS, and Vice President of Institute of Automation, CAS in 2006. He found CAS Center for Social Computing and Parallel Management in 2008, and became the State Specially Appointed Expert and the Founding Director of the State Key Laboratory for Management and Control of Complex Systems in 2011. His current research focuses on methods and applications for parallel intelligence, social computing, and knowledge automation. He is a Fellow of INCOSE, IFAC, ASME, and AAAS. In 2007, he received the National Prize in Natural Sciences of China, numerous best papers awards from IEEE Transactions, and became an Outstanding Scientist of ACM for his work in intelligent control and social computing. He received the IEEE ITS Outstanding Application and Research Awards in 2009, 2011, and 2015, respectively, the IEEE SMC Norbert Wiener Award in 2014, and became the IFAC Pavel J. Nowacki Distinguished Lecturer in 2021.Since 1997, he has been serving as the General or Program Chair of over 30 IEEE, INFORMS, IFAC, ACM, and ASME conferences. He was the President of the IEEE ITS Society from 2005 to 2007, the IEEE Council of RFID from 2019 to 2021, the Chinese Association for Science and Technology, USA, in 2005, the American Zhu Kezhen Education Foundation from 2007 to 2008, the Vice President of the ACM China Council from 2010 to 2011, the Vice President and the Secretary General of the Chinese Association of Automation from 2008 to 2018, the Vice President of IEEE Systems, Man, and Cybernetics Society from 2019 to 2021. He was the Founding Editor-in-Chief (EiC) of the International Journal of Intelligent Control and Systems from 1995 to 2000, IEEE ITS Magazine from 2006 to 2007, IEEE/CAA Journal of Automatica Sinica from 2014−2017, China’s Journal of Command and Control from 2015−2021, and China’s Journal of Intelligent Science and Technology from 2019 to 2021. He was the EiC of the IEEE Intelligent Systems from 2009 to 2012, IEEE Transactions on Intelligent Transportation Systems from 2009 to 2016, and IEEE Transactions on ComputationaL Social Systems from 2017 to 2020. Currently, he is the President of CAA’s Supervision Council and the EiC of IEEE Transaction on Intelligent Vehicles
Corresponding author: Xiao Xue, e-mail: jzxuexiao@tju.edu.cn
Xiao Xue and Deyu Zhou contributed equally to this work.
Received Date: 2023-10-16
Revised Date: 2023-12-07
Accepted Date: 2023-12-25

Available Online: 2024-02-21

Abstract

Abstract

Powered by advanced information technology, more and more complex systems are exhibiting characteristics of the cyber-physical-social systems (CPSS). In this context, computational experiments method has emerged as a novel approach for the design, analysis, management, control, and integration of CPSS, which can realize the causal analysis of complex systems by means of “algorithmization” of “counterfactuals”. However, because CPSS involve human and social factors (e.g., autonomy, initiative, and sociality), it is difficult for traditional design of experiment (DOE) methods to achieve the generative explanation of system emergence. To address this challenge, this paper proposes an integrated approach to the design of computational experiments, incorporating three key modules: 1) Descriptive module: Determining the influencing factors and response variables of the system by means of the modeling of an artificial society; 2) Interpretative module: Selecting factorial experimental design solution to identify the relationship between influencing factors and macro phenomena; 3) Predictive module: Building a meta-model that is equivalent to artificial society to explore its operating laws. Finally, a case study of crowd-sourcing platforms is presented to illustrate the application process and effectiveness of the proposed approach, which can reveal the social impact of algorithmic behavior on “rider race”.
- Agent-based modeling,
- computational experiments,
- cyber-physical-social systems (CPSS),
- generative deduction,
- generative experiments,
- meta model

FullText(HTML)

Xiao Xue and Deyu Zhou contributed equally to this work.

References(42)

References

[1]	Y. Zhou, F. R. Yu, J. Chen, and Y. Kuo, “Cyber-physical-social systems: A state-of-the-art survey, challenges and opportunities,” IEEE Commun. Surv. Tutorials, vol. 22, no. 1, pp. 389–425, 2020. doi: 10.1109/COMST.2019.2959013
[2]	F.-Y. Wang, “The emergence of intelligent enterprises: From CPS to CPSS,” IEEE Intell. Syst., vol. 25, no. 4, pp. 85–88, Jul.–Aug. 2010. doi: 10.1109/MIS.2010.104
[3]	X. Xue, X.-N. Yu, D.-Y. Zhou, P. Chao, X. Wang, Z.-B. Zhou, and F.-Y. Wang, “Computational experiments: Past, present and perspective,” Acta Autom. Sinica, vol. 49, no. 2, pp. 246–271, Feb. 2023.
[4]	X. Xue, X. Yu, and F.-Y. Wang, “ChatGPT chats on computational experiments: From interactive intelligence to imaginative intelligence for design of artificial societies and optimization of foundational models,” IEEE/CAA J. Autom. Sinica, vol. 10, no. 6, pp. 1357–1360, Jun. 2023. doi: 10.1109/JAS.2023.123585
[5]	X. Xue, Y. Guo, S. Chen, and S. Wang, “Analysis and controlling of manufacturing service ecosystem: A research framework based on the parallel system theory,” IEEE Trans. Serv. Comput., vol. 14, no. 6, pp. 1598–1611, Nov.-Dec. 2021. doi: 10.1109/TSC.2019.2917445
[6]	M. Kahng, N. Thorat, D. H. Chau, F. B. Viégas, and M. Wattenberg, “GAN Lab: Understanding complex deep generative models using interactive visual experimentation,” IEEE Trans. Visualization Comput. Graphics, vol. 25, no. 1, pp. 310–320, Jan. 2019. doi: 10.1109/TVCG.2018.2864500
[7]	D. Lazer, A. Pentland, L. Adamic, S. Aral, A. L. Barabási, D. Brewer, N. Christakis, N. Contractor, J. Fowler, M. Gutmann, T. Jebara, G. King, M. Macy, D. Roy, and M. Van Alstyne, “Computational social science,” Science, vol. 323, no. 5915, pp. 721–723, Feb. 2009. doi: 10.1126/science.1167742
[8]	J. M. Hofman, D. J. Watts, S. Athey, F. Garip, T. L. Griffiths, J. Kleinberg, H. Margetts, S. Mullainathan, M. J. Salganik, S. Vazire, A. Vespignani, and T. Yarkoni, “Integrating explanation and prediction in computational social science,” Nature, vol. 595, no. 7866, pp. 181–188, Jun. 2021. doi: 10.1038/s41586-021-03659-0
[9]	C. Cioffi-Revilla and M. Rouleau, “MASON RebeLand: An agent-based model of politics, environment, and insurgency,” Int. Stud. Rev., vol. 12, no. 1, pp. 31–52, Mar. 2010. doi: 10.1111/j.1468-2486.2009.00911.x
[10]	X. Xue, G. Li, D. Zhou, Y. Zhang, L. Zhang, Y. Zhao, Z. Feng, L. Cui, Z. Zhou, X. Sun, X. Lu, and S. Chen, “Research roadmap of service ecosystems: A crowd intelligence perspective,” Int. J. Crowd Sci., vol. 6, no. 4, pp. 195–222, Nov. 2022. doi: 10.26599/IJCS.2022.9100026
[11]	W. Zhang, A. Valencia, and N.-B. Chang, “Synergistic integration between machine learning and agent-based modeling: A multidisciplinary review,” IEEE Trans. Neural Netw. Learn. Syst., vol. 34, no. 5, pp. 2170–2190, May 2023. doi: 10.1109/TNNLS.2021.3106777
[12]	X. Xue, F. Chen, D. Zhou, X. Wang, M. Lu, and F.-Y. Wang, “Computational experiments for complex social systems—Part I: The customization of computational model,” IEEE Trans. Comput. Soc. Syst., vol. 9, no. 5, pp. 1330–1344, Oct. 2022. doi: 10.1109/TCSS.2021.3125287
[13]	X. Xue, Z. Chen, S. Wang, Z. Feng, Y. Duan, and Z. Zhou, “Value entropy: A systematic evaluation model of service ecosystem evolution,” IEEE Trans. Serv. Comput., vol. 15, no. 4, pp. 1760–1773, Jul.–Aug. 2022. doi: 10.1109/TSC.2020.3016660
[14]	M. J. Salganik, P. S. Dodds, and D. J. Watts, “Experimental study of inequality and unpredictability in an artificial cultural market,” Science, vol. 311, no. 5762, pp. 854–856, Feb. 2006. doi: 10.1126/science.1121066
[15]	X. Xue, S. Wang, L. Zhang, Z. Feng, and Y. Guo, “Social learning evolution (SLE): Computational experiment-based modeling framework of social manufacturing,” IEEE Trans. Ind. Inf., vol. 15, no. 6, pp. 3343–3355, Jun. 2019. doi: 10.1109/TII.2018.2871167
[16]	C. Peng, X. Yu, W. Ma, H. Kaneko, L. Meng, Y. Zhao, and X. Xue, “Computational experiments: Virtual production and governance tool for metaverse,” Int. J. Crowd Sci., vol. 7, no. 4, pp. 158–167, Dec. 2023. doi: 10.26599/IJCS.2023.9100023
[17]	S. N. Politis, P. Colombo, G. Colombo, and D. M. Rekkas, “Design of experiments (DoE) in pharmaceutical development,” Drug Dev. Ind. Pharm., vol. 43, no. 6, pp. 889–901, Feb. 2017. doi: 10.1080/03639045.2017.1291672
[18]	J. Ferber and O. Gutknecht, “A meta-model for the analysis and design of organizations in multi-agent systems,” in Proc. Int. Conf. Multi Agent Systems, Paris, France, 1998, pp. 128–135.
[19]	A. Dorri, S. S. Kanhere, and R. Jurdak, “Multi-agent systems: A survey,” IEEE Access, vol. 6, pp. 28573–28593, Apr. 2018. doi: 10.1109/ACCESS.2018.2831228
[20]	D. Kahneman and A. Tversky, “Prospect theory: An analysis of decision under risk,” Econometrica, vol. 47, no. 2, pp. 263–292, Mar. 1979. doi: 10.2307/1914185
[21]	D. Zhou, X. Xue, and Z. Zhou, “SLE2: The improved social learning evolution model of cloud manufacturing service ecosystem,” IEEE Trans. Ind. Inf., vol. 18, no. 12, pp. 9017–9026, Dec. 2022. doi: 10.1109/TII.2022.3173053
[22]	M. Lu, S. Chen, X. Xue, X. Wang, Y. Zhang, Y. Zhang, and F.-Y. Wang, “Computational experiments for complex social systems—Part II: The evaluation of computational models,” IEEE Trans. Comput. Soc. Syst., vol. 9, no. 4, pp. 1224–1236, Aug. 2022. doi: 10.1109/TCSS.2021.3121323
[23]	R. Sanders, “The pareto principle: Its use and abuse,” J. Serv. Mark., vol. 1, no. 2, pp. 37–40, Feb. 1987. doi: 10.1108/eb024706
[24]	J. B. Ullman and P. M. Bentler, “Structural equation modeling,” in Handbook of Psychology, 2nd ed. J. A. Schinka, W. F. Velicer, and I. B. Weiner, Eds. Hoboken, USA: John Wiley & Sons, 2012.
[25]	L. Du, “Research On Efficient Experimental Design Methods For Complex Simulation System,” Harbin Institute of Technology, 2018.
[26]	J. P. C. Kleijnen, Design and Analysis of Simulation Experiments. L. G. Zhang, J. K. Zhang, and X. K. Liu, trans. Beijing: Electronic Industry Press, 2010.
[27]	C. Z. Mooney, Monte Carlo Simulation. Los Angeles, USA: Sage, 1997.
[28]	C. H. Yu, “Resampling methods: Concepts, applications, and justification,” Pract. Assess. Res. Eval., vol. 8, p. 19, 2002.
[29]	G. Ten Broeke, G. Van Voorn, and A. Ligtenberg, “Which sensitivity analysis method should I use for my agent-based model,” J. Artif. Soc. Soc. Simul., vol. 19, no. 1, p. 5, Jan. 2016. doi: 10.18564/jasss.2857
[30]	I. Salle and M. Yıldızoğlu, “Efficient sampling and meta-modeling for computational economic models,” Comput. Econ., vol. 44, no. 4, pp. 507–536, Dec. 2014. doi: 10.1007/s10614-013-9406-7
[31]	M. Edali and G. Yücel, “Automated analysis of regularities between model parameters and output using support vector regression in conjunction with decision trees,” J. Artif. Soc. Soc. Simul., vol. 21, no. 4, p. 1, Oct. 2018. doi: 10.18564/jasss.3786
[32]	K. N. Cui, X. L. Zheng, D. Wen, and X. L. Zhao, “Researches and applications of computational experiments,” Acta Autom. Sinica, vol. 39, no. 8, pp. 1157–1169, Aug. 2013.
[33]	J. P. C. Kleijnen, W. Van Beers, and I. Van Nieuwenhuyse, “Expected improvement in efficient global optimization through bootstrapped kriging,” J. Global Optim., vol. 54, no. 1, pp. 59–73, Sept. 2012. doi: 10.1007/s10898-011-9741-y
[34]	K.-T. Fang, R. Li, and A. Sudjianto, Design and Modeling for Computer Experiments. Boca Raton: Chapman & Hall/CRC, 2006.
[35]	F. Zhang and L. J. O’Donnell, “Support vector regression,” in Machine Learning, A. Mechelli and S. Vieira, Eds. Amsterdam: Elsevier, 2020, pp. 123-140.
[36]	S. M. Clarke, J. H. Griebsch, and T. W. Simpson, “Analysis of support vector regression for approximation of complex engineering analyses,” J. Mech. Des., vol. 127, no. 6, pp. 1077–1087, Nov. 2005. doi: 10.1115/1.1897403
[37]	Y. F. Li, S. H. Ng, M. Xie, and T. N. Goh, “A systematic comparison of metamodeling techniques for simulation optimization in decision support systems,” Appl. Soft Comput., vol. 10, no. 4, pp. 1257–1273, Sept. 2010. doi: 10.1016/j.asoc.2009.11.034
[38]	N. Villa-Vialaneix, M. Follador, M. Ratto, and A. Leip, “A comparison of eight metamodeling techniques for the simulation of N₂O fluxes and N leaching from corn crops,” Environ. Modell. Software, vol. 34, pp. 51–66, Jun. 2012. doi: 10.1016/j.envsoft.2011.05.003
[39]	N. Barakat and A. P. Bradley, “Rule extraction from support vector machines: A review,” Neurocomputing, vol. 74, pp. 1–3, Dec. 2010. doi: 10.1016/j.neucom.2010.08.007
[40]	L. Breiman, J. Friedman, R. A. Olshen, and C. J. Stone, Classification and Regression Trees. New York, USA: CRC Press, 1984.
[41]	E. Alpaydin, Introduction to Machine Learning. Cambridge, USA: The MIT Press, 2014.
[42]	P. Sun, “Your order, their labor: An exploration of algorithms and laboring on food delivery platforms in China,” Chin. J. Commun., vol. 12, no. 3, pp. 308–323, Mar. 2019. doi: 10.1080/17544750.2019.1583676

Supplements(0)

Cited By

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Figures(10) / Tables(5)

Get Citation

PDF

XML

Article Metrics

Article views (111) PDF downloads(41)

Highlights

It is difficult for traditional design of experiment methods to achieve the generative explanation of system emergence
We propose an integrated approach to the design of computational experiments, incorporating three key modules: descriptive module, interpretative module, and predictive module

Computational Experiments for Complex Social Systems: Experiment Design and Generative Explanation

doi: 10.1109/JAS.2024.124221

Abstract

References

Proportional views

Catalog

通讯作者: 陈斌, bchen63@163.com

Article Metrics

Highlights

Export File

Citation

Format

Content