>
Fa   |   Ar   |   En
   improving probabilistic bisimulation for mdps using machine learning  
   
نویسنده mohagheghi mohammadsadegh ,salehi khayyam
منبع mathematics interdisciplinary research - 2024 - دوره : 9 - شماره : 2 - صفحه:151 -169
چکیده    ‎the utilization of model checking has been suggested as a formal verification technique for analyzing critical systems‎. ‎however‎, ‎the primary challenge in applying to complex systems is the state space explosion problem‎. ‎to address this issue‎, ‎bisimulation minimization has emerged as a prominent method for reducing the number of states in a system‎, ‎aiming to overcome the difficulties associated with the state space explosion problem‎. ‎for systems with stochastic behaviors‎, ‎probabilistic bisimulation is employed to minimize a given model‎, ‎obtaining its equivalent form with fewer states‎. ‎in this paper‎, ‎we propose a novel technique to partition the state space of a given probabilistic model to its bisimulation classes‎. ‎this technique uses the prism program of a given model and constructs some small versions of the model to train a classifier‎. ‎it then applies supervised machine learning techniques to approximately classify the related partition‎. ‎the resulting partition is then used to accelerate the standard bisimulation technique‎, ‎significantly reducing the running time of the method‎. ‎the experimental results show that the approach can decrease significantly the running time compared to state-of-the-art tools‎.
کلیدواژه probabilistic bisimulation‎، ‎markov decision process‎، ‎model checking‎، ‎machine learning‎، ‎support vector machine
آدرس ‎vali-e-asr university of rafsanjan, ‎department of computer science, iran, shahrekord university, ‎department of computer science, iran
پست الکترونیکی kh.salehi@sku.ac.ir
 
     
   
Authors
  
 
 

Copyright 2023
Islamic World Science Citation Center
All Rights Reserved