Browsing by Author "Musavi, Negin"
Now showing 1 - 2 of 2
Results Per Page
Sort Options
Item Open Access A 3D game theoretical framework for the evaluation of unmanned aircraft systems airspace integration concepts(Elsevier, 2021-10-23) Albaba, Berat Mert; Musavi, Negin; Yıldız, YıldırayPredicting the outcomes of integrating Unmanned Aerial System (UAS) into the National Airspace System (NAS) is a complex problem, which is required to be addressed by simulation studies before allowing the routine access of UAS into the NAS. This paper focuses on providing a 3-dimensional (3D) simulation framework using a game-theoretical methodology to evaluate integration concepts using scenarios where manned and unmanned air vehicles co-exist. In the proposed method, the human pilot interactive decision-making process is incorporated into airspace models which can fill the gap in the literature where the pilot behavior is generally assumed to be known a priori. The proposed human pilot behavior is modeled using a dynamic level-k reasoning concept and approximate reinforcement learning. The level-k reasoning concept is a notion in game theory and is based on the assumption that humans have various levels of decision making. In the conventional “static” approach, each agent makes assumptions about his or her opponents and chooses his or her actions accordingly. On the other hand, in the dynamic level-k reasoning, agents can update their beliefs about their opponents and revise their level-k rule. In this study, Neural Fitted Q Iteration, which is an approximate reinforcement learning method, is used to model time-extended decisions of pilots with 3D maneuvers. An analysis of UAS integration is conducted using an Example 3D scenario in the presence of manned aircraft and fully autonomous UAS equipped with sense and avoid algorithms.Item Open Access A game theoretical modeling and simulation framework for the integration of unmanned aircraft systems in to the national airspace(AIAA, 2016) Musavi, Negin; Tekelioğlu, K. B.; Yıldız, Yıldıray; Güneş, Kerem; Onural, DenizThe focus of this paper is to present a game theoretical modeling and simulation frame- work for the integration of Unmanned Aircraft Systems (UAS) into the National Airspace system (NAS). The problem of predicting the outcome of complex scenarios, where UAS and manned air vehicles co-exist, is the research problem of this work. The fundamental gap in the literature in terms of developing models for UAS integration into NAS is that the models of interaction between manned and unmanned vehicles are insufficient. These models are insufficient because a) they assume that human behavior is known a priori and b) they disregard human reaction and decision making process. The contribution of this paper is proposing a realistic modeling and simulation framework that will fill this gap in the literature. The foundations of the proposed modeling method is formed by game theory, which analyzes strategic decision making between intelligent agents, bounded rationality concept, which is based on the fact that humans cannot always make perfect decisions, and reinforcement learning, which is shown to be effective in human behavior in psychology literature. These concepts are used to develop a simulator which can be used to obtain the outcomes of scenarios consisting of UAS, manned vehicles, automation and their interactions. An analysis of the UAS integration is done with a specifically designed scenario for this paper. In the scenario, a UAS equipped with sense and avoid algorithm, moves along a predefined trajectory in a crowded airspace. Then the effect of various system parameters on the safety and performance of the overall system is investigated.