• About
  • Policies
  • What is open access
  • Library
  • Contact
Advanced search
      View Item 
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Engineering
      • Department of Mechanical Engineering
      • View Item
      •   BUIR Home
      • Scholarly Publications
      • Faculty of Engineering
      • Department of Mechanical Engineering
      • View Item
      JavaScript is disabled for your browser. Some features of this site may not work without it.

      A 3D game theoretical framework for the evaluation of unmanned aircraft systems airspace integration concepts

      Thumbnail
      Embargo Lift Date: 2023-10-23
      View / Download
      4.3 Mb
      Author(s)
      Albaba, Berat Mert
      Musavi, Negin
      Yıldız, Yıldıray
      Date
      2021-10-23
      Source Title
      Transportation Research Part C: Emerging Technologies
      Print ISSN
      0968-090X
      Electronic ISSN
      1879-2359
      Publisher
      Elsevier
      Volume
      133
      Issue
      2021
      Pages
      103417-1 - 103417-22
      Language
      en
      Type
      Article
      Item Usage Stats
      81
      views
      0
      downloads
      Abstract
      Predicting the outcomes of integrating Unmanned Aerial System (UAS) into the National Airspace System (NAS) is a complex problem, which is required to be addressed by simulation studies before allowing the routine access of UAS into the NAS. This paper focuses on providing a 3-dimensional (3D) simulation framework using a game-theoretical methodology to evaluate integration concepts using scenarios where manned and unmanned air vehicles co-exist. In the proposed method, the human pilot interactive decision-making process is incorporated into airspace models which can fill the gap in the literature where the pilot behavior is generally assumed to be known a priori. The proposed human pilot behavior is modeled using a dynamic level-k reasoning concept and approximate reinforcement learning. The level-k reasoning concept is a notion in game theory and is based on the assumption that humans have various levels of decision making. In the conventional “static” approach, each agent makes assumptions about his or her opponents and chooses his or her actions accordingly. On the other hand, in the dynamic level-k reasoning, agents can update their beliefs about their opponents and revise their level-k rule. In this study, Neural Fitted Q Iteration, which is an approximate reinforcement learning method, is used to model time-extended decisions of pilots with 3D maneuvers. An analysis of UAS integration is conducted using an Example 3D scenario in the presence of manned aircraft and fully autonomous UAS equipped with sense and avoid algorithms.
      Keywords
      UAS integration into NAS
      Reinforcement learning
      Behavioral game theory
      Human modeling
      Permalink
      http://hdl.handle.net/11693/76718
      Published Version (Please cite this version)
      https://doi.org/10.1016/j.trc.2021.103417
      Collections
      • Department of Mechanical Engineering 330
      Show full item record

      Browse

      All of BUIRCommunities & CollectionsTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartmentsCoursesThis CollectionTitlesAuthorsAdvisorsBy Issue DateKeywordsTypeDepartmentsCourses

      My Account

      Login

      Statistics

      View Usage StatisticsView Google Analytics Statistics

      Bilkent University

      If you have trouble accessing this page and need to request an alternate format, contact the site administrator. Phone: (312) 290 2976
      © Bilkent University - Library IT

      Contact Us | Send Feedback | Off-Campus Access | Admin | Privacy