Browsing by Keywords "Markov processes"
Now showing items 120 of 57

Analysis of concurrency control protocols for realtime database systems
(Elsevier, 1998)This paper provides an approximate analytic solution method for evaluating the performance of concurrency control protocols developed for realtime database systems (RTDBSs). Transactions processed in a RTDBS are associated ... 
Analysis of design parameters in safetycritical computers
(IEEE Computer Society, 2018)Nowadays, safetycritical computers are extensively used in many civil domains like transportation including railways, avionics, and automotive. In evaluating these safety critical systems, previous studies considered ... 
Analyzing large sparse Markov chains of Kronecker products
(IEEE, 2009)Kronecker products are used to define the underlying Markov chain (MC) in various modeling formalisms, including compositional Markovian models, hierarchical Markovian models, and stochastic process algebras. The motivation ... 
An approximate analytical method of analysis of a threshold maintenance policy for a multiphase multicomponent model
(Springer, 2003)A multicomponent system is investigated that consists of n identical unreliable components whose nonfailure operating time consists of a number of sequential phases with exponential times. A maintenance policy is studied ... 
Automatic detection of compound structures by joint selection of region groups from a hierarchical segmentation
(Institute of Electrical and Electronics Engineers, 2016)A challenging problem in remote sensing image analysis is the detection of heterogeneous compound structures such as different types of residential, industrial, and agricultural areas that are composed of spatial arrangements ... 
Averaging methods for transient regimes in overloading retrial queueing systems
(Elsevier, 1999)A new approach is suggested to study transient and stable regimes in overloading retrial queueing systems. This approach is based on limit theorems of averaging principle and diffusion approximation types for socalled ... 
Bant genişliği kısıtı altında videonun en iyi iletimi
(IEEE, 200604)In this paper, we propose an optimal video streaming framework using retransmissions based on the theory of Markov Decision Processes (MDP). Using MDPs, we calculate average reward optimal policies so as to maximize the ... 
Block SOR for Kronecker structured representations
(Elsevier, 2004)The Kronecker structure of a hierarchical Markovian model (HMM) induces nested block partitionings in the transition matrix of its underlying Markov chain. This paper shows how sparse real Schur factors of certain diagonal ... 
Block SOR preconditioned projection methods for Kronecker structured Markovian representations
(SIAM, 2005)Kronecker structured representations are used to cope with the state space explosion problem in Markovian modeling and analysis. Currently, an open research problem is that of devising strong preconditioners to be used ... 
Compact representation of solution vectors in Kroneckerbased Markovian analysis
(Springer, 201608)It is well known that the infinitesimal generator underlying a multidimensional Markov chain with a relatively large reachable state space can be represented compactly on a computer in the form of a block matrix in which ... 
Componentwise bounds for nearly completely decomposable Markov chains using stochastic comparison and reordering
(Elsevier, 2005)This paper presents an improved version of a componentwise bounding algorithm for the state probability vector of nearly completely decomposable Markov chains, and on an application it provides the first numerical results ... 
Computational methods for riskaverse undiscounted transient markov models
(Institute for Operations Research and the Management Sciences (I N F O R M S), 2014)The total cost problem for discretetime controlled transient Markov models is considered. The objective functional is a Markov dynamic risk measure of the total cost. Two solution methods, value and policy iteration, are ... 
Computing moments of first passage times to a subset of states in Markov chains
(SIAM, 2005)This paper presents a relatively efficient and accurate method to compute the moments of first passage times to a subset of states in finite ergodic Markov chains. With the proposed method, the moment computation problem ... 
Conditional steadystate bounds for a subset of states in Markov chains
(ACM, 200610)The problem of computing bounds on the conditional steadystate probability vector of a subset of states in finite, ergodic discretetime Markov chains (DTMCs) is considered. An improved algorithm utilizing the strong ... 
Çok kollu haydutlar ile dinamik ambulans konumlandırma
(IEEE, 201904)Bir ülkenin acil yardım sistemlerinin iyileştirilmesi, daha çok acil vakaya zamanında müdahale edilmesi ve daha çok hayatın kurtarılmasını sağlar. 112 Acil Yardım sisteminin bir parçası olan ambulans konumlandırma problemi, ... 
Decompositional analysis of Kronecker structured Markov chains
(Kent State University, 2008)This contribution proposes a decompositional iterative method with low memory requirements for the steadystate analysis ofKronecker structured Markov chains. The Markovian system is formed by a composition of subsystems ... 
Detection of compound structures by region group selection from hierarchical segmentations
(IEEE, 201607)Detection of compound structures that are comprised of different arrangements of simpler primitive objects has been a challenging problem as commonly used bagofwords models are limited in capturing spatial information. ... 
Detection of compound structures using multiple hierarchical segmentations
(IEEE, 2014)In this paper, we present a method for automatic compound structure detection in highresolution images. Given a query compound structure, our aim is to detect coherent regions with similar spatial arrangement and ... 
Diferansiyel PIR algılayıcılarla dalgacık tabanlı alev tespiti
(IEEE, 201204)Bu makalede, diferansiyel kızılberisi algılayıcı (PIR) kullanılarak geliştirilen bir alev tespit sistemi önerilmektedir. Diferansiyel kızılberisi algılayıcılar, yalnızca görüş alanlarındaki ani sıcaklık değişikliklerine ... 
Discretetime pricing and optimal exercise of American perpetual warrants in the geometric random walk model
(2013)An American option (or, warrant) is the right, but not the obligation, to purchase or sell an underlying equity at any time up to a predetermined expiration date for a predetermined amount. A perpetual American option ...