State-dependent control of a single stage hybrid system with poisson arrivals
Discrete Event Dynamic Systems: Theory and Applications
MetadataShow full item record
Please cite this item using this persistent URLhttp://hdl.handle.net/11693/21692
We consider a single-stage hybrid manufacturing system where jobs arrive according to a Poisson process. These jobs undergo a deterministic process which is controllable. We define a stochastic hybrid optimal control problem and decompose it hierarchically to a lower-level and a higher-level problem. The lower-level problem is a deterministic optimal control problem solved by means of calculus of variations. We concentrate on the stochastic discrete-event control problem at the higher level, where the objective is to determine the service times of jobs. Employing a cost structure composed of process costs that are decreasing and strictly convex in service times, and system-time costs that are linear in system times, we show that receding horizon controllers are state-dependent controllers, where state is defined as the system size. In order to improve upon receding horizon controllers, we search for better state-dependent control policies and present two methods to obtain them. These stochastic-approximation-type methods utilize gradient estimators based on Infinitesimal Perturbation Analysis or Imbedded Markov Chain techniques. A numerical example demonstrates the performance improvements due to the proposed methods. © 2011 Springer Science+Business Media, LLC.
- Research Paper 7144
Showing items related by title, author, creator and subject.
Ünal H.U.; Ataşlar-Ayyildiz, B.; Iftar, A.; Özbay H. (2010)Robust controller design for a flow control problem where uncertain multiple time-varying time-delays exist is considered. Although primarily data-communication networks are considered, the presented approach can also be ...
Çakmakci, M.; Ulsoy, A.G. (2011)In the early days of computer control, only one centralized computer was responsible for executing the algorithms. Increasingly, computer control algorithms reside inside individual system components in a distributed ...
Morgül Ö. (Institute of Electrical and Electronics Engineers Inc., 2003)We consider the delayed feedback control (DFC) scheme for one dimensional discrete time systems. To analyze the stability, we construct a map whose fixed points correspond to the periodic orbits of the system to be controlled. ...