Adaptive Cross-layer Optimization Based on Markov Decision Process

1970 ◽  
Vol 108 (2) ◽  
pp. 39-42
Author(s):  
Z. Velickovic ◽  
M. Jevtovic
Keyword(s):  
Markov Decision Process ◽  
Decision Process ◽  
Cross Layer ◽  
Cross Layer Design ◽  
Protocol Stack ◽  
Wireless Multimedia ◽  
Average Value ◽  
Cross Layer Optimization ◽  
Markov Decision ◽  
Simulation Results

In order to satisfy QoS demands of wireless multimedia application it is necessary to make an optimization on several ISO-OSI layers in the protocol stack. In this paper an optimization cross-layer algorithm has been applied based on Markov decision process (MDP). The wireless communication system with one user has been optimized by the transmitting policies in order to maximize the throughput along with the optimization of the average value of the engaged power, satisfying the demanded BER and the average value of rejected packets. Simulation results show that the application of cross-layer design based on MDP is justified. Ill. 2, bibl. 9 (in English; abstracts in English and Lithuanian).http://dx.doi.org/10.5755/j01.eee.108.2.141

scholarly journals A Theoretical Framework for Quality-Aware Cross-Layer Optimized Wireless Multimedia Communications

2008 ◽  
Vol 2008 ◽  
pp. 1-10 ◽  
Author(s):  
Song Ci ◽  
Haohong Wang ◽  
Dalei Wu
Keyword(s):  
Dynamic Programming ◽  
Wireless Networks ◽  
Network Architecture ◽  
Large Scale ◽  
Multimedia Systems ◽  
Multimedia Communications ◽  
Cross Layer ◽  
Cross Layer Design ◽  
Wireless Multimedia ◽  
Cross Layer Optimization

Although cross-layer has been thought as one of the most effective and efficient ways for multimedia communications over wireless networks and a plethora of research has been done in this area, there is still lacking of a rigorous mathematical model to gain in-depth understanding of cross-layer design tradeoffs, spanning from application layer to physical layer. As a result, many existing cross-layer designs enhance the performance of certain layers at the price of either introducing side effects to the overall system performance or violating the syntax and semantics of the layered network architecture. Therefore, lacking of a rigorous theoretical study makes existing cross-layer designs rely on heuristic approaches which are unable to guarantee sound results efficiently and consistently. In this paper, we attempt to fill this gap and develop a new methodological foundation for cross-layer design in wireless multimedia communications. We first introduce a delay-distortion-driven cross-layer optimization framework which can be solved as a large-scale dynamic programming problem. Then, we present new approximate dynamic programming based on significance measure and sensitivity analysis for high-dimensional nonlinear cross-layer optimization in support of real-time multimedia applications. The major contribution of this paper is to present the first rigorous theoretical modeling for integrated cross-layer control and optimization in wireless multimedia communications, providing design insights into multimedia communications over current wireless networks and throwing light on design optimization of the next-generation wireless multimedia systems and networks.

scholarly journals Development of a Shipment Policy for Collection Centers

Mathematics ◽  
2021 ◽  
Vol 9 (12) ◽  
pp. 1385
Author(s):  
Irais Mora-Ochomogo ◽  
Marco Serrato ◽  
Jaime Mora-Vargas ◽  
Raha Akhavan-Tabatabaei
Keyword(s):  
Climate Change ◽  
Natural Disasters ◽  
Markov Decision Process ◽  
Decision Process ◽  
Necessary Conditions ◽  
Decision Makers ◽  
Humanitarian Organizations ◽  
The World ◽  
Markov Decision ◽  
Unsatisfied Demand

Natural disasters represent a latent threat for every country in the world. Due to climate change and other factors, statistics show that they continue to be on the rise. This situation presents a challenge for the communities and the humanitarian organizations to be better prepared and react faster to natural disasters. In some countries, in-kind donations represent a high percentage of the supply for the operations, which presents additional challenges. This research proposes a Markov Decision Process (MDP) model to resemble operations in collection centers, where in-kind donations are received, sorted, packed, and sent to the affected areas. The decision addressed is when to send a shipment considering the uncertainty of the donations’ supply and the demand, as well as the logistics costs and the penalty of unsatisfied demand. As a result of the MDP a Monotone Optimal Non-Decreasing Policy (MONDP) is proposed, which provides valuable insights for decision-makers within this field. Moreover, the necessary conditions to prove the existence of such MONDP are presented.

Sign in / Sign up

Export Citation Format

Share Document