An Efficient Weak-Constraint Gradient-Based Parameter-Estimation Algorithm Using Representer Expansions

SPE Journal ◽  
2009 ◽  
Vol 15 (01) ◽  
pp. 18-30 ◽  
Author(s):  
J.R.. R. Rommelse ◽  
J.D.. D. Jansen ◽  
A.W.. W. Heemink

Summary The discrepancy between observed measurements and model predictions can be used to improve either the model output alone or both the model output and the parameters that underlie the model. In the case of parameter estimation, methods exist that can efficiently calculate the gradient of the discrepancy to changes in the parameters, assuming that there are no uncertainties in addition to the unknown parameters. In the case of general nonlinear parameter estimation, many different parameter sets exist that locally minimize the discrepancy. In this case, the gradient must be regularized before it can be used by gradient-based minimization algorithms. This article proposes a method for calculating a gradient in the presence of additional model errors through the use of representer expansions. The representers are data-driven basis functions that perform the regularization. All available data can be used during every iteration of the minimization scheme, as is the case in the classical representer method (RM). However, the method proposed here also allows adaptive selection of different portions of the data during different iterations to reduce computation time; the user now has the freedom to choose the number of basis functions and revise this choice at every iteration. The method also differs from the classic RM by the introduction of measurement representers in addition to state, adjoint, and parameter representers and by the fact that no correction terms are calculated. Unlike the classic RM, where the minimization scheme is prescribed, the RM proposed here provides a gradient that can be used in any minimization algorithm. The applicability of the modified method is illustrated with a synthetic example to estimate permeability values in an inverted- five-spot waterflooding problem.

2015 ◽  
Vol 738-739 ◽  
pp. 423-429
Author(s):  
Jian Jun Zhang

High calculation precision and speed of the model parameter estimation has become the theoretical research emphasis and the key link of the applications of the time series analysis based methods. Aiming at the problem that some of the previous parameter estimation methods exist the weakness of stronger constraints, higher time complexity, lower precision of the whole recurrence process and insufficient online diagnosis power, this paper proposes an approach which repeatedly uses the auto-covariance function and the autocorrelation function throughout the recurrent process while guaranteeing not to increase the time complexity of the proposed algorithm and, hence improve the calculation speed and accuracy of parameter estimation simultaneously. As compared to related work, it has lower time complexity, shorter computation time and higher parameter estimation accuracy. The fault diagnosis steps based on the proposed parameter estimation approach are also suggested.


2021 ◽  
Author(s):  
Leonard Schmiester ◽  
Daniel Weindl ◽  
Jan Hasenauer

AbstractMotivationUnknown parameters of dynamical models are commonly estimated from experimental data. However, while various efficient optimization and uncertainty analysis methods have been proposed for quantitative data, methods for qualitative data are rare and suffer from bad scaling and convergence.ResultsHere, we propose an efficient and reliable framework for estimating the parameters of ordinary differential equation models from qualitative data. In this framework, we derive a semi-analytical algorithm for gradient calculation of the optimal scaling method developed for qualitative data. This enables the use of efficient gradient-based optimization algorithms. We demonstrate that the use of gradient information improves performance of optimization and uncertainty quantification on several application examples. On average, we achieve a speedup of more than one order of magnitude compared to gradient-free optimization. Additionally, in some examples, the gradient-based approach yields substantially improved objective function values and quality of the fits. Accordingly, the proposed framework substantially improves the parameterization of models from qualitative data.AvailabilityThe proposed approach is implemented in the open-source Python Parameter EStimation TOolbox (pyPESTO). All application examples and code to reproduce this study are available at https://doi.org/10.5281/zenodo.4507613.


Author(s):  
А.В. Башкиров ◽  
О.Ю. Макаров ◽  
А.С. Демихова ◽  
М.В. Долженко ◽  
О.В. Ильина

Предложен метод сочетания мультиплексирования с ортогональным частотным разделением каналов (OFDM) с пространственно-временным блочным кодированием (STBC). Предлагаются коды с пониженной сложностью декодирования и высокой эффективностью использования полосы пропускания. Большинство работ по данной тематике предлагают комбинацию кодов STBC-OFDM для ситуаций, где параметры канала известны заранее и прошиты в приемнике. С внедрением новых методов оценки каналов моделируются и анализируются реальные условия, чтобы предложить методы, подходящие для эффективной работы будущих беспроводных технологий, таких как 5G. Исследована методика оценки каналов для систем STBC-OFDM с использованием различного количества передающих и приемных антенн, различного порядка модуляции для пилотных и информационных поднесущих, различного количества пилотных поднесущих и различных условий состояния канала. Представлены результаты моделирования для 2-х и 4-х передающих антенн и 1-х и 2-х приемных антенн, а также проведено сравнение алгоритма оценки канала с идеальным случаем, когда предполагается, что параметры канала известны в приемнике. Кроме того, исследовано влияние группового декодирования путем анализа времени декодирования одного блока STBC-OFDM и времени, сэкономленного на декодировании всей группы блоков данных. Из результатов моделирования видно, что предложенная методика обладает преимуществами повышения вычислительной эффективности системы за счет сокращения времени вычислений при одновременном увеличении числа пилотных поднесущих. Использование метода группового декодирования позволяет системе быть более устойчивой к распространению ошибок. Действительно, в традиционных схемах, использующих итерационный метод, где оценка канала выполняется в начале передачи, распространение ошибки имеет решающее значение, так как ошибка в оценке параметра канала приведет к неточному декодированию данных. В рамках проведенного исследования были предложены новая совместная оценка канала и восстановление поврежденных данных. Метод отличается энергоэффективностью и простотой вычислений за счет того, что он не требует инверсии матрицы на приемнике в отличие от других методов, рассматриваемых в литературе In this paper, a method for combining OFDM with STBC is proposed. Codes with reduced decoding complexity and high bandwidth efficiency are proposed. Most of the works on this topic suggest a combination of STBC-OFDM codes for situations where the channel parameters are known in advance and are embedded in the receiver. With the introduction of new channel estimation methods, real-world conditions are modeled and analyzed to propose methods suitable for efficient operation of future wireless technologies such as 5G. The article explores a channel estimation technique for STBC-OFDM systems using different numbers of transmit and receive antennas, different modulation orders for pilot and data subcarriers, different numbers of pilot subcarriers, and different channel conditions. Simulation results for 2 and 4 transmitting antennas and 1 and 2 receiving antennas are presented, as well as a comparison of the channel estimation algorithm with the ideal case, when it is assumed that the channel parameters are known in the receiver. In addition, the effect of group decoding was investigated by analyzing the decoding time of one STBC-OFDM block and the time saved on decoding the entire group of data blocks. It can be seen from the simulation results that the proposed method has the advantages of increasing the computational efficiency of the system by reducing the computation time while increasing the number of pilot subcarriers. As part of the research carried out in the article, a new joint channel assessment and recovery of damaged data were proposed. The method is distinguished by its energy efficiency and simplicity of calculations due to the fact that the method does not require inversion of the matrix at the receiver, unlike other methods proposed in the literature


2003 ◽  
Vol 125 (1) ◽  
pp. 11-18 ◽  
Author(s):  
Anindya Chatterjee ◽  
Joseph P. Cusumano

We present an observer for parameter estimation in nonlinear oscillating systems (periodic, quasiperiodic or chaotic). The observer requires measurements of generalized displacements. It estimates generalized velocities on a fast time scale and unknown parameters on a slow time scale, with time scale separation specified by a small parameter ε. Parameter estimates converge asymptotically like e−εt where t is time, provided the data is such that a certain averaged coefficient matrix is positive definite. The method is robust: small model errors and noise cause small estimation errors. The effects of zero mean, high frequency noise can be reduced by faster sampling. Several numerical examples show the effectiveness of the method.


2014 ◽  
Vol 2014 ◽  
pp. 1-7 ◽  
Author(s):  
Alimorad Mahmoudi

This paper addresses the problem of multichannel autoregressive (MAR) parameter estimation in the presence of spatially correlated noise by steepest descent (SD) method which combines low-order and high-order Yule-Walker (YW) equations. In addition, to yield an unbiased estimate of the MAR model parameters, we apply inverse filtering for noise covariance matrix estimation. In a simulation study, the performance of the proposed unbiased estimation algorithm is evaluated and compared with existing parameter estimation methods.


2020 ◽  
Author(s):  
Martin Verlaan ◽  
Xiaohui Wang ◽  
Hai Xiang Lin

<p><span>Previous development of a parameter estimation scheme for a Global Tide and Surge Model (GTSM) showed that accurate estimation of the parameters is currently limited by the memory use of the analysis step and the computational demand. Because the estimation algorithm solver requires storage of the model output matching each observation for each parameter (or ensemble member), the requirement of memory storage gets out of control as the model simulation time increases, the model output and observation matrix become too large. The popular approach of localization does not work here because the tides propagate all over the globe in days, while parameter estimation requires weeks at least. Proper Orthogonal Decomposition (POD) is a useful technique to reduce the high dimension system with a smaller linear subspace. Singular values decomposition (SVD) is one of the methods to derive the POD modes, which is generally applied for space patterns. In this study, we focus on the application of POD in time patterns by using SVD to reduce the dimension in time patterns. As expected, the time patterns show a strong resemblance to the tidal constituents, but the same method is likely to work for a wider range of problems, which indicate that the memory requirements can be reduced dramatically by projection the model output and observations onto the time-POD patterns.</span></p>


2021 ◽  
pp. 1-14
Author(s):  
Nan Zhang ◽  
Yuhong Sheng ◽  
Jing Zhang ◽  
Xiaoli Wang

In uncertainty theory, parameter estimation of uncertain differential equation is a very important research direction. The parameter estimation of multifactor uncertain differential equation needs to be solved. Multifactor uncertain differential equation is a differential equation driven by multiple Liu processes. The paper introduces two methods to solve the unknown parameters of the multifactor uncertain differential equation, they are the method of moment estimation and the method of least squares estimation. Several numerical examples are used to illustrate the proposed parameter estimation methods.


Sign in / Sign up

Export Citation Format

Share Document