Abstract
Thus far we have considered binary observations and continuous observations in our state-space models. With binary observations, we do not consider the magnitudes of the binary-valued events (since each is just a 0 or a 1) but are merely interested in the event occurrences. Consequently, we can treat the spiking-type observations in the earlier chapter as binary-valued as well. There too, our concern was primarily with the occurrence of the cardiac contractions and the accompanying spikes in an EKG signal, but not the actual amplitudes of the spikes.
You have full access to this open access chapter, Download chapter PDF
Thus far we have considered binary observations and continuous observations in our state-space models. With binary observations, we do not consider the magnitudes of the binary-valued events (since each is just a 0 or a 1) but are merely interested in the event occurrences. Consequently, we can treat the spiking-type observations in the earlier chapter as binary-valued as well. There too, our concern was primarily with the occurrence of the cardiac contractions and the accompanying spikes in an EKG signal, but not the actual amplitudes of the spikes. But what happens when we observe a point process that is not just a sequence of zeros and ones but rather is a sequence of zeros and real-valued amplitudes? Such a point process forms a marked point process (MPP). These are encountered frequently in physiological state estimation applications as well. For instance, the sequence of neural impulses underlying a skin conductance signal forms an MPP (Fig. 3.2). So do pulsatile hormone secretory events. In this chapter, we will learn how to derive the state and parameter estimation step equations when the state-space model contains MPP observations.
In this chapter also, we will begin by considering a motivating example. Now we can build many models ranging from simple to complex to account for physiological phenomena. Any mathematical abstraction of a real-world system will have some imperfections to it and will not be able to fully account for all of the data. Occasionally, in engineering systems, we will encounter cases where a simpler model performs better than a more complex model. The estimation of sympathetic arousal from skin conductance is one such case. The state-space model with one binary and two continuous observations is quite complex [29]. However, despite its complexity, it is somewhat imperfect in that it interpolates over a log-transformed version of the SCR amplitudes. A more natural way to account for phasic skin conductance variations is to model the underlying neural impulses as an MPP [32]. This eliminates the need for two continuous variables and is simpler.
A further algorithmic detail is also worth noting here. Mathematical models of real-world systems will always have some limitations. The limitations may be in the model itself or have to do with issues that arise during computation. This book focuses on the estimation of unobserved physiological quantities that are related (fully or partially) to point process observations. Occasionally, when we have both binary and continuous variables involved, the EM algorithm can have a tendency to converge to locations where there is a near-perfect fit to one of the continuous variables (i.e., overfitting occurs). The state-space model with one binary and two continuous observations has this tendency to overfit on experimental data. Consequently, additional constraints have to be put in place to control it [29]. This issue can also occur in the model with one binary and one continuous observation. The use of the MPP framework circumvents the need to have a continuous variable and thus avoids the need for external overfitting control. Thus the simpler MPP state-space model for estimating arousal based on skin conductance performed quite well in comparison to others [32].
7.1 Deriving the Update Equations in the State Estimation Step
In this chapter also, we will assume that \(x_{k}\) evolves with time following one of the state equations we have already seen. Thus no new predict step equations have to be derived.
Recall from (3.21) that the PDF of a single (Bernoulli-distributed) binary observation \(n_{k}\) is
This same density function can be written as
In reality, we could derive our state estimation step update equations based on (7.2) as well. For instance, if we observed \(n_{k} = 0\) at time index k, the posterior density would be
where we have substituted \(n_{k} = 0\) into the exponent of the first term. We could next take the first and second derivatives of the exponent to obtain the corresponding state estimation step update equations for \(x_{k|k}\) and \(\sigma ^{2}_{k|k}\). We could also do the same for \(n_{k} = 1\). In the case of \(n_{k} = 1\), we would have
Finally, we could express the update step equations for the two different cases based on an if-else condition. This would be of the form
if \(n_{k} = 0\),
if \(n_{k} = 1\),
In the case of an MPP where we have non-zero amplitudes only at the instances where point process events occur, the density function for the observations is
where the point process event amplitudes (i.e., the marks) \(r_{k}\) are assumed to be linearly related to \(x_{k}\) through \(r_{k} = \gamma _{0} + \gamma _{1}x_{k} + v_{k}\), where \(v_{k} \sim \mathcal {N}(0, \sigma ^{2}_{v})\) is sensor noise.
Let us now proceed with calculating the update step equations for the two cases where \(n_{k} = 0\) and \(n_{k} = 1\). First consider \(n_{k} = 0\). Based on (7.9), the posterior density is
We can now take the log, take its derivative, and set it to 0 to solve for the mean. This yields
Interestingly, this is the same as (3.38) where we only had one binary observation \(n_{k}\) in the state-space model. Let us now calculate the variance by taking the second derivative.
Again, interestingly, this turns out to be the same as (3.40) where we only had one binary observation. Therefore, when a point process event does not occur (i.e., when \(n_{k} = 0\)), our state estimation step update equations are similar to the case where we only had one binary observation in the state-space model.
We will next consider the case when \(n_{k} = 1\). Note that we will then have the \(r_{k}\) amplitude term as well. Based on (7.9), the posterior is now
Taking the log and proceeding to take the first derivative, we have
Since \(n_{k} = 1\), we will replace \((1 - p_{k})\) with \((n_{k} - p_{k})\). Therefore,
This is the same as (4.21) where we had both a binary variable and a continuous variable in the state-space model. Therefore, based on (4.26), the mean update for \(x_{k}\) is
Also, when we take the second derivative, we end up with
just like (4.28).
This provides an interesting insight. In the case of an MPP, the state estimation step update equations switch between those where one binary variable was observed and where both a binary variable and a continuous variable were observed. This switching occurs depending on whether \(n_{k} = 0\) or \(n_{k} = 1\).
When \(x_{k}\) gives rise to MPP observations comprising of the pairs \((n_{k}, r_{k})\), the update equations in the state estimation step are
if \(n_{k} = 0\),
if \(n_{k} = 1\),
7.2 Deriving the Parameter Estimation Step Equations
The only changes that occur at the parameter estimation step relate to \(\gamma _{0}\), \(\gamma _{1}\), and \(\sigma ^{2}_{v}\). Parameter estimates for other variables such as the process noise variance \(\sigma ^{2}_{\varepsilon }\) do not change.
7.2.1 Deriving the Constant Coefficient Terms
Recall from (4.43) that when we observed one binary variable and one continuous variable, the probability term containing \(\gamma _{0}\), \(\gamma _{1}\), and \(\sigma ^{2}_{v}\) required at the parameter estimation step was
Notice that the product is over \(k = 1, 2, \ldots , K\). This is when we observed a non-zero \(r_{k}\) at each point in time. When we observe an MPP variable as modeled in (7.9), \(r_{k}\) shows up only at the time indices where \(n_{k} = 1\). Let us assume that the point process events occur at time indices \(\tilde {K} \subseteq \{1, 2, \ldots , K\}\). Therefore, in the case of an MPP, the probability term we are interested in at the M-step will be
where the product is only over the specific indices \(\tilde {K}\) rather than everywhere. The corresponding log-likelihood term is therefore
We can now proceed by taking the partial derivatives with respect to \(\gamma _{0}\), \(\gamma _{1}\), and \(\sigma ^{2}_{v}\), setting them to 0 and solving. This yields
Note that all three equations shown above are similar to the case where a continuous variable was always present. Now, however, the summations are only over \(\tilde {K}\). Thus the parameter estimation step updates for \(\gamma _{0}\), \(\gamma _{1}\), and \(\sigma ^{2}_{v}\) are very similar to what we have seen before.
The parameter estimation step updates for \(\gamma _{0}\), \(\gamma _{1}\) and \(\sigma ^{2}_{v}\) when we observe an MPP variable with the amplitudes modeled as \(r_{k} = \gamma _{0} + \gamma _{1}x_{k} + v_{k}\) are
7.3 MATLAB Examples
The MATLAB code examples for estimating \(x_{k}\) from a set of MPP observations are provided in the following folders:
-
one_mpp
-
sim∖
-
data_one_mpp.mat
-
filter_one_mpp.m
-
-
expm∖
-
expm_data_one_mpp.mat
-
expm_filter_one_mpp.m
-
-
The code examples estimate \(x_{k}\) based on the inputs \(n_{k}\) and \(r_{k}\) denoted by the variables n and r. A few differences are to be noted in this code compared to the previous examples. In the previous MATLAB examples, we had the predict, update, predict, update, etc. steps executed repeatedly for \(k = 1, 2, \ldots , K\). However, when we have MPP observations, we have two different filter update equations depending on the value of \(n_{k}\). The \(r_{k}\) amplitudes are only taken into account when \(n_{k} = 1\). Therefore, the state estimation step contains the following:
The state update, also based on an if-else depending on the value of \(n_{k}\), is calculated using the get_posterior_mode(...) function shown below:
The other variables used in the code largely remain the same. For instance, we still use x_pred, x_updt, and x_smth to denote \(x_{k|k - 1}\), \(x_{k|k}\), and \(x_{k|K}\), respectively, and v_pred, v_updt and v_smth to denote the corresponding variances \(\sigma ^{2}_{k|k - 1}\), \(\sigma ^{2}_{k|k}\) and \(\sigma ^{2}_{k|K}\).
7.3.1 Application to Skin Conductance and Sympathetic Arousal
As stated earlier, the sequence of neural impulses underlying the phasic variations in a skin conductance signal forms an MPP. This sequence of impulses is extracted via deconvolution. In the code example, the input (i.e., the deconvolved neural impulse train) is provided through the variables n and r. The variable r(k) has a non-zero amplitude whenever n(k) is equal to 1. The r(k) amplitudes are not taken into account when n(k) is 0. Running the MATLAB examples on simulated and experimental data produces the results shown in Fig. 7.1. The filter was used in [32] for estimating sympathetic arousal from deconvolved skin conductance data. The results on experimental data shown in the figure are based on the study described in [53] (seen in the earlier chapters as well). The study involved different types of stressors interspersed by periods of relaxation. The results of using the same code on the driver stress data in [54] for a particular subject are shown in Fig. 7.2.
References
D. S. Wickramasuriya and R. T. Faghih, “A Bayesian filtering approach for tracking arousal from binary and continuous skin conductance features,” IEEE Transactions on Biomedical Engineering, vol. 67, no. 6, pp. 1749–1760, 2020.
D. S. Wickramasuriya and R. T. Faghih, “A marked point process filtering approach for tracking sympathetic arousal from skin conductance,” IEEE Access, vol. 8, pp. 68 499–68 513, 2020.
J. Birjandtalab, D. Cogan, M. B. Pouyan, and M. Nourani, “A non-EEG biosignals dataset for assessment and visualization of neurological status,” in Proc. IEEE Int. Workshop .Signal Processing Systems, 2016, pp. 110–114.
J. A. Healey and R. W. Picard, “Detecting stress during real-world driving tasks using physiological sensors,” IEEE Transactions on intelligent transportation systems, vol. 6, no. 2, pp. 156–166, 2005.
Author information
Authors and Affiliations
7.1 Electronic Supplementary Material
Rights and permissions
Open Access This chapter is licensed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.
Copyright information
© 2024 The Author(s)
About this chapter
Cite this chapter
Wickramasuriya, D.S., Faghih, R.T. (2024). State-Space Model with One Marked Point Process (MPP) Observation. In: Bayesian Filter Design for Computational Medicine. Springer, Cham. https://doi.org/10.1007/978-3-031-47104-9_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-47104-9_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-47103-2
Online ISBN: 978-3-031-47104-9
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)