We now have a collection of literature values for all parameters and their associated uncertainty. Now we want to sample plausible values for use in our ensemble models. Of course, values could be randomly picked from the found literature data, but what about the ‘gaps’ between the data points? These intermediate values could be perfectly plausible parameter values too.

The probability density functions (PDF) describe our beliefs about the plausibility of different possible parameter values in a systematic way, and can be used for sampling continuously from the entire range of plausible values.

What are the options?

There are multiple ways to estimate a probability density function from a data set. They can be split into two categories; parametric and non-parametric. In parametric approaches, the data are used to find parameters for a known distribution that fits the data the best. We tried two parametric methods: fitting to a log-normal distribution and fitting to a normal distribution.

Non-parametric methods don’t use knowledge of a specific distribution; we tried one such method, kernel density estimation. This works by giving each data point an associated wave, the superposition of which gives our PDF.

All these methods have advantages and drawbacks which will be discussed below.

Example of a pdf we used.

These graphs show the difference between the raw data and data sampled from a created PDF.

The graphs are displaying samples from a pdf used the lognormal method. As you can see from the histograms it has given much more information about the densely populated 0-100 Km value range, however it has unfairly reduced the amount of Km = ~ 500 and ~ 700 values. This is a potential downside of parametric methods and can be remedied by the kernel method. However looking at the ascending order values these Km values are still present in the sample of 500.

How it’s done - Finding PDF

Firstly the distribution function must be calculated. For the parametric methods the distribution parameters are calculated for our data set, these are then put into the relevant equation. For the kernel method, the Epanechnikov kernel was used for the waves associated with each point.

For example to find the log-normal distribution you must evaluate the mean of the log of your parameter values (denoted U) and the standard deviation of the log of your paramaters (denoted O). The PDF can then be found from PLACEHOLDER equation/

Practical considerations

How we sampled from our distributions

The PDF was split up into bins. The PDF is evaluated at the start position of each of these bins and the cumulative integral (total area under the PDF from parameter = 0) Was found at the end of each bin. These values are then all normalised so that the final value is equal to 1. As such the difference between two sequential bins cumulative integral is equal to the probability that a randomly picked parameter will be in the bin defined by the two start points.

A random number between 0 and 1 is now generated, This is compared to the cumulative integral to decide which bin to sample from.(see below figure).

Finally we know what bin to sample from but we dont yet know where in the bin too sample. Its assumed that the pdf is constant over the bin such that a newly generated separate random number between 0 and 1 is used to decide where in the bin the value will, assuming all values are equally likely. sampled value = value at start of bin + bin width x random number(0-1).

Final Note