Skip to content

Commit

Permalink
Merge pull request #18 from chhoumann/feedback_update
Browse files Browse the repository at this point in the history
  • Loading branch information
chhoumann authored Nov 6, 2023
2 parents 2b83ca5 + a5d230b commit fd93869
Show file tree
Hide file tree
Showing 2 changed files with 24 additions and 33 deletions.
51 changes: 21 additions & 30 deletions report_pre_thesis/src/sections/definition.tex
Original file line number Diff line number Diff line change
@@ -1,46 +1,37 @@
\section{Definition}\label{sec:definition}
Let $D$ be the LIBS data set, defined in the space $\Lambda \times \mathbb{R}^m$, where $\Lambda$ represents the set of possible wavelengths and $\mathbb{R}^m$ denotes the $m$-dimensional space of intensities.
The dataset $D$ is given by:
This section introduces the LIBS dataset and the hypothesis function for predicting the composition of major oxides, establishing the foundation for model evaluation and optimization in our study.

\begin{equation}
D = \{ (\lambda_1, \vec{I}_1), (\lambda_2, \vec{I}_2), \ldots, (\lambda_n, \vec{I}_n) \}
\end{equation}
\begin{definition}\label{def:dataset}
Let $D$ be the LIBS data set, defined in the space $\Lambda \times \mathbb{R}^m$, where $\Lambda$ represents the set of possible wavelengths and $\mathbb{R}^m$ denotes the $m$-dimensional space of intensities.

Each element $(\lambda_i, \vec{I}_i) \in \Lambda \times \mathbb{R}^{m}$ comprises the wavelength $\lambda_i$ of the $i^{th}$ measurement point, measured in nanometers, and an $m$-dimensional intensity vector $\vec{I}_i = [I_{i1}, I_{i2}, \ldots, I_{im}]$.
This vector captures the intensity values at $\lambda_i$ for each of the $m$ shots, measured in units of photons per channel.
The dataset $D$ is given by $D = \{ (\lambda_1, \vec{I}_1), (\lambda_2, \vec{I}_2), \ldots, (\lambda_n, \vec{I}_n) \}$, where each element $(\lambda_i, \vec{I}_i) \in \Lambda \times \mathbb{R}^{m}$ comprises the wavelength $\lambda_i$ of the $i^{th}$ measurement point, measured in nanometers, and an $m$-dimensional intensity vector $\vec{I}_i = [I_{i1}, I_{i2}, \ldots, I_{im}]$.
This vector captures the intensity values at $\lambda_i$ for each of the $m$ shots, measured in units of photons per channel.
\end{definition}

Given a set of major oxides $O$ where $k=|O|$, define a model $M$ that learns a hypothesis function $f: \Lambda \times \mathbb{R}^m \rightarrow \mathbb{R}^k$ to predict the composition of the $k$ major oxides in geological samples.
The output of the hypothesis function is a vector $\mathbf{\hat{y}} = [\hat{y}_{1}, \hat{y}_{2}, \ldots, \hat{y}_{8}]$ where $\hat{y}_{i}$ is the predicted weight percentage of the major oxide $o_i \in O$.
The sum of the predicted weight percentages is not necessarily equal to 100\%.
\begin{definition}\label{def:hypothesis_function}
Given a set of major oxides $O$ where $k=|O|$, define a model $M$ that learns a hypothesis function $f: \Lambda \times \mathbb{R}^m \rightarrow \mathbb{R}^k$ to predict the composition of the $k$ major oxides in geological samples.
The output of the hypothesis function is a vector $\mathbf{\hat{y}} = [\hat{y}_{1}, \hat{y}_{2}, \ldots, \hat{y}_{8}]$ where $\hat{y}_{i}$ is the predicted weight percentage of the major oxide $o_i \in O$.
\end{definition}
The sum of the predicted weight percentages is not necessarily equal to 100\%, but is not expected to surpass 100\%.
The samples may contain other elements that are not considered major oxides, which would account for the difference.
If the sum of the predicted weight percentages is greater than 100\%, the model is overestimating the weight percentages, and represents a physical impossibility.

We define a function $E$ to measure the error of a model $M$ based on the RMSE of the predictions for each oxide $\mathbf{\hat{y}}$ and actual values $\mathbf{y}$:
There are various methods to evaluate the performance of a model.
We use the average RMSE of the predictions for each oxide $\mathbf{\hat{y}}$ and actual values $\mathbf{y}$, denoted $E$, as the error metric for the model:

\begin{equation}
\begin{equation}\label{eq:avg_rmse_metric}
E(M) = \frac{1}{k} \sum_{i=1}^{k} \sqrt{\frac{1}{m} \sum_{j=1}^{m} (\hat{y}_{ij} - y_{ij})^2}
\end{equation}

Where \( \hat{y}_{ij} \) is the \( i^{th} \) component of the output vector \( \hat{y} \) for the \( j^{th} \) sample in the dataset \( D \), as produced by the hypothesis function \( f \) of model \( M \). Similarly, \( y_{ij} \) is the actual weight percentage of the \( i^{th} \) major oxide \( o_i \in O \) for the \( j^{th} \) sample.

Let $C = \{C_1, C_2, \ldots, C_n\}$ be the set of components that comprise a model $M$.
Given such a model and the set of its components, we define an experiment $X$ to be a change to the model $M$ that affects a subset $S(X) \subseteq C$ of its components.
Let $\mathcal{X} = \{X_1, X_2, \ldots, X_k\}$ be the set of experiments, where each $X_i$ is a function mapping from a model $M$ to a new model $M'$, defined as:

$$
X_i: M \mapsto M\underset{X_i}{\rightarrow}M'
$$

Further, associate with each experiment $X_i$ a corresponding change set $S(X_i)$:

$$
S(X_i) \subseteq C
$$

The effect of an experiment $X$ on the model $M$ results in a new model $M\underset{X}{\rightarrow}M'$ and is measured by the change in the error before and after the experiment, denoted by $\Delta E = E(M) - E(M')$.
$\Delta E > 0$ indicates an improvement in the model error, $\Delta E < 0$ indicates a deterioration in the model error, and $\Delta E = 0$ indicates no change in the model error.
We add the model $M'$ to a set $\mathcal{M}$, which is the set of models that result from the experiments.
Let $M_{MOC}$ be the baseline model recreated based on the original MOC model. $M_{MOC}$ is comprised of various components.
Our plan is to perform a series of experiments on $M_{MOC}$ by making changes to a select number of these components.
By doing so, we transform the original model $M_{MOC}$ into a new model $M$, which retains most of the original components and structure of $M_{MOC}$, with the exception of the modified components.
We will conduct several different experiments, each targeting different components of the model.
For every experiment, we will note which specific parts of the model were altered.
The goal is to measure how each experiment affects the model's performance by looking at the difference in errors before and after the changes.

This leads us to the following challenge:

\textbf{Problem}: Given a set of experiments $\mathcal{X}$ and the resulting set of models $\mathcal{M}$, identify the components $C \in M$ that contribute the most to the overall error $E(M)$.
\textbf{Problem}: Given a series of experiments and the resulting models, identify the components that contribute the most to the overall error $E(M)$.
6 changes: 3 additions & 3 deletions report_pre_thesis/src/sections/introduction.tex
Original file line number Diff line number Diff line change
Expand Up @@ -22,12 +22,12 @@ \section{Introduction}\label{sec:introduction}
Enhancing the predictive accuracy and robustness of the MOC model is crucial for achieving more reliable composition predictions, thereby furthering the scientific objectives of the Mars Science Laboratory in understanding Martian geology and potential habitability.
Accuracy, in this context, is measured as Root Mean Squared Error (RMSE).
Robustness refers to the model's ability to handle the variations in the data.
We use a term 'matrix effects' to refer to these variations.
We use a term 'matrix effects' as a catch-all term for any effect that can cause the intensity of emission lines from an element to vary independent of that element's concentration.
The complexity of LIBS spectra is increased by multiple interacting physical processes.
These interactions, collectively referred to as 'matrix effects,' introduce variability into the emission line intensities independent of the elements' concentrations.
These interactions introduce variability into the emission line intensities independent of the elements' concentrations.
Such variability complicates the direct interpretation of the spectra and poses challenges for computational models aiming for accurate elemental quantification.\cite{andersonImprovedAccuracyQuantitative2017}

In this work, we aim to identify and propose improvements to the specific components of the current MOC model that limit its predictive accuracy and robustness against matrix effects.
\textit{In this work, we aim to solve the problem of identifying and proposing improvements to the specific components of the current MOC model that limit its predictive accuracy and robustness against matrix effects.}

The remainder of this paper is organized as follows:
Section~\ref{sec:background} sets the context, while Section~\ref{sec:related_works} reviews existing literature.
Expand Down

0 comments on commit fd93869

Please sign in to comment.