Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataset Documentation #21

Open
jejjohnson opened this issue Feb 26, 2023 · 0 comments
Open

Dataset Documentation #21

jejjohnson opened this issue Feb 26, 2023 · 0 comments
Labels
documentation Improvements or additions to documentation

Comments

@jejjohnson
Copy link
Owner

jejjohnson commented Feb 26, 2023

Documentation for use cases associated with the dataset in #4


Use Cases

This is a major feature so it would be worth it to showcase a few examples for how this can be used for most problems. Here is an outline of some ways this can be used


Coordinate-Based Interpolation

This is useful for Interpolation using Neural Fields (a.k.a. Implicit NNs, Coordinate-Based NNs). Some methods include NerFs or even GPs.

Model Formulation

$$ \mathbf{y} = \boldsymbol{f_\theta}(\mathbf{x}) + \epsilon $$

Input Variables:

$$\mathbf{x} \in \mathbb{R}^{D_x}$$

The $\mathbf{x}$ is a 3-dimension vector with of [lat,lon,time].

Output Variables:

$$\mathbf{y} \in \mathbb{R}^{D_y}$$

The output $\mathbf{y}$ is a 2-dimensional vector with of [ssh, sst].


Full-Field Interpolation

This is useful where we want the full field to go into our model

Model Formulation:

$$ \begin{aligned} \mathbf{Z} &= \boldsymbol{F_e}(\mathbf{X}) \\ \hat{\mathbf{X}} &= \boldsymbol{F_d}(\mathbf{Z}) \end{aligned} $$

Input Variables:

$$\mathbf{X} \in \mathbb{R}^{H\times W\times T\times V}$$

The $\mathbf{X}$ is a multi-dimensional array of rank 4 of size[lat x lon x time x variables].


Example Applications
  • Interpolation: Implicit/Coordinate-Based methods, e.g. GPs, NerFs
    • x=[lat,lon,time]
    • f=[ssh,sst]
  • Interpolation: Explicit/Coordinate-Based methods, e.g. CNN
    • f=u(lat x lon x time x var)
    • x=(lat,lon,time,mask)
  • Inverse Problems: Operator Methods, e.g. 4DVar
    • f=u_sim(lat x lon x time x vars)
    • y=u_obs(lat x lon x time x vars)
    • x=(lat,lon,time,mask)
  • Predictions Problems: Functional Methods, e.g. GPs, NerFs
    • f=[var1,var2,...]
    • c=[var1,var2,...]
    • x=[lat,lon,time]
  • Predictions Problems: Operator Methods, e.g. FNO, MNO
    • f=u(lat x lon x time x var)
    • g=a(lat x lon x time x var)
    • x=(lat,lon,time,mask)
@jejjohnson jejjohnson added the documentation Improvements or additions to documentation label Feb 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

1 participant