Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE REQUEST] somewhat unintuitive default forecasting model #94

Open
MBasalla opened this issue May 31, 2022 · 2 comments
Open

[FEATURE REQUEST] somewhat unintuitive default forecasting model #94

MBasalla opened this issue May 31, 2022 · 2 comments
Assignees

Comments

@MBasalla
Copy link

Is your feature request related to a problem? Please describe.
It is somewhat unintuitive, that the model returns a standard error in the univariate case and but not in the multivariate case (due to using a tree based forecast in the multivariate case).

Describe the solution you'd like
Ideally the default forecaster should return the same output "format" (forecast and standard error) independent of the input data.
This would likely require changing the default forecaster for the multivariate case (A probabilistic tree based method like for example ngboost [https://github.com/stanfordmlgroup/ngboost] might be worth investigating for this.)

Describe alternatives you've considered
Given that the "ideal" solution is quite complex a lower effort alternative would be to make this behavior more clear in the description and documentation of the default forecast model.

Additional context
I think having a default model as an entry point to the forecasting case is a good idea. But the difference in forecast outputs for univariate and multivariate case somewhat defeats this purpose. Intuitively one would probably assume, that the default model has the same features in both cases.

@aadyotb
Copy link
Contributor

aadyotb commented May 31, 2022

@MBasalla thanks for the suggestion. @Emerald01 can you look into enhancing the tree models with uncertainty estimates?

@Emerald01
Copy link
Collaborator

@MBasalla thank you for the suggestion. We used deterministic tree models for the multivariate forecaster, and we are considering to add some probabilistic-based tree models and others for the multivariate so we can have variance measure. It is worth mentioning that the standard error is not the default output for prediction in general because only probabilistic-based algorithms will naturally provide such measure. For deterministic forecaster, we return None for standard deviation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants