-
Notifications
You must be signed in to change notification settings - Fork 813
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add KAN (Kolmogorov-Arnold Network) to Darts #2379
Comments
Hi @PapadopoulosDimitrios, this could indeed be a great addition to Darts. I'll put it in our backlog. However, I'm not sure about adding I think we need to investigate a bit more. Maybe we could re-implement only the relevant parts for Darts 🤔 Is this something you'd be willing to contribute to? |
Tried replacing nn.Linear with KANLinear from here https://github.com/Blealtan/efficient-kan in the TSMixer and it works quite well. The speed of iterations is slower (clock wise) as expected but fits much quicker per iteration (metrics wise) and I get a much higher overfit suggesting that they are considerably more expressive. It didn't improve my results due to overfitting but I believe it will vary from dataset to dataset Note: had to fix this Blealtan/efficient-kan#36 to make it work but thats a one line change. |
@dennisbader Unfortunately, I won't be able to contribute due to time constraints. FYI there's also an sklearn-style implementation ok KAN in: https://github.com/csinva/imodelsX/blob/master/imodelsx/kan/kan_sklearn.py The general RegressionModel wrapper could be used here. |
There is TKAN implementation base on tensorflow: |
another paper: https://arxiv.org/html/2405.08790v1 |
There has been a recent boom of positive comments on the KAN (Kolmogorov-Arnold Network) model. Are you thinking about incorporating it? Repo: https://github.com/KindXiaoming/pykan
The text was updated successfully, but these errors were encountered: