Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Is "Transformer Architecture Marchine Learning Model" supported on RubixML ??? #282

Open
chegmarco1989 opened this issue Apr 1, 2023 · 4 comments
Open

Is "Transformer Architecture Marchine Learning Model" supported on RubixML ??? #282

chegmarco1989 opened this issue Apr 1, 2023 · 4 comments
Labels
question Further information is requested

Comments

@chegmarco1989
Copy link

Hello (again).

ChatGPT is built on Transformer Architecture Machine Learning Model .

So, does RubixML support this Transformer Architecture algorithm to do something like an intelligence Question & Answer project like ChatGPT in PHP using RubixML ???

If so, how to access its tutorial ???

Thanks to answer.
@andrewdalpino
Copy link
Member

Hi @chegmarco1989, currently we just have feed-forward networks without attention implemented in Rubix ML.

@chegmarco1989
Copy link
Author

Ok. Thanks for your feedback

@andrewdalpino
Copy link
Member

andrewdalpino commented Apr 20, 2023 •
edited

You're welcome! If you're looking for a place to get started with Transformer networks, I highly recommend Andrey Karpathy's NanoGPT project as a place to get started. It uses PyTorch under the hood.

https://github.com/karpathy/nanoGPT

@chegmarco1989
Copy link
Author

Thanks

@chegmarco1989 chegmarco1989 changed the title Does "Transformer Architecture Marchine Learning Model" is supported on RubixML ??? Is "Transformer Architecture Marchine Learning Model" supported on RubixML ??? Apr 21, 2023
@andrewdalpino andrewdalpino added the question Further information is requested label May 27, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@andrewdalpino @chegmarco1989