You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Last year antoni did a proof of concept on generating datasets which can be used to train LLMs.
The goal of this milestone is to take that idea and make it production ready.
After this milestone is complete.
We should have examples of creating LLM datasets from 2 different organizational datasources (e.g gitlab and confluence or gitlab and jira).
We should have examples of saving LLM datasets to 2 different dataset storage repositories (e.g huggingface dataset registry and persistent attached volume on k8s).
We should also be able to show that it is somewhat configurable to meet customer changing needs.