Skip to content

Latest commit

 

History

History
9 lines (7 loc) · 333 Bytes

File metadata and controls

9 lines (7 loc) · 333 Bytes

MathAssertGPT notes

Overfitting

When training reaches 5_000_000 steps, then new_statement_percentage falls to 30%.

This may not necessarily be bad. You would need to provide a temperature setting to see if a higher temperature increases the new_statement_percentage while maintaining syntactically correct metamath statements.