Skip to content

LAMB missing in str2optimizer32bit? #1118

@Xynonners

Description

@Xynonners

System Info

Python 3.11 venv, Arch Linux

Reproduction

import torch
import bitsandbytes as bnb

a = [torch.rand(1), torch.rand(1)]
opt = bnb.optim.LAMB8bit(a)
a[0].grad = torch.rand(1)
opt.step()

venv/lib/python3.11/site-packages/bitsandbytes/functional.py", line 1211, in optimizer_update_32bit
optim_func = str2optimizer32bit[optimizer_name][0]
~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^
KeyError: 'lamb'

Expected behavior

it steps the optimizer?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions