Is there a way to set variable lr for each row of an Embedding matrix?

Hello All,

We are trying to implement an adaptive learning rate for an item embedding model, so newer items get assigned a larger learning rate and vice versa. I wonder if there is a way to do so? I’m aware of the set_lr_mult method but that can only give different learning rates to different layers, not different rows within the same layer.
Any help is appreciated!