The authors provide code and show in their paper a manner of enabling online-lora to finetune pre-trained Vision Transformers (ViT)s in real time, thereby addressing the issues with reherasl buffers. They use dynamic loss values to ensure automatic recognition of data distribution shipfts and a novel online weight regularization strategy for combining different model parameters.
