Elena' s AI Blog
  Browse by topic  · Browse by tag

LoRA fine-tuning wins


You no longer need to retrain entire language models. LoRA allows you to teach new capabilities via tiny adapters. Here is the architectural code, deployment cheat sheets, and production pitfalls. Read more...

TensorFlow: Transfer Learning (Fine-Tuning) in Image Classification


We used a 400 species birds dataset for building bird species predictive models based on EffeicientNetB0 from Keras. The baseline model showed already an excellent Accuracy=0.9845. However, data augmentation did not help in improving accuracy, which slightly lowered to 0.9690. Further, this model with a data augmentation layer was partially unfrozen, retrained with a lower learning rate, and reached an Accuracy=0.9850. Read more...