Timeline
24 February 2023
Llama Released
Facebook's release of Llama version one opened up opportunities for many of us to engage with Large Language Models.
Llama Fine tuning
Within CloudCoder, we effectively fine-tuned Llama using the Alpaca dataset.
23 March 2023
Rest of the 2023
Llama V2 & More
We achieved successful pre-training of Llama V2 using Bengali vocabulary and fine-tuned it for improved performance. Subsequently, we integrated a RAG (Retrieval-Augmented Generation) mechanism for our vector database.
