Meta’s Breakthrough Language Model on Par with GPT-4 and Bard in Performance One of the notable aspects of LIMA’s performance is its ability to generalise well to unseen tasks that were not part of its training data. By Mohit Pandey
Researchers for Meta AI , alongside Carnegie Mellon University, University of Southern California and Tel Aviv University, today unveiled LIMA, a 65 billion parameter LLaMa language model fine-tuned with the standard supervised loss on only 1,000 carefully curated prompts and responses, without any reinsurance learning or human preference modelling. Register >> Check out the research paper: LIMA: Less Is More for Alignment Meta’s AI chief Yann LeCun said that this is on par with GPT-4 and Bard in terms of performance. The researchers said that LIMA has shown strong capabilities in learning specific response formats with minimal training examples. They said that it can effectively handle complex queries, ranging from planning travel itineraries to speculating about alternate history. Interestingly, one of the notable aspects of this new language model’s performance is its ability to generalise well to unseen tasks that...