Microsoft introduces ‘LeMa’, a new approach to enhance AI problem solving

Microsoft’s ‘LeMa’ method mimics human learning from mistakes, enhancing AI reasoning. By having AI correct its own errors, it achieves outstanding results in math problem-solving, even surpassing specialized models.

Image of hand and indication about AI.

In collaboration with Peking University and Xi’an Jiaotong University, Microsoft Research Asia has unveiled an innovative AI learning method called ‘LeMa,’ which emulates the problem-solving processes of humans. LeMa is based on the idea of learning from errors, similar to how humans refine their skills. Researchers applied this concept to large language models (LLMs) to enhance their ability to solve mathematical problems. The procedure involves creating imperfect reasoning paths for math questions, having GPT-4 recognise mistakes, elucidate them, and present corrected reasoning paths, and then fine-tuning the original models using this corrected information.

LeMa consistently enhances the performance of various LLMs across mathematical reasoning tasks, surpassing existing standards. Even specialised LLMs like WizardMath and MetaMath reap benefits from LeMa, achieving notable accuracy on challenging datasets.

Why does this matter?

This advancement not only elevates AI reasoning capabilities but also signifies a transition toward AI systems that can learn and improve from their errors, akin to human learning. The open-source aspect of this research encourages further exploration, potentially leading to progress in machine learning. This development holds substantial implications, particularly in sectors like healthcare, finance, and autonomous vehicles, where error correction and continuous learning are pivotal, bringing AI closer to surpassing human abilities in intricate problem-solving tasks.