Meta Large Language Model Compiler

ai.meta.com

‎Abstract‎ Large Language Models (LLMs) have demonstrated remarkable capabilities across a variety of software engineering and coding tasks. However, their application in the domain of code and compiler optimization remains underexplored. Training LLMs is resource-intensive, requiring substantial GPU hours and … Read more

Large language model data pipelines and Common Crawl

blog.christianperone.com

Erik Desmazieres’s “La Bibliothèque de Babel”. 1997. We have been training language models (LMs) for years, but finding valuable resources about the data pipelines commonly used to build the datasets for training these models is paradoxically challenging. It may be … Read more

Large Language Models Are Neurosymbolic Reasoners

arxiv.org
large-language-models-are-neurosymbolic-reasoners

Abstract:A wide range of real-world applications is characterized by their symbolic nature, necessitating a strong capability for symbolic reasoning. This paper investigates the potential application of Large Language Models (LLMs) as symbolic reasoners. We focus on text-based games, significant benchmarks … Read more

Large Language Models for Compiler Optimization

arxiv.org
large-language-models-for-compiler-optimization

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. … Read more