From Token Probabilities to Semantic Constraints: Towards Declarative Probabilistic Evaluation of Language Models

arXiv:2609.13520v1 Announce Type: new Abstract: While Large Language Models have improved rapidly, many fundamental questions remain about how to evaluate the knowledge and reasoning abilities they acquire, and how...