Introduction
Welcome to the home of the Litig AI Benchmark Initiative documentation site. This is a living site for us to share documentation, best practices, resources and tools to help the legal industry on its journey to adopting AI.
What is the Litig AI Benchmark Initiative?
Litig’s purpose is to drive innovation, best practice, education, knowledge sharing, and collaboration for the good of our member organisations and the legal industry as a whole. You can find out more about Litig on the main website.
With the pace of change in AI in mind, the key objective of the Litig AI Benchmark Initiative is to create an ‘AI Benchmark’ as an open-source, standardised framework to help evaluate, improve trust and drive sustainable adoption of AI tools used in legal contexts.
We have brought together a wide and diverse community, including law firms, legal tech suppliers of all sizes, regulators, universities, and others, to drive this forward. From this community, we have a core working group who have been helping develop materials and agree on a strategy.
Given the challenges of agreeing metric-based benchmarks, the initiative has focused first on setting a common understanding and then developing an approach to transparency across the legal industry that will benefit everyone. We have now published the materials below and we are considering where we might go next – and we welcome everyone’s thoughts and feedback on that.
Meet the team made up of experts from across the industry behind the working group.
Make sense of the technical jargon with our helpful glossary.
Explore and commit to the foundational principles and transparency requirements essential for evaluating AI systems used in legal contexts.
Set out standardised information about a legal AI product, including the underlying AI models used, its intended use, performance, limitations, how testing has been conducted and ethical considerations
Consider these flexible approaches to help legal teams and technology providers define and communicate GenAI use cases — from simple, high-level models to more detailed formats suitable for business case.
Find out more information about other Benchmarks, Evaluations, Due Diligence questions and AI Regulation.
Join our LinkedIn Group
To stay up to date with the progress of the group, join our LinkedIn group here.