LLM-and-Law

This repository is dedicated to summarizing papers related to large language models with the field of law

Applications of Large Language Models in Legal Tasks

[1] Legal Prompt Engineering for Multilingual Legal Judgement Prediction

[2] Can GPT-3 Perform Statutory Reasoning?

[3] Legal Prompting: Teaching a Language Model to Think Like a Lawyer

[4] Large Language Models as Fiduciaries: A Case Study Toward Robustly Communicating With Artificial Intelligence Through Legal Standards

[5] ChatGPT Goes to Law School

[6] ChatGPT, Professor of Law

[7] ChatGPT & Generative AI Systems as Quasi-Expert Legal Advice Lawyers - Case Study Considering Potential Appeal Against Conviction of Tom Hayes

[8] ‘Words Are Flowing Out Like Endless Rain Into a Paper Cup’: ChatGPT & Law School Assessments

[9] ChatGPT by OpenAI: The End of Litigation Lawyers?

[10] Law Informs Code: A Legal Informatics Approach to Aligning Artificial Intelligence with Humans

[11] ChatGPT may Pass the Bar Exam soon, but has a Long Way to Go for the LexGLUE benchmark paper

[12] How Ready are Pre-trained Abstractive Models and LLMs for Legal Case Judgement Summarization? paper

[13] Explaining Legal Concepts with Augmented Large Language Models (GPT-4) paper

[14] Garbage in, garbage out: Zero-shot detection of crime using Large Language Models paper

[15] Legal Summarisation through LLMs: The PRODIGIT Project paper

[16] Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Task paper

[17] PolicyGPT: Automated Analysis of Privacy Policies with Large Language Models

[18] Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise paper

[19] Precedent-Enhanced Legal Judgment Prediction with LLM and Domain-Model Collaboration paper

[20] From Text to Structure: Using Large Language Models to Support the Development of Legal Expert Systems paper

[21] Boosting legal case retrieval by query content selection with large language models paper

[22] LLMediator: GPT-4 Assisted Online Dispute Resolution paper

[23] Employing Label Models on ChatGPT Answers Improves Legal Text Entailment Performance paper

[24] LLaMandement: Large Language Models for Summarization of French Legislative Proposals paper

[25] Logic Rules as Explanations for Legal Case Retrieval paper Our new paper, welcome to pay attention !!!

[26] Enhancing Legal Document Retrieval: A Multi-Phase Approach with Large Language Models paper

[27] BLADE: Enhancing Black-box Large Language Models with Small Domain-Specific Models paper

[28] A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Law paper

[29] Archimedes-AUEB at SemEval-2024 Task 5: LLM explains Civil Procedure paper

[30] More Than Catastrophic Forgetting: Integrating General Capabilities For Domain-Specific LLMs paper

[31] Legal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model paper

[32] Knowledge-Infused Legal Wisdom: Navigating LLM Consultation through the Lens of Diagnostics and Positive-Unlabeled Reinforcement Learning paper

[33] GOLDCOIN: Grounding Large Language Models in Privacy Laws via Contextual Integrity Theory paper

[34] Enabling Discriminative Reasoning in Large Language Models for Legal Judgment Prediction paper

[35] Large Language Models for Judicial Entity Extraction: A Comparative Study paper

[36] Applicability of Large Language Models and Generative Models for Legal Case Judgement Summarization paper

[37] LawLLM: Law Large Language Model for the US Legal System paper

[38] Legal syllogism prompting: Teaching large language models for legal judgment prediction paper

[39] Optimizing Numerical Estimation and Operational Efficiency in the Legal Domain through Large Language Models paper

[40] Hallucination-Free? Assessing the Reliability of Leading AI Legal Research Tools paper

[41] KRAG Framework for Enhancing LLMs in the Legal Domain paper

[42] Legal Evalutions and Challenges of Large Language Models paper

[43] Analyzing Images of Legal Documents: Toward Multi-Modal LLMs for Access to Justice (https://arxiv.org/pdf/2412.15260)

Legal Agent

[1] SimuCourt: Building Judicial Decision-Making Agents with Real-world Judgement Documents paper

[2] Can Large Language Models Grasp Legal Theories? Enhance Legal Reasoning with Insights from Multi-Agent Collaboration paper

Legal Problems of Large Language Models

[1] Towards WinoQueer: Developing a Benchmark for Anti-Queer Bias in Large Language Models

[2] Persistent Anti-Muslim Bias in Large Language Models

[3] Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models

[4] The Dark Side of ChatGPT: Legal and Ethical Challenges from Stochastic Parrots and Hallucination

[5] The GPTJudge: Justice in a Generative AI World paper

[6] Is the U.S. Legal System Ready for AI's Challenges to Human Values? paper

[7] Questioning Biases in Case Judgment Summaries: Legal Datasets or Large Language Models? paper

[8] Large Legal Fictions: Profiling Legal Hallucinations in Large Language Models

[9] A Legal Framework for Natural Language Processing Model Training in Portugal paper

[10] LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domain paper

[11] Bias in Large Language Models: Origin, Evaluation, and Mitigation paper

[12] An Information Theoretic Approach to Operationalize Right to Data Protection paper

[13] Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench paper

Data Resources for Large Language Models in Law

[1] CAIL2018: A Large-Scale Legal Dataset for Judgment Prediction

[2] When does pretraining help? assessing self-supervised learning for law and the casehold dataset of 53,000+ legal holdings

[3] LeCaRD: a legal case retrieval dataset for Chinese law system

[4] LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development

[5] Legal Extractive Summarization of U.S. Court Opinions

[6] Awesome Chinese Legal Resources github

[7] MultiLegalPile: A 689GB Multilingual Legal Corpus paper

[8] The Cambridge Law Corpus: A Corpus for Legal AI Research

[9] TransformLLM: Adapting Large Language Models via LLM-Transformed Reading Comprehension Text paper

[10] Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challenges paper

[11] ChineseSafe: A Chinese Benchmark for Evaluating Safety in Large Language Models paper

[12] Augmenting Legal Decision Support Systems with LLM-based NLI for Analyzing Social Media Evidence paper

Law LLMs

[1] LawGPT_zh github

[2] LaWGPT github

[3] Lawyer LLaMA github

[4] LexiLaw github

[5] LexGPT 0.1: pre-trained GPT-J models with Pile of Law paper

[6] TOWARDS THE EXPLOITATION OF LLM-BASED CHATBOT FOR PROVIDING LEGAL SUPPORT TO PALESTINIAN COOPERATIVES paper

[7] ChatLaw: Open-Source Legal Large Language Model with Integrated External Knowledge Bases paper

[8] DISC-LawLLM github

[9] InternLM-Law: An Open Source Chinese Legal Large Language Model paper

[10] SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain paper

Evaluation:

[1] Measuring Massive Multitask Chinese Understanding paper

[2] LawBench: Benchmarking Legal Knowledge of Large Language Models github

[3] Large Language Models are legal but they are not: Making the case for a powerful LegalLLM paper

[4] Better Call GPT, Comparing Large Language Models Against Lawyers paper

[5] Evaluating GPT-3.5's Awareness and Summarization Abilities for European Constitutional Texts with Shared Topics paper

[6] Evaluation Ethics of LLMs in Legal Domain paper

[7] GPTs and Language Barrier: A Cross-Lingual Legal QA Examination paper

[8] LawBench: Benchmarking Legal Knowledge of Large Language Models paper

[9] LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models paper

The survey paper is shown in paper

Acknowledgement

Please cite the following papers as the references if you use our codes or the processed datasets.

@article{sun2023short,
  title={A short survey of viewing large language models in legal aspect},
  author={Sun, Zhongxiang},
  journal={arXiv preprint arXiv:2303.09136},
  year={2023}
}