Evaluation of Large Language Models in Legal Applications: Challenges, Methods, and Future Directions
评估大型语言模型在法律应用中的表现:挑战、方法与未来方向
Yiran Hu, Huanghai Liu, Chong Wang, Kunran Li, Tien-Hsuan Wu, Haitao Li, Xinran Xu, Siqing Huo, Weihang Su, Ning Zheng, Siyuan Zheng, Qingyao Ai, Yun Liu, Renjun Bian, Yiqun Liu, Charles L. A. Clarke, Weixing Shen, Ben Kao
机构
*
Tsinghua University(清华大学)
;
The University of Hong Kong(香港大学)
;
University of Waterloo(多伦多大学)
;
Shanghai Jiaotong University(上海交通大学)
;
Peking University(北京大学)
Opportunities in AI/ML for the Rubin LSST Dark Energy Science Collaboration
人工智能/机器学习在Rubin LSST暗能量科学合作中的机遇
LSST Dark Energy Science Collaboration, Eric Aubourg, Camille Avestruz, Matthew R. Becker, Biswajit Biswas, Rahul Biswas, Boris Bolliet, Adam S. Bolton, Clecio R. Bom, Raphaël Bonnet-Guerrini, Alexandre Boucaud, Jean-Eric Campagne, Chihway Chang, Aleksandra Ćiprijanović, Johann Cohen-Tanugi, Michael W. Coughlin, John Franklin Crenshaw, Juan C. Cuevas-Tello, Juan de Vicente, Seth W. Digel, Steven Dillmann, Mariano Javier de León Dominguez Romero, Alex Drlica-Wagner, Sydney Erickson, Alexander T. Gagliano, Christos Georgiou, Aritra Ghosh, Matthew Grayling, Kirill A. Grishin, Alan Heavens, Lindsay R. House, Mustapha Ishak, Wassim Kabalan, Arun Kannawadi, François Lanusse, C. Danielle Leonard, Pierre-François Léget, Michelle Lochner, Yao-Yuan Mao, Peter Melchior, Grant Merz, Martin Millon, Anais Möller, Gautham Narayan, Yuuki Omori, Hiranya Peiris, Laurence Perreault-Levasseur, Andrés A. Plazas Malagón, Nesar Ramachandra, Benjamin Remy, Cécile Roucelle, Jaime Ruiz-Zapatero, Stefan Schuldt, Ignacio Sevilla-Noarbe, Ved G. Shah, Tjitske Starkenburg, Stephen Thorp, Laura Toribio San Cipriano, Tilman Tröster, Roberto Trotta, Padma Venkatraman, Amanda Wasserman, Tim White, Justine Zeghal, Tianqing Zhang, Yuanyuan Zhang
机构
*
Université Paris Cité, CNRS, CEA, Astroparticule et Cosmologie, F-75013 Paris, France
;
Department of Physics, University of Michigan, Ann Arbor, MI 48109, USA
;
Leinweber Institute of Theoretical Physics, University of Michigan, Ann Arbor, MI 48109, USA
;
Argonne National Laboratory, 9700 South Cass Avenue, Lemont, IL 60439, USA
;
Cavendish Astrophysics, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK
;
Kavli Institute for Cosmology, University of Cambridge, Madingley Road, Cambridge CB3 0HA, UK
;
SLAC National Accelerator Laboratory, Menlo Park, CA 94025, USA
;
Department of Computer Science, University of Milan, Milan, Italy
;
Université Paris Cité, CNRS, Astroparticule et Cosmologie, F-75013 Paris, France
;
Université Paris-Saclay, CNRS/IN2P3, IJCLab, 91405 Orsay, France
;
Department of Astronomy
;
Astrophysics, University of Chicago, Chicago, IL 60637, USA
;
Kavli Institute for Cosmological Physics, University of Chicago, Chicago, IL 60637, USA
;
NSF-Simons AI Institute for the Sky (SkAI), 172 E. Chestnut St., Chicago, IL 60611, USA
;
Fermi National Accelerator Laboratory, P.O. Box 500, Batavia, IL 60510, USA
;
Universit\'e Clermont-Auvergne, CNRS, LPCA, 63000 Clermont-Ferrand, France
;
Kavli Institute for Particle Astrophysics
;
Cosmology, Stanford University, Stanford, CA 94305, USA
;
Department of Physics, Stanford University, 382 Via Pueblo Mall, Stanford, CA 94305, USA
;
Engineering Faculty, Universidad Autonoma de San Luis Potosi, Zona Universitaria, San Luis Potosi, 78290, Mexico
;
Stanford Artificial Intelligence Laboratory, Stanford University, Stanford, CA 94305, USA
;
Kavli Institute of Cosmological Physics, University of Chicago, Chicago, IL 60637, USA
;
The NSF AI Institute for Artificial Intelligence
;
Center for Astrophysics Harvard \& Smithsonian, 60 Garden Street, Cambridge, MA 02138, USA
;
Department of Physics
;
Kavli Institute for Astrophysics
;
Space Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
;
Institut de Física d'Altes Energies (IFAE), The Barcelona Institute of Science
;
Institute of Astronomy
;
Kavli Institute for Cosmology, University of Cambridge, Madingley Road, Cambridge, CB3 0HA, UK
;
Imperial Centre for Inference
;
Cosmology (ICIC), Imperial College London, Blackett Laboratory, Prince Consort Road, London SW7 2AZ, UK
;
Data Science Institute, The University of Chicago, Chicago, IL 60615, USA
;
Department of Physics, The University of Texas at Dallas, Richardson, TX 75080, USA
;
Department of Physics, Duke University, Durham, NC 27708, USA
;
Université Paris-Saclay, Université Paris Cité, CEA, CNRS, AIM, F-91191 Gif-sur-Yvette, France
;
School of Mathematics, Statistics
;
Physics, Newcastle University, Newcastle upon Tyne, NE1 7RU, United Kingdom
;
Department of Astrophysical Sciences, Princeton University, Princeton, NJ 08544, USA
;
Astronomy, University of the Western Cape, Bellville, Cape Town, 7535, South Africa
;
Astronomy, University of Utah, Salt Lake City, UT 84112, USA
;
Department of Astrophysical Sciences, Princeton University, Peyton Hall, Princeton, NJ 08544, USA
;
Department of Astronomy, University of Illinois Urbana Champaign, 1002 W. Green St., Urbana, IL, 61801, USA
;
Institute for Particle Physics
;
Astrophysics, ETH Zürich, Wolfgang-Pauli-Strasse 27, CH-8093 Zurich, Switzerland
;
Swinburne University of Technology, Hawthorn, Victoria 3122, Australia
;
Ciela - Montr\'eal Institute for Astrophysical Data Analysis
;
Mila - Quebec Artificial Intelligence Institute, Montréal, QC H2S 3H1, Canada
;
Advanced Research Computing Centre, University College London, 90 High Holborn, London WC1V 6LJ, UK
;
Finnish Centre for Astronomy with ESO (FINCA), University of Turku, FI-20014 Turku, Finland
;
Department of Physics, P.O. Box 64, University of Helsinki, FI-00014 Helsinki, Finland
;
Astronomy, Northwestern University, Evanston, IL, USA
;
Center for Interdisciplinary Exploration
;
Research in Astrophysics, Northwestern University, Evanston, IL, USA
;
Scientific Data Science, International School for Advanced Study, Via Bonomea 265, I-34136 Trieste, Italy
;
Department of Statistics, University of Michigan, Ann Arbor, MI 48109, USA
;
PITT PACC, University of Pittsburgh, Pittsburgh, PA 15260, USA
;
NSF NOIRLab, 950 N. Cherry Ave., Tucson, AZ 85719, USA
Comments84 pages. This is v1.0 of the DESC's white paper on AI/ML, a collaboration document that is being made public but which is not planned for submission to a journal
Measuring and Aligning Abstraction in Vision-Language Models with Medical Taxonomies
利用医学分类法测量和对齐视觉-语言模型中的抽象能力
Ben Schaper, Maxime Di Folco, Bernhard Kainz, Julia A. Schnabel, Cosmin I. Bercea
机构
*
1 School of Computation, Information
;
Technology, Technical University of Munich, Germany 2 Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich, Germany 3 LTCI, Télécom Paris, Institut Polytechnique de Paris, France 4 Munich Center for Machine Learning (MCML) 5 School of Biomedical Engineering
;
Imaging Sciences, King's College London, UK 6 Department of Artificial Intelligence in Biomedical Imaging, FAU Erlangen-Nuremberg, Germany 7 Department of Computing, Imperial College London, UK
CommentsThis is the author's version of the work. The definitive version is published in: Proceedings of the 48th European Conference on Information Retrieval (ECIR '26), March 29-April 2, 2026, Delft, The Netherlands