This paper presents the outputs of the exploratory phase of a global audit of Large Language Models (LLMs) project. In this exploratory phase, I used the Global AI Dataset (GAID) Project as a framework to stress-test the Llama-3 8B model and evaluate geographic and socioeconomic biases in technical AI governance awareness. By stress-testing the model with 1,704 queries across 213 countries and eight technical metrics, I identified a significant digital barrier and gap separating the Global North and South. The results indicate that the model was only able to provide number/fact responses in 11.4% of its query answers, where the empirical validity of such responses was yet to be verified. The findings reveal that AI's technical knowledge is heavily concentrated in higher-income regions, while lower-income countries from the Global South are subject to disproportionate systemic information gaps. This disparity between the Global North and South poses concerning risks for global AI safety and inclusive governance, as policymakers in underserved regions may lack reliable data-driven insights or be misled by hallucinated facts. This paper concludes that current AI alignment and training processes reinforce existing geoeconomic and geopolitical asymmetries, and urges the need for more inclusive data representation to ensure AI serves as a truly global resource.
Institute for Future Initiatives, The University of Tokyo(东京大学未来创成机构);Deloitte Touche Tohmatsu LLC(德勤日本有限责任公司);Toyo University(东洋大学);CDLE, AI Legal (NEC)(日本电气股份有限公司AI法律中心CDLE);IRCA (International Register of Certified Auditors)(国际注册审计师登记处)
A Methodology for Auditable Trustworthiness Levels in AI Lifecycle Governance
Institute of Biomedical Ethics and History of Medicine, University of Zürich(生物医学伦理与医学史研究所,苏黎世大学);SUPSI, Dalle Molle Institute for Artificial Intelligence (IDSIA)(SUPSI人工智能研究所);ETH Zürich(苏黎世联邦理工学院)
A Framework for Responsible AI Systems: Building Societal Trust through Domain Definition, Trustworthy AI Design, Auditability, Accountability, and Governance
Deparment of Computer Science and Artificial Intelligence and Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI), University of Granada(计算机科学与人工智能系和安达卢西亚数据科学与计算智能研究所(DaSCI),格拉纳达大学);TECNALIA (BRTA)(TECNALIA(BRTA));University of the Basque Country (UPV/EHU)(巴斯克大学(UPV/EHU));School of Engineering, Cornell University(工程学院,康奈尔大学);ADIA Lab(ADIA实验室);Computational Research Department, Lawrence Berkeley National Laboratory(计算研究部,劳伦斯伯克利国家实验室);Intelligent Systems for Robotics and Automation Laboratory, Macau University of Science and Technology(机器人与自动化智能系统实验室,澳门科学技术大学)
Operational AI Deployment Assurance: Governance-State Orchestration Under Threshold-Sensitive Deployment Conditions -- A Governance Framework for High-Stakes AI Systems
Ducaltus | AI Assurance \& Governance Newcastle upon Tyne, United Kingdom School of Computing, Engineering \& Digital Technologies Teesside University Middlesbrough, United Kingdom
Compliant But Unsatisfactory: The Gap Between Auditing Standards and Practices for Probabilistic Genotyping Software
University of California, Berkeley(加州大学伯克利分校);Wright State University(莱特州立大学);Forensic Bioinformatic Services, Inc.(法医生物信息学服务公司);ELLIS Institute(ELLIS研究所);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
Roadmap on Incentive Compatibility for AI Alignment and Governance in Sociotechnical Systems
Institute for Artificial Intelligence, Peking University(人工智能研究院,北京大学);State Key Laboratory of General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,BIGAI);Shanghai Jiao Tong University(上海交通大学);Zhongguancun Academy(中关村学院)
Auditing large language models: a three-layered approach
University of Oxford(牛津大学);Princeton University(普林斯顿大学);Centre for the Governance of AI(人工智能治理中心);Goethe University Frankfurt(法兰克福歌德大学);University of Bologna(博洛尼亚大学)
A Technical Policy Blueprint for Trustworthy Decentralized AI
MLCommons;Sage Bionetworks;Google(谷歌);Inria(法国国家计算机科学研究所);Intel(英特尔);Flower;Apheris;University of Notre Dame(圣母大学);NVIDIA(英伟达);Factored;Florida International University(佛罗里达国际大学)