计算法和网络安全的危险:工程和AI法案的视角
The Dangers of Computational Law and Cybersecurity; Perspectives from Engineering and the AI Act
摘要:
计算法已经开始在社会中发挥作用,这已经预测了一段时间。自动化决策和协助用户的系统现在已在不同的司法管辖区使用,但随着这种成熟,也带来了某些警告。计算法则存在于使其成为可能的平台上,在这种情况下是数字系统,这意味着它继承了相同的缺陷。网络安全解决了这些潜在的弱点。在本文中,我们通过已知的问题,并讨论他们在各个层面,从设计到物理领域。我们还研究了机器学习特定的对抗性问题。此外,我们对计算法以及现有和未来的立法进行了某些考虑。最后,我们提出了三个建议,这是必要的计算法的功能,全球性的,并遵循安全和安全工程的想法。如前所述,我们发现,计算法必须认真考虑,它不仅面临着与其他类型的软件和计算机系统相同的风险,而且它内部的故障可能会造成财务或物理损失,以及不公正。计算法律系统失败的后果比仅仅是软件和硬件更严重。如果系统采用机器学习,它必须注意到这带来的非常具体的危险,其中数据投毒是一个典型的例子。计算法也必须明确立法,我们表明目前欧盟的情况并非如此,这也适用于与之相关的网络安全方面。但欧盟拟议的人工智能法案有很大的希望,它为将计算法带来的具体问题纳入法律领域做出了重要尝试。我们对计算法和网络安全的建议是:适应威胁,充分使用,人类仍然是部署的中心。
英文摘要:
Computational Law has begun taking the role in society which has been predicted for some time. Automated decision-making and systems which assist users are now used in various jurisdictions, but with this maturity come certain caveats. Computational Law exists on the platforms which enable it, in this case digital systems, which means that it inherits the same flaws. Cybersecurity addresses these potential weaknesses. In this paper we go through known issues and discuss them in the various levels, from design to the physical realm. We also look at machine-learning specific adversarial problems. Additionally, we make certain considerations regarding computational law and existing and future legislation. Finally, we present three recommendations which are necessary for computational law to function globally, and which follow ideas in safety and security engineering. As indicated, we find that computational law must seriously consider that not only does it face the same risks as other types of software and computer systems, but that failures within it may cause financial or physical damage, as well as injustice. Consequences of Computational Legal systems failing are greater than if they were merely software and hardware. If the system employs machine-learning, it must take note of the very specific dangers which this brings, of which data poisoning is the classic example. Computational law must also be explicitly legislated for, which we show is not the case currently in the EU, and this is also true for the cybersecurity aspects that will be relevant to it. But there is great hope in EU's proposed AI Act, which makes an important attempt at taking the specific problems which Computational Law bring into the legal sphere. Our recommendations for Computational Law and Cybersecurity are: Accommodation of threats, adequate use, and that humans remain in the centre of their deployment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。