Several studies claim that large language models have passed the Turing Test and hence can "think", yet none follow Turing's original instructions precisely. Passing the test holds significance as evidence that a machine demonstrates human-like intelligence, and as a marker for artificial-general intelligence in commercial and legal domains. We conducted Turing's three-player imitation game with an LLM by following the guidelines identified by Turing and applying scientific standards wherever detailed instructions were missing. We performed a computer-imitates-human game without duration constraints and a man-imitates-woman game as a benchmark. In the computer-imitates-human game, only one participant misidentified the large language model, indicating that claims of large language models' passing the Turing test are premature. Participants required over five minutes for both tasks, with the man-imitates-woman game taking longer; shorter time limits elsewhere may explain earlier positive results. We expect the Turing Test to remain central in assessing machine intelligence for years to come.
SciIF: Benchmarking Scientific Instruction Following Towards Rigorous Scientific Intelligence
Shanghai AI Laboratory(上海人工智能实验室);University of Science and Technology of China(中国科学技术大学);Shanghai Jiao Tong University(上海交通大学);The Chinese University of Hong Kong(香港中文大学);University of Sydney(悉尼大学);Fudan University(复旦大学);Tsinghua University(清华大学);Beihang University(北航大学)
The complexities of patient-centred conversational artificial intelligence
Verily Health(Verily健康公司);University of Oxford(牛津大学);University of Birmingham(伯明翰大学);University Hospitals Birmingham NHS Foundation Trust(伯明翰大学医院NHS基金会信托);Harvard Medical School(哈佛医学院);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心)
History of generative Artificial Intelligence (AI) chatbots: past, present, and future development
University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校);Asian University of Bangladesh(亚洲孟加拉大学);Sonargaon University(索纳尔冈大学);Babes-Bolyai University(巴比什-博雅依大学);Islamic University(伊斯兰大学);University of Chittagong(吉大港大学)