Traditional high-quality 3D scanning and reconstruction typically relies on human labor to plan the scanning procedure. With the rapid development of embodied systems such as drones and robots, there is a growing demand of performing accurate 3D scanning and reconstruction in an fully automated manner. We introduce Auto3R, a data-driven uncertainty quantification model that is designed to automate the 3D scanning and reconstruction of scenes and objects, including objects with non-lambertian and specular materials. Specifically, in a process of iterative 3D reconstruction and scanning, Auto3R can make efficient and accurate prediction of uncertainty distribution over potential scanning viewpoints, without knowing the ground truth geometry and appearance. Through extensive experiments, Auto3R achieves superior performance that outperforms the state-of-the-art methods by a large margin. We also deploy Auto3R on a robot arm equipped with a camera and demonstrate that Auto3R can be used to effectively digitize real-world 3D objects and delivers ready-to-use and photorealistic digital assets. Our homepage: https://tomatoma00.github.io/auto3r.github.io .
Integrated Laser Scanning and Image-Based Topology Optimization Techniques for Detection and Quantification of Visible and Subsurface Structural Defects
Point-level Uncertainty Evaluation of Mobile Laser Scanning Point Clouds
Chair of Engineering Geodesy, TUM School of Engineering(工程大地测量学教授职位,技术大学慕尼黑工程与设计学院);TUM Leonhard Obermeyer Center(技术大学慕尼黑Leonhard Obermeyer中心);CV4DT, University of Cambridge(Cambridge大学CV4DT)
Automated Erythrocyte Detection and Tracking for Retinal Blood Flow Quantification in Erythrocyte-Mediated Angiography
Department of Bioengineering, University of Maryland, College Park, MD 20742, USA(生物工程系,马里兰大学,学院公园,MD 20742,美国);Department of Ophthalmology and Visual Sciences, University of Maryland School of Medicine, Baltimore, MD 21201, USA(眼科学与视觉科学系,马里兰大学医学院,巴尔的摩,MD 21201,美国);Department of Electrical and Computer Engineering, University of Maryland, College Park, MD 20742, USA(电气与计算机工程系,马里兰大学,学院公园,MD 20742,美国)
Counting Molecules: Python based scheme for automated enumeration and categorization of molecules in scanning tunneling microscopy images
Institute of Physics of the Czech Academy of Sciences, v.v.i.(捷克科学院物理研究所);Regional Centre of Advanced Technologies and Materials, Palacký University(帕拉茨基大学先进技术与材料区域中心);RWTH Aachen University(亚琛工业大学)
The Hatching-Box: A Novel System for Automated Monitoring and Quantification of Drosophila melanogaster Developmental Behavior
Institute of Geoinformatics(地理信息研究所);University of Münster(穆尔斯特大学);Faculty of Mathematics & Computer Science(数学与计算机科学学院);Institute of Neuro- and Behavioral Biology(神经生物学与行为生物学研究所)
Validation of Smartphone-Based Photogrammetric 3D Body Scanning for Automated Anthropometric Measurements Compared with a Commercial Depth-Sensor-Based Body Scanner
The George Washington University(乔治·华盛顿大学);The University of Hong Kong(香港大学)
Automated high-frequency quantification of fish communities and biomass using computer vision
Graduate School of Life Sciences, Tohoku University(东北大学生命科学研究生院);Advanced Institute for Marine Ecosystem Change (WPI-AIMEC), Tohoku University(东北大学海洋生态系统变化先进研究所);Graduate School of Science and Engineering, University of the Ryukyus(冲绳大学理学研究院);Faculty of Science, University of the Ryukyus(冲绳大学理学部)
OREHAS: A fully automated deep-learning pipeline for volumetric endolymphatic hydrops quantification in MRI
Bioengineering Department, Universidad Carlos III de Madrid(卡洛斯三世大学生物工程系);Radiology Department, Clínica Universidad de Navarra(纳瓦拉大学医院放射科);Otorhinolaryngology Department, Clínica Universidad de Navarra(纳瓦拉大学医院耳鼻喉科)
ACCELERATION: Sequentially-scanning DECT Imaging Using High Temporal Resolution Image Reconstruction And Temporal Extrapolation
Research Center for Medical Artificial Intelligence, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院医学人工智能研究中心);University of Chinese Academy of Sciences(中国科学院大学)
A novel approach for the automated segmentation and volume quantification of cardiac fats on computed tomography
Universidade Federal Fluminense (UFF)(弗鲁米嫩塞联邦大学);Universidade Federal do Rio de Janeiro (UFRJ)(里约热内卢联邦大学);Universidade Federal do Espírito Santo (UFES)(圣埃斯皮里图联邦大学)
En masse scanning and automated surfacing of small objects using Micro-CT
University of Minnesota(明尼苏达大学);School of Mathematics, University of Minnesota(明尼苏达大学数学学院);Department of Anthropology, University of Minnesota(明尼苏达大学人类学系)
Sequential-Scanning Dual-Energy CT Imaging Using High Temporal Resolution Image Reconstruction and Error-Compensated Material Basis Image Generation
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Southeast University(东南大学);United Imaging Healthcare Company Ltd.(联影医疗科技股份有限公司)
SpineReport: Automated 3D Quantification and Reporting of Lumbar Spine Degeneration on MRI
NeuroPoly, Institute of Biomedical Engineering, Polytechnique Montreal(NeuroPoly,生物医学工程研究所,蒙特利尔大学);Mila, Quebec AI Institute, Montreal(Mila,魁北克人工智能研究所,蒙特利尔);Department of Radiology, Balgrist University Hospital, Zurich(放射科,巴尔格里斯大学医院,苏黎世);Faculty of Medicine, University of Zurich(医学学院,苏黎世大学);Department of Neurosurgery, Brain & Spine, University of South Florida(神经外科,脑与脊柱,佛罗里达大学);Center for Neuromusculoskeletal Research, University of South Florida(神经肌肉研究中心,佛罗里达大学);Department of Medical Engineering, University of South Florida(医学工程系,佛罗里达大学);Stanford School of Medicine, Stanford(斯坦福医学院,斯坦福);Functional Neuroimaging Unit, CRIUGM, Université de Montréal(功能神经影像单元,CRIUGM,蒙特利尔大学);Centre de recherche du CHU Sainte-Justine, Université de Montréal(圣若泽中心研究,蒙特利尔大学)
Glo-UMF: A Unified Multi-model Framework for Automated Morphometry of Glomerular Ultrastructural Characterization
School of Biomedical Engineering(生物医学工程学院);Southern Medical University(南方医科大学);Guangdong Provincial Key Laboratory of Medical Image Processing(广东省医学影像处理重点实验室);Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology(广东省医学影像与诊断技术工程实验室);Department of Pathology, School of Basic Medical Sciences(基础医学学院病理学系);Guangzhou Huayin Medical Laboratory Center(广州华英医学实验室中心);Central Laboratory(中心实验室);Department of Nephrology(肾内科)
Automated Labeling of Intracranial Arteries with Uncertainty Quantification Using Deep Learning
Dept. of Molecular Medicine and Surgery, Karolinska Institutet(卡罗林斯卡研究所分子医学与外科部);Biomedical Imaging Center, Pontificia Universidad Católica de Chile(智利天主教大学生物医学成像中心);Department of Electrical Engineering, School of Engineering, Pontificia Universidad Católica de Chile(智利天主教大学工程学院电气工程系);Millennium Institute for Intelligent Healthcare Engineering (iHEALTH), Santiago, Chile(智利智能健康工程研究院(iHEALTH));Department of Medical Physics, Institute of Physics, University of Greifswald(格里夫斯瓦尔德大学物理研究所医学物理系);Department of Radiology, Northwestern University(西北大学放射科);Department of Neurological Surgery, Northwestern University(西北大学神经外科部);Department of Neurology, Northwestern University(西北大学神经科)
Deep Learning-Based Automated Quantification of TIMI Myocardial Perfusion Frame Count (DL-TMPFC) from Coronary Angiography: A Novel Framework for Rapid Assessment of Microvascular Dysfunction
School of Artificial Intelligence and Digital Economy Industry, Guangzhou Institute of Science and Technology(人工智能与数字经济发展学院,广州科学研究院);Department of Cardiology, Second Affiliated Hospital, Jiangxi Medical College, Nanchang University(南华大学江西医学院心内科,第二附属医院);Department of Cardiology, First Affiliated Hospital of Zhejiang University School of Medicine(浙江大学医学院附属第一医院心内科);Department of Cardiology, National University Heart Centre(国立大学心脏中心心内科)
Automated HER2 scoring with uncertainty quantification using lensfree holography and deep learning
Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA(加州大学洛杉矶分校电气与计算机工程系);Bioengineering Department, University of California, Los Angeles, CA, 90095, USA(加州大学洛杉矶分校生物工程系);California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA(加州大学洛杉矶分校加州纳米系统研究所);Department of Computer Science, University of California, Los Angeles, CA, 90095, USA(加州大学洛杉矶分校计算机科学系)
An Interactive, Automated 4D-STEM data acquisition and analysis routine for Scanning Electron Nanobeam Diffraction and Ptychography experiments
electron Physical Science Imaging Centre, Diamond Light Source(电子物理科学成像中心,钻石光源);Department of Materials, University of Oxford(牛津大学材料系);Johnson Matthey(庄信万丰)
Automated SSIM Regression for Detection and Quantification of Motion Artefacts in Brain MR Images
University Hospital Magdeburg(马格德堡大学医院);Otto von Guericke University(奥托·冯·格里克大学);Human Technopole(人类技术中心);University of L’Aquila(拉奎拉大学);Center for Behavioral Brain Sciences(行为脑科学中心);German Center for Neurodegenerative Disease(德国神经退行性疾病中心)
Automated detection and quantification of COVID-19 airspace disease on chest radiographs: A novel approach achieving radiologist-level performance using a CNN trained on digital reconstructed radiographs (DRRs) from CT-based ground-truth
Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院);Siemens Healthineers(西门子医疗)
Automated Quality Controlled Analysis of 2D Phase Contrast Cardiovascular Magnetic Resonance Imaging
King's College London(伦敦国王学院);Duke University(杜克大学);Technical University Munich(慕尼黑工业大学);Helmholtz Center Munich(慕尼黑亥姆霍兹中心);Guy's and St Thomas' NHS Foundation Trust(盖伊和圣托马斯国民保健服务基金会信托)
Deep learning vessel segmentation and quantification of the foveal avascular zone using commercial and prototype OCT-A platforms
Simon Fraser University(西蒙菲莎大学);University of British Columbia(不列颠哥伦比亚大学);University of Western Australia(西澳大学);Lions Eye Institute(狮子眼科研究所);Vitreous Retina Macula Consultants of New York(纽约玻璃体视网膜黄斑 Consultants);Manhattan Eye, Ear and Throat Hospital(曼哈顿眼耳鼻喉医院);University of Zagreb(萨格勒布大学)
The MYOSAIQ Challenge: Myocardial Segmentation with Automated Infarct Quantification
INSA-Lyon, Universite Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1294(里昂国立应用科学学院、里昂第一大学克洛德·贝尔纳大学、圣艾蒂安大学、法国国家科学研究中心、法国国家健康与医学研究院、CREATIS联合研究机构);Institut Universitaire de France (IUF)(法兰西大学研究院);University of Sherbrooke(谢布鲁克大学);Huazhong University of Science and Technology(华中科技大学);Sunnybrook Research Institute, University of Toronto(多伦多大学桑尼布鲁克研究所);Imperial College London(伦敦帝国理工学院);University College London(伦敦大学学院);Fudan University(复旦大学);Medical University of Graz(格拉茨医科大学);Graz University of Technology(格拉茨技术大学);Universidad de Zaragoza(萨拉戈萨大学);Instituto de Investigación Sanitaria de Aragón (IIS Aragón)(阿拉贡卫生研究所);Centre Hospitalier Annecy Genevois(阿讷西日内瓦中心医院);Hôpital Universitaire Cardiologique Louis Pradel(路易·普拉德尔大学心脏病医院)
Automated quantification of myocardial tissue characteristics from native T1 mapping using neural networks with Bayesian inference for uncertainty-based quality-control
King’s College London(伦敦国王学院);Guy’s and St Thomas’ NHS Foundation Trust(盖伊和圣托马斯国民保健服务基金会信托);ETH Zürich(苏黎世联邦理工学院);Imperial College London(伦敦帝国理工学院)
Automated Quantification of CT Patterns Associated with COVID-19 from Chest CT
Hôpital Foch(福煦医院);Donald and Barbara Zucker School of Medicine(唐纳德和芭芭拉·祖克医学院);Feinstein Institutes for Medical Research(范斯坦医学研究所);Northwell Health(诺斯韦尔健康中心);Siemens Healthineers(西门子医疗);University Hospital Basel(巴塞尔大学医院);Clinic of Radiology & Nuclear medicine(放射与核医学科);Vancouver General Hospital(温哥华总医院)
Deep learning automated quantification of lung disease in pulmonary hypertension on CT pulmonary angiography: A preliminary clinical study with external validation
University of Sheffield(谢菲尔德大学);Sheffield Teaching Hospitals NHS Foundation Trust(谢菲尔德教学医院NHS基金会信托);INSIGNEO, Institute for In Silico Medicine, University of Sheffield(谢菲尔德大学INSIGNEO计算医学研究所);NIHR Sheffield Biomedical Research Centre, University of Sheffield(谢菲尔德大学NIHR谢菲尔德生物医学研究中心)
A Large-Language-Model Assisted Automated Scale Bar Detection and Extraction Framework for Scanning Electron Microscopic Images
Shanghai Jiao Tong Global College(上海交通大学全球学院);Shanghai Jiao Tong University(上海交通大学);Global Institute of Future Technology(全球未来技术研究院);AI Lab, Xiaomi Corporation(小米公司AI实验室)
ScarNet: A Novel Foundation Model for Automated Myocardial Scar Quantification from LGE in Cardiac MRI
Northwestern University(西北大学);Feinberg School of Medicine(费林伯格医学院);University of Miami Miller School of Medicine(迈阿密大学米勒医学院);Cedars-Sinai Medical Center(西达赛奈医疗中心)
Calibrating Ensembles for Scalable Uncertainty Quantification in Deep Learning-based Medical Segmentation
University of Cambridge(剑桥大学);Cancer Research UK Cambridge Centre(英国癌症研究中心剑桥中心);Cancer Research UK Cambridge Institute(英国癌症研究中心剑桥研究所);Danube Private University(多瑙河私立大学);KTH Royal Institute of Technology(KTH皇家理工学院)