Our interest in this paper is in optimisation problems that are intractable to solve by direct numerical optimisation, but nevertheless have significant amounts of relevant domain-specific knowledge. The category of heuristic search techniques known as estimation of distribution algorithms (EDAs) seek to incrementally sample from probability distributions in which optimal (or near-optimal) solutions have increasingly higher probabilities. Can we use domain knowledge to assist the estimation of these distributions? To answer this in the affirmative, we need: (a)a general-purpose technique for the incorporation of domain knowledge when constructing models for optimal values; and (b)a way of using these models to generate new data samples. Here we investigate a combination of the use of Inductive Logic Programming (ILP) for (a), and standard logic-programming machinery to generate new samples for (b). Specifically, on each iteration of distribution estimation, an ILP engine is used to construct a model for good solutions. The resulting theory is then used to guide the generation of new data instances, which are now restricted to those derivable using the ILP model in conjunction with the background knowledge). We demonstrate the approach on two optimisation problems (predicting optimal depth-of-win for the KRK endgame, and job-shop scheduling). Our results are promising: (a)On each iteration of distribution estimation, samples obtained with an ILP theory have a substantially greater proportion of good solutions than samples without a theory; and (b)On termination of distribution estimation, samples obtained with an ILP theory contain more near-optimal samples than samples without a theory. Taken together, these results suggest that the use of ILP-constructed theories could be a useful technique for incorporating complex domain-knowledge into estimation distribution procedures.
Transferable Direct Prompt Injection via Activation-Guided MCMC Sampling
School of Software Engineering, Huazhong University of Science and Technology(华中科技大学软件学院);School of Cyber Science and Engineering, Huazhong University of Science and Technology(华中科技大学网络安全学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);Faculty of Data Science, City University of Macau(澳门城市大学数据科学学院)
Diversifying Neural Text Generation with Part-of-Speech Guided Softmax and Sampling
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Center for Data Science, Peking University(北京大学数据科学中心);The MOE Key Laboratory of Computational Linguistics, Peking University(北京大学计算语言学教育部重点实验室)
Fast and Robust Likelihood-Guided Diffusion Posterior Sampling with Amortized Variational Inference
Institute of Foundation Models, MBZUAI(基础模型研究所,MBZUAI);Huawei Lagrange Mathematics and Computing Research Center, Paris, France(华为拉格朗日数学与计算研究中心,法国巴黎);Mohamed Bin Zayed University of AI, Chair of the ML Department, EPITA, Laboratoire Recherche de l'EPITA(穆罕默德·本·扎耶德人工智能大学,机器学习系主任,EPITA,EPITA研究实验室)
DiffSAC: Diffusion-guided Sampling for Consensus-based Robust Estimation
School of Automation and Intelligent Sensing, Shanghai Jiao Tong University(上海交通大学自动化与智能感知学院);Key Laboratory of System Control and Information Processing, Ministry of Education of China(教育部系统控制与信息处理重点实验室);Department of Engineering, Cambridge University(剑桥大学工程系)
Ten Words Only Still Help: Improving Black-Box AI-Generated Text Detection via Proxy-Guided Efficient Re-Sampling
Key Lab of Intelligent Information Processing of Chinese Academy of Sciences(中国科学院智能信息处理重点实验室);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Xi’an Jiaotong University(西安交通大学)
Latent Space Guided Scenario Sampling for Multimodal Segmentation Under Missing Modalities
organization= Department of Computer Engineering, Ankara University, Ankara, T \"u rkiye;organization= Department of Modeling;Simulation, Graduate School of Informatics, METU, Ankara, T \"u rkiye
Logical Specifications-guided Dynamic Task Sampling for Reinforcement Learning Agents
Tufts University(塔夫茨大学);University of Texas at Austin(德克萨斯大学奥斯汀分校);Georgia Tech Research Institute(佐治亚理工学院研究所);University of Colorado Boulder(科罗拉多大学博尔德分校)
GOOD: Training-Free Guided Diffusion Sampling for Out-of-Distribution Detection
Nanjing University(南京大学);Fudan University(复旦大学);Carnegie Mellon University(卡内基梅隆大学);Chinese Academy of Sciences(中国科学院);Nanyang Technological University(南洋理工大学)
UPCMR: A Universal Prompt-guided Model for Random Sampling Cardiac MRI Reconstruction
Leiden University Medical Center(莱顿大学医学中心);Cardiologs;Philips(飞利浦);Eindhoven University of Technology(埃因霍温理工大学);Philips Innovative Technologies(飞利浦创新技术)
Enhancing Adversarial Transferability by Balancing Exploration and Exploitation with Gradient-Guided Sampling
School of Computer Science & Software Engineering, Shenzhen University, China(深圳大学计算机科学与软件工程学院);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen, China(广东省人工智能与数字经济发展实验室(深圳));Guangdong Provincial Key Laboratory of Intelligent Information Processing, Shenzhen University, China(广东省智能信息处理省级重点实验室);School of Computer Science, University of Exeter, U.K.(埃克塞特大学计算机科学学院);Department of Computing and Information Technology, Great Bay University, China(大鹏大学计算与信息技术系);Computer Vision Institute, School of Artificial Intelligence, Shenzhen University, China(人工智能学院计算机视觉研究所)
Mitigating Tail Narrowing in LLM Self-Improvement via Socratic-Guided Sampling
School of Computer Science, Fudan University(复旦大学计算机科学学院);Meituan(美团);Institute of Modern Languages and Linguistics, Fudan University(复旦大学现代语言与语言学研究所);Key Laboratory of Intelligent Information Processing, Fudan University(复旦大学智能信息处理重点实验室);Macau University of Science and Technology(澳门科技大学)
Random Sampling for Diffusion-based Adversarial Purification
Northwestern Polytechnical University(西北工业大学);The Hong Kong Polytechnic University(香港理工大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));The Hong Kong University of Science and Technology(香港科技大学)
F$^3$low: Frame-to-Frame Coarse-grained Molecular Dynamics with SE(3) Guided Flow Matching
Mila - Québec AI Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学);Microsoft Research AI4Science(微软研究院AI4科学部门);Xi’an Jiaotong University(西安交通大学);Shanghai Jiao Tong University School of Medicine(上海交通大学医学院);HEC Montréal(蒙特利尔高等商学院);Canadian Institute for Advanced Research (CIFAR)(加拿大高级研究院)