This paper is devoted to the study of vector valued reproducing kernel Hilbert spaces. We focus on two aspects: vector valued feature maps and universal kernels. In particular we characterize the structure of translation invariant kernels on abelian groups and we relate it to the universality problem.
This paper is devoted to the study of vector valued reproducing kernel Hilbert spaces. We focus on reproducing kernels in vector-valued reproducing kernel Hilbert spaces. In particular we extend reproducing kernels to relative reproducing kernels and prove some theorems in this subject.
This paper studies the construction of a refinement kernel for a given operator-valued reproducing kernel such that the vector-valued reproducing kernel Hilbert space of the refinement kernel contains that of the given one as a subspace. The study is motivated from the need of updating the current operator-valued reproducing kernel in multi-task learning when underfitting or overfitting occurs. Numerical simulations confirm that the established refinement kernel method is able to meet this need. Various characterizations are provided based on feature maps and vector-valued integral representat…
Targeting at sparse multi-task learning, we consider regularization models with an $\ell^1$ penalty on the coefficients of kernel functions. In order to provide a kernel method for this model, we construct a class of vector-valued reproducing kernel Banach spaces with the $\ell^1$ norm. The notion of multi-task admissible kernels is proposed so that the constructed spaces could have desirable properties including the crucial linear representer theorem. Such kernels are related to bounded Lebesgue constants of a kernel interpolation question. We study the Lebesgue constant of multi-task kernels…
Motivated by multi-task machine learning with Banach spaces, we propose the notion of vector-valued reproducing kernel Banach spaces (RKBS). Basic properties of the spaces and the associated reproducing kernels are investigated. We also present feature map constructions and several concrete examples of vector-valued RKBS. The theory is then applied to multi-task machine learning. Especially, the representer theorem and characterization equations for the minimizer of regularized learning schemes in vector-valued RKBS are established.
Motivated by the need of processing functional-valued data, or more general, operatorvalued data, we introduce the notion of the operator reproducing kernel Hilbert space (ORKHS). This space admits a unique operator reproducing kernel which reproduces a family of continuous linear operators on the space. The theory of ORKHSs and the associated operator reproducing kernels are established. A special class of ORKHSs, known as the perfect ORKHSs, are studied, which reproduce the family of the standard point-evaluation operators and at the same time another different family of continuous linear op…
We give necessary and sufficient conditions under which the reproducing kernel of a Pontryagin space of $d \times 1$ vector polynomials is determined by a generalized Nevanlinna pair of $d \times d$ matrix polynomials.
The aim of this paper is to present a unified framework in the setting of Hilbert $C^*$-modules for the scalar- and vector-valued reproducing kernel Hilbert spaces and $C^*$-valued reproducing kernel spaces. We investigate conditionally negative definite kernels with values in the $C^*$-algebra of adjointable operators acting on a Hilbert $C^*$-module. In addition, we show that there exists a two-sided connection between positive definite kernels and reproducing kernel Hilbert $C^*$-modules. Furthermore, we explore some conditions under which a function is in the reproducing kernel module and …
Motivated by the theory of weighted shifts on directed trees and its multivariable counterpart, we address the question of identifying commutant and reflexivity of the multiplication $d$-tuple $\mathscr M_z$ on a reproducing kernel Hilbert space $\mathscr H$ of $E$-valued holomorphic functions on $Ω$, where $E$ is a separable Hilbert space and $Ω$ is a bounded domain in $\mathbb C^d$ admitting bounded approximation by polynomials. In case $E$ is a finite dimensional cyclic subspace for $\mathscr M_z$, under some natural conditions on the $B(E)$-valued kernel associated with $\mathscr H$, the c…
We present a characterization for a positive definite operator valued kernel to be universal or $C_{0}$-universal, and apply these characterizations to a family of operator valued kernels that are shown to be well behaved. Later, we obtain a characterization for an operator valued differentiable kernel to be $C^{q}$-universal and $C_{0}^{q}$-universal. In order to obtain such characterization and examples we generalize some well known results concerning the structure of differentiable kernels to the operator valued context. On the examples is given an emphasis on the radial kernels on Euclidea…
Banach Spaces Generated by Finite-Valued Functions: Superreflexive Rigidity, Hankel Operators, and Universality
Konstantin Preslavsky University of Shumen(舒门康斯坦丁·普拉斯夫斯基大学);University of Plovdiv Paisii Hilendarski(普罗夫迪夫帕伊西·希伦达斯基大学);Technical University of Varna(瓦尔纳技术大学)
Complementing earlier results on dynamics of unilateral weighted shifts, we obtain a sufficient (but not necessary, with supporting examples) condition for hypercyclicity, mixing and chaos for $M_z^*$, the adjoint of $M_z$, on vector-valued analytic reproducing kernel Hilbert spaces $\mathcal{H}$ in terms of the derivatives of kernel functions on the open unit disc $\mathbb{D}$ in $\mathbb{C}$. Here $M_z$ denotes the multiplication operator by the coordinate function $z$, that is \[ (M_z f) (w) = w f(w), \] for all $f \in \mathcal{H}$ and $w \in \mathbb{D}$. We analyze the special case of quas…
This paper considers universal Hilbert space operators in the sense of Rota, and gives criteria for universality of semigroups in the context of uniformly continuous semigroups and contraction semigroups. Specific examples are given. Universal semigroups provide models for these classes of semigroups: following a line of research initiated by Shimorin, models for concave semigroups are developed, in terms of shifts on reproducing kernel Hilbert spaces.
A contraction $T$ on a Hilbert space $\mathcal{H}$ is said to be pure if the sequence $\lbrace T^{*n} \rbrace_{n}$ converges to $0$ in the strong operator topology. In this article, we prove that for contractions $T$, which commute with certain tractable tuples of commuting operators $X = (X_1,\ldots,X_n)$ on $\mathcal{H}$, the following statements are equivalent: (i) $T$ is a pure contraction on $\mathcal{H}$, (ii) the compression $P_{\mathcal{W}(X)}T|_{\mathcal{W}(X)}$ is a pure contraction, where $\mathcal{W}(X)$ is the wandering subspace corresponding to the tuple $X$. An operator-valued m…
We extend the classical Mercer theorem to reproducing kernel Hilbert spaces whose elements are functions from a measurable space $X$into $\mathbb C^n$. Given a finite measure $μ$ on $X$, we represent the reproducing kernel $K$ as convergent series in terms of the eigenfunctions of a suitable compact operator depending on $K$ and $μ$. Our result holds under the mild assumption that $K$ is measurable and the associated Hilbert space is separable. Furthermore, we show that $X$ has a natural second countable topology with respect to which the eigenfunctions are continuous and the series representi…
This paper concerns a commutant lifting theorem and a Nevanlinna-Pick type interpolation result in the setting of multipliers from vector-valued Drury-Arveson space to a large class of vector-valued reproducing kernel Hilbert spaces over the unit ball in $\mathbb{C}^n$. The special case of reproducing kernel Hilbert spaces includes all natural examples of Hilbert spaces like Hardy space, Bergman space and weighted Bergman spaces over the unit ball.
A Schur-class function in $d$ variables is defined to be an analytic contractive-operator valued function on the unit polydisk. Such a function is said to be in the Schur--Agler class if it is contractive when evaluated on any commutative $d$-tuple of strict contractions on a Hilbert space. It is known that the Schur--Agler class is a strictly proper subclass of the Schur class if the number of variables $d$ is more than two. The Schur--Agler class is also characterized as those functions arising as the transfer function of a certain type (Givone--Roesser) of conservative multidimensional line…
The main purpose of this paper is providing a systematic study and classification of non-scalar kernels for Reproducing Kernel Hilbert Spaces (RKHS), to be used in the analysis of deformation in shape spaces endowed with metrics induced by the action of groups of diffeomorphisms. After providing an introduction to matrix-valued kernels and their relevant differential properties, we explore extensively those, that we call TRI kernels, that induce a metric on the corresponding Hilbert spaces of vector fields that is both translation- and rotation-invariant. These are analyzed in an effective man…
The techniques developed by Popescu, Muhly-Solel and Good for the study of algebras generated by weighted shifts are applied to generalize results of Sarkar and of Bhattacharjee-Eschmeier-Keshari-Sarkar concerning dilations and invariant subspaces for commuting tuples of operators. In that paper the authors prove Beurling-Lax-Halmos type results for commuting tuples $T=(T_1,\ldots,T_d)$ operators that are contractive and pure; that is $Φ_T(I)\leq I$ and $Φ_T^n(I)\searrow 0$ where $$Φ_T(a)=Σ_i T_iaT_i^*.$$ Here we generalize some of their results to commuting tuples $T$ satisfying similar condi…
We consider positive semidefinite kernels valued in the $*$-algebra of adjointable operators on a VE-space (Vector Euclidean space) and that are invariant under actions of $*$-semigroups. A rather general dilation theorem is stated and proved: for these kind of kernels, representations of the $*$-semigroup on either the VE-spaces of linearisation of the kernels or on their reproducing kernel VE-spaces are obtainable. We point out the reproducing kernel fabric of dilation theory and we show that the general theorem unifies many dilation results at the non topological level.
This note finds a new characterization of complete Nevanlinna-Pick kernels on the Euclidean unit ball. The classical theory of Sz.-Nagy and Foias about the characteristic function is extended in this note to a commuting tuple $\bfT$ of bounded operators satisfying the natural positivity condition of $1/k$-contractivity for an irreducible unitarily invariant complete Nevanlinna-Pick kernel. The characteristic function is a multiplier from $H_k \otimes \cE$ to $H_k \otimes \cF$, {\em factoring} a certain positive operator, for suitable Hilbert spaces $\cE$ and $\cF$ depending on $\bfT$. There is…
In this work we treat realization results for operator-valued functions which are analytic in the complex sense or slice hyperholomorphic over the quaternions. In the complex setting, we prove a realization theorem for an operator-valued function analytic in a neighborhood of the origin with a coisometric state space operator thus generalizing an analogous result in the unitary case. A main difference with previous works is the use of reproducing kernel Krein spaces. We then prove the counterpart of this result in the quaternionic setting. The present work is the first paper which presents a r…
We describe those reproducing kernel Hilbert spaces of holomorphic functions on domains in ${\Bbb C}^d$ for which an analogue of the Nevanlinna-Pick theorem holds, in other words when the existence of a (possibly matrix-valued) function in the unit ball of the multiplier algebra with specified values on a finite set of points is equivalent to the positvity of a related matrix. Our description is in terms of a certain localization property of the kernel.
Featured Reproducing Kernel Banach Spaces for Learning and Neural Networks
Dept. of Computer Science and Artificial Intelligence, Andalusian Institute on Data Science and Computational Intelligence (DaSCI), University of Granada(计算机科学与人工智能系,数据科学与计算智能安达卢西亚研究所,格拉纳达大学);ADIA Lab, Abu Dhabi, United Arab Emirates(阿布扎比分实验室,阿联酋);Dpto. de Análisis Matemático, Facultad de Ciencias, Universidad de Granada(数学系,科学学院,格拉纳达大学)
In this paper we are discussing various aspects of wavelet filters. While there are earlier studies of these filters as matrix valued functions in wavelets, in signal processing, and in systems, we here expand the framework. Motivated by applications, and by bringing to bear tools from reproducing kernel theory, we point out the role of non-positive definite Hermitian inner products (negative squares), for example Krein spaces, in the study of stability questions. We focus on the non-rational case, and establish new connections with the theory of generalized Schur functions and their associate…
Learning Operators by Regularized Stochastic Gradient Descent with Operator-valued Kernels
School of Mathematical Sciences, Fudan University(复旦大学数学科学学院);Fudan University(复旦大学);Shanghai Key Laboratory for Contemporary Applied Mathematics, Fudan University(复旦大学当代应用数学重点实验室)