A geometric method to analyze nonlinear oscillations is discussed. We consider a nonlinear oscillation modeled by a second order ordinary differential equation without specifying the function form. By transforming the differential equation into the system of first order ordinary differential equations, the trajectory is embedded in $R^3$ as a curve, and thereby the time evolution of the original state can be translated into the behavior of the curve in $R^3$, or the vector field along the curve. We analyze the vector field to investigate the dynamic properties of a nonlinear oscillation. While the function form of the model is unspecified, the vector fields and those associated quantities can be estimated by a nonparametric filtering method. We apply the proposed analysis to the time series of the Japanese stock price index. The application shows that the vector field and its derivative will be used as the tools of picking up various signals that help understanding of the dynamic properties of the stock price index.
We utilize a recently developed genetic algorithm, in conjunction with discrete wavelets, for carrying out successful forecasts of the trend in financial time series, that includes the NASDAQ composite index. Discrete wavelets isolate the local, small scale variations in these non-stationary time series, after which the genetic algorithm's predictions are found to be quite accurate. The power law behavior in Fourier domain reveals an underlying self-affine dynamical behavior, well captured by the algorithm, in the form of an analytic equation. Remarkably, the same equation captures the trend o…
An analysis of the stylized facts in financial time series is carried out. We find that, instead of the heavy tails in asset return distributions, the slow decay behaviour in autocorrelation functions of absolute returns is actually directly related to the degree of clustering of large fluctuations within the financial time series. We also introduce an index to quantitatively measure the clustering behaviour of fluctuations in these time series and show that big losses in financial markets usually lump more severely than big gains. We further give examples to demonstrate that comparing to conv…
We investigate the local fractal properties of the financial time series based on the evolution of the Warsaw Stock Exchange Index (WIG) connected with the largest developing financial market in Europe. Calculating the local Hurst exponent for the WIG time series we find an interesting dependence between the behavior of the local fractal properties of the WIG time series and the crashes appearance on the financial market.
A clustering procedure, based on the Hausdorff distance, is introduced and tested on the financial time series of the Dow Jones Industrial Average (DJIA) index.
This paper investigates the phenomenon of support and resistance levels (SR levels) in financial time series, which act as temporary price barriers that reverses price trends. We develop a heuristic discovery algorithm for this purpose, to discover and evaluate SR levels for intraday price series. Our simple approach discovers SR levels which are able to reverse price trends statistically significantly. Asset price entering SR levels with higher number of price bounces before are more likely to bounce on such SR levels again. We also show that the decay aspect of the discovered SR levels as de…
The relation between time series irreversibility and entropy production has been recently investigated in thermodynamic systems operating away from equilibrium. In this work we explore this concept in the context of financial time series. We make use of visibility algorithms to quantify in graph-theoretical terms time irreversibility of 35 financial indices evolving over the period 1998-2012. We show that this metric is complementary to standard measures based on volatility and exploit it to both classify periods of financial stress and to rank companies accordingly. We then validate this appr…
Here we present a novel approach to statistical analysis of financial time series. The approach is based on $n$-grams frequency dictionaries derived from the quantized market data. Such dictionaries are studied by evaluating their information capacity using relative entropy. A specific quantization of (originally continuous) financial data is considered: so called binary quantization. Possible applications of the proposed technique include market event study with the $n$-grams of higher information value. The finite length of the input data presents certain computational and theoretical challe…
In this paper we propose an Ising model which simulates multiple financial time series. Our model introduces the interaction which couples to spins of other systems. Simulations from our model show that time series exhibit the volatility clustering that is often observed in the real financial markets. Furthermore we also find non-zero cross correlations between the volatilities from our model. Thus our model can simulate stock markets where volatilities of stocks are mutually correlated.
We discuss the origin of multiscaling in financial time-series and investigate how to best quantify it. Our methodology consists in separating the different sources of measured multifractality by analysing the multi/uni-scaling behaviour of synthetic time-series with known properties. We use the results from the synthetic time-series to interpret the measure of multifractality of real log-returns time-series. The main finding is that the aggregation horizon of the returns can introduce a strong bias effect on the measure of multifractality. This effect can become especially important when retu…
Precise financial series predicting has long been a difficult problem because of unstableness and many noises within the series. Although Traditional time series models like ARIMA and GARCH have been researched and proved to be effective in predicting, their performances are still far from satisfying. Machine Learning, as an emerging research field in recent years, has brought about many incredible improvements in tasks such as regressing and classifying, and it's also promising to exploit the methodology in financial time series predicting. In this paper, the predicting precision of financial…
In Financial Signal Processing, multiple time series such as financial indicators, stock prices and exchange rates are strongly coupled due to their dependence on the latent state of the market and therefore they are required to be jointly analysed. We focus on learning the relationships among financial time series by modelling them through a multi-output Gaussian process (MOGP) with expressive covariance functions. Learning these market dependencies among financial series is crucial for the imputation and prediction of financial observations. The proposed model is validated experimentally on …
The speculation game is an agent-based toy model to investigate the dynamics of the financial market. Our model has achieved the reproduction of 10 of the well-known stylized facts for financial time series. However, there is also a divergence from the behavior of real market. The market price of the model tends to be anti-persistent to the initial price, resulting in the quite small value of Hurst exponent of price change. To overcome this problem, we extend the speculation game by introducing a perturbative part to the price change with the consideration of other effects besides pure specula…
Order patterns and permutation entropy have become useful tools for studying biomedical, geophysical or climate time series. Here we study day-to-day market data, and Brownian motion which is a good model for their order patterns. A crucial point is that for small lags (1 up to 6 days), pattern frequencies in financial data remain essentially constant. The two most important order parameters of a time series are turning rate and up-down balance. For change points in EEG brain data, turning rate is excellent while for financial data, up-down balance seems the best. The fit of Brownian motion wi…
Concept drift detectors allow learning systems to maintain good accuracy on non-stationary data streams. Financial time series are an instance of non-stationary data streams whose concept drifts (market phases) are so important to affect investment decisions worldwide. This paper studies how concept drift detectors behave when applied to financial time series. General results are: a) concept drift detectors usually improve the runtime over continuous learning, b) their computational cost is usually a fraction of the learning and prediction steps of even basic learners, c) it is important to st…
Prices of commodities or assets produce what is called time-series. Different kinds of financial time-series have been recorded and studied for decades. Nowadays, all transactions on a financial market are recorded, leading to a huge amount of data available, either for free in the Internet or commercially. Financial time-series analysis is of great interest to practitioners as well as to theoreticians, for making inferences and predictions. Furthermore, the stochastic uncertainties inherent in financial time-series and the theory needed to deal with them make the subject especially interestin…
Financial time series have been investigated to follow fat-tailed distributions. Further, an empirical probability distribution sometimes shows cut-off shapes on its tails. To describe this stylized fact, we incorporate the cut-off effect in superstatistics. Then we confirm that the presented stochastic model is capable of describing the statistical properties of real financial time series. In addition, we present an option pricing formula with respect to superstatistics.
In this paper we use wavelet concepts to show that correlation coefficient between two financial data's is not constant but varies with scale from high correlation value to strongly anti-correlation value This studies is important because correlation coefficient is used to quantify degree of independence between two variables. In econophysics correlation coefficient forms important input to evolve hierarchial tree and minimum spanning tree of financial data.
Financial markets are prominent examples for highly non-stationary systems. Sample averaged observables such as variances and correlation coefficients strongly depend on the time window in which they are evaluated. This implies severe limitations for approaches in the spirit of standard equilibrium statistical mechanics and thermodynamics. Nevertheless, we show that there are similar generic features which we uncover in the empirical return distributions for whole markets. We explain our findings by setting up a random matrix model.
Permutation approach is suggested as a method to investigate financial time series in micro scales. The method is used to see how high frequency trading in recent years has affected the micro patterns which may be seen in financial time series. Tick to tick exchange rates are considered as examples. It is seen that variety of patterns evolve through time; and that the scale over which the target markets have no dominant patterns, have decreased steadily over time with the emergence of higher frequency trading.
This article studies the financial time series data processing for machine learning. It introduces the most frequent scaling methods, then compares the resulting stationarity and preservation of useful information for trend forecasting. It proposes an empirical test based on the capability to learn simple data relationship with simple models. It also speaks about the data split method specific to time series, avoiding unwanted overfitting and proposes various labelling for classification and regression.
Properties of low-variability periods in the time series are analysed. The theoretical approach is used to show the relationship between the multi-scaling of low-variability periods and multi-affinity of the time series. It is shown that this technically simple method is capable of reveling more details about time-series than the traditional multi-affine analysis. We have applied this scaling analysis to financial time series: a number of daily currency and stock index time series. The results show a good scaling behaviour for different model parameters. The analysis of high-frequency USD-EUR …
Multifractal analysis is one of the important approaches that enables us to measure the complexity of various data via the scaling properties. We compare the most common techniques used for multifractal exponents estimation from both theoretical and practical point of view. Particularly, we discuss the methods based on estimation of Rényi entropy, which provide a powerful tool especially in presence of heavy-tailed data. To put some flesh on bare bones, all methods are compared on various real financial datasets, including daily and high-frequency data.
In this research the technology of complex Markov chains is applied to predict financial time series. The main distinction of complex or high-order Markov Chains and simple first-order ones is the existing of aftereffect or memory. The technology proposes prediction with the hierarchy of time discretization intervals and splicing procedure for the prediction results at the different frequency levels to the single prediction output time series. The hierarchy of time discretizations gives a possibility to use fractal properties of the given time series to make prediction on the different frequen…
In this work we present a data-driven end-to-end Deep Learning approach for time series prediction, applied to financial time series. A Deep Learning scheme is derived to predict the temporal trends of stocks and ETFs in NYSE or NASDAQ. Our approach is based on a neural network (NN) that is applied to raw financial data inputs, and is trained to predict the temporal trends of stocks and ETFs. In order to handle commission-based trading, we derive an investment strategy that utilizes the probabilistic outputs of the NN, and optimizes the average return. The proposed scheme is shown to provide s…
Researchers have used from 30 days to several years of daily returns as source data for clustering financial time series based on their correlations. This paper sets up a statistical framework to study the validity of such practices. We first show that clustering correlated random variables from their observed values is statistically consistent. Then, we also give a first empirical answer to the much debated question: How long should the time series be? If too short, the clusters found can be spurious; if too long, dynamics can be smoothed out.
We extend existing models in the financial literature by introducing a cluster-derived canonical vine (CDCV) copula model for capturing high dimensional dependence between financial time series. This model utilises a simplified market-sector vine copula framework similar to those introduced by Heinen and Valdesogo (2008) and Brechmann and Czado (2013), which can be applied by conditioning asset time series on a market-sector hierarchy of indexes. While this has been shown by the aforementioned authors to control the excessive parameterisation of vine copulas in high dimensions, their models ha…
We develop a framework especially suited to the autocorrelation properties observed in financial times series, by borrowing from the physical picture of turbulence. The success of our approach as applied to high frequency foreign exchange data is demonstrated by the overlap of the curves in Figure (1), since we are able to provide an analytical derivation of the relative sizes of the quantities depicted. These quantities include departures from Gaussian probability density functions and various two and three-point autocorrelation functions.
We conduct an empirical study using the quantile-based correlation function to uncover the temporal dependencies in financial time series. The study uses intraday data for the S\&P 500 stocks from the New York Stock Exchange. After establishing an empirical overview we compare the quantile-based correlation function to stochastic processes from the GARCH family and find striking differences. This motivates us to propose the quantile-based correlation function as a powerful tool to assess the agreements between stochastic processes and empirical data.
Financial time-series analysis and forecasting have been extensively studied over the past decades, yet still remain as a very challenging research topic. Since the financial market is inherently noisy and stochastic, a majority of financial time-series of interests are non-stationary, and often obtained from different modalities. This property presents great challenges and can significantly affect the performance of the subsequent analysis/forecasting steps. Recently, the Temporal Attention augmented Bilinear Layer (TABL) has shown great performances in tackling financial forecasting problems…
We perform wavelet decomposition of high frequency financial time series into large and small time scale components. Taking the FTSE100 index as a case study, and working with the Haar basis, it turns out that the small scale component defined by most ($\simeq$ 99.6%) of the wavelet coefficients can be neglected for the purpose of option premium evaluation. The relevance of the hugely compressed information provided by low-pass wavelet-filtering is related to the fact that the non-gaussian statistical structure of the original financial time series is essentially preserved for expiration times…
We propose a simple stochastic volatility model which is analytically tractable, very easy to simulate and which captures some relevant stylized facts of financial assets, including scaling properties. In particular, the model displays a crossover in the log-return distribution from power-law tails (small time) to a Gaussian behavior (large time), slow decay in the volatility autocorrelation and multiscaling of moments. Despite its few parameters, the model is able to fit several key features of the time series of financial indexes, such as the Dow Jones Industrial Average, with a remarkable a…
We introduce two types of ordinal pattern dependence between time series. Positive (resp. negative) ordinal pattern dependence can be seen as a non-paramatric and in particular non-linear counterpart to positive (resp. negative) correlation. We show in an explorative study that both types of this dependence show up in real world financial data.
This research shows that under certain mathematical conditions, a threshold autoregressive model (TAR) can represent the leverage effect based on its conditional variance function. Furthermore, the analytical expressions for the third and fourth moment of the TAR model are obtained when it is weakly stationary.
Columbia University（哥伦比亚大学）；Zurich University of Applied Sciences（苏黎世应用科学大学）
Financial time series simulation is a central topic since it extends the limited real data for training and evaluation of trading strategies. It is also challenging because of the complex statistical properties of the real financial data. We introduce two generative adversarial networks (GANs), which utilize the convolutional networks with attention and the transformers, for financial time series simulation. The GANs learn the statistical properties in a data-driven manner and the attention mechanism helps to replicate the long-range dependencies. The proposed GANs are tested on the S&P 500 in…
Samsung Research Samsung Electronics Co., Ltd.（三星电子有限公司三星研究院）
Extracting previously unknown patterns and information in time series is central to many real-world applications. In this study, we introduce a novel approach to modeling financial time series using a deep learning model. We use a Long Short-Term Memory (LSTM) network equipped with the trainable initial hidden states. By learning to reconstruct time series, the proposed model can represent high-dimensional time series data with its parameters. An experiment with the Korean stock market data showed that the model was able to capture the relative similarity between a large number of stock prices…
We present the method of complementary ensemble empirical mode decomposition (CEEMD) and Hilbert-Huang transform (HHT) for analyzing nonstationary financial time series. This noise-assisted approach decomposes any time series into a number of intrinsic mode functions, along with the corresponding instantaneous amplitudes and instantaneous frequencies. Different combinations of modes allow us to reconstruct the time series using components of different timescales. We then apply Hilbert spectral analysis to define and compute the associated instantaneous energy-frequency spectrum to illustrate t…
We report evidence of a deep interplay between cross-correlations hierarchical properties and multifractality of New York Stock Exchange daily stock returns. The degree of multifractality displayed by different stocks is found to be positively correlated to their depth in the hierarchy of cross-correlations. We propose a dynamical model that reproduces this observation along with an array of other empirical properties. The structure of this model is such that the hierarchical structure of heterogeneous risks plays a crucial role in the time evolution of the correlation matrix, providing an int…
We present in this paper an empirical framework motivated by the practitioner point of view on stability. The goal is to both assess clustering validity and yield market insights by providing through the data perturbations we propose a multi-view of the assets' clustering behaviour. The perturbation framework is illustrated on an extensive credit default swap time series database available online at www.datagrapple.com.
The price of financial assets are, since Bachelier, considered to be described by a (discrete or continuous) time sequence of random variables, i.e a stochastic process. Sharp scaling exponents or unifractal behavior of such processes has been reported in several works. In this letter we investigate the question of scaling transformation of price processes by establishing a new connexion between non-linear group theoretical methods and multifractal methods developed in mathematical physics. Using two sets of financial chronological time series, we show that the scaling transformation is a non-…
Multifractality is ubiquitously observed in complex natural and socioeconomic systems. Multifractal analysis provides powerful tools to understand the complex nonlinear nature of time series in diverse fields. Inspired by its striking analogy with hydrodynamic turbulence, from which the idea of multifractality originated, multifractal analysis of financial markets has bloomed, forming one of the main directions of econophysics. We review the multifractal analysis methods and multifractal models adopted in or invented for financial time series and their subtle properties, which are applicable t…
The autocorrelation function of volatility in financial time series is fitted well by a superposition of several exponents. Such a case admits an explicit analytical solution of the problem of constructing the best linear forecast of a stationary stochastic process. We describe and apply the proposed analytical method for forecasting volatility. The leverage effect and volatility clustering are taken into account. Parameters of the predictor function are determined numerically for the Dow Jones 30 Industrial Average. Connection of the proposed method to the popular ARCH models is discussed.
Researchers have studied the first passage time of financial time series and observed that the smallest time interval needed for a stock index to move a given distance is typically shorter for negative than for positive price movements. The same is not observed for the index constituents, the individual stocks. We use the discrete wavelet transform to illustrate that this is a long rather than short time scale phenomenon -- if enough low frequency content of the price process is removed, the asymmetry disappears. We also propose a new model, which explain the asymmetry by prolonged, correlated…
We present some stylized facts exhibited by the time series of returns of the Mexican Stock Exchange Index (IPC) and compare them to a sample of both developed (USA, UK and Japan) and emerging markets (Brazil and India). The period of study is 1997-2011. The stylized facts are related mostly to the probability distribution func- tion and the autocorrelation function (e.g. fat tails, non-normality, volatility cluster- ing, among others). We find that positive skewness for returns in Mexico and Brazil, but not in the rest, suggest investment opportunities. Evidence of nonlinearity is also docume…
In the past few decades considerable effort has been expended in characterizing and modeling financial time series. A number of stylized facts have been identified, and volatility clustering or the tendency toward persistence has emerged as the central feature. In this paper we propose an appropriately defined conditional probability as a new measure of volatility clustering. We test this measure by applying it to different stock market data, and we uncover a rich temporal structure in volatility fluctuations described very well by a scaling relation. The scale factor used in the scaling provi…
In this paper, we use the generalized Hurst exponent approach to study the multi- scaling behavior of different financial time series. We show that this approach is robust and powerful in detecting different types of multiscaling. We observe a puzzling phenomenon where an apparent increase in multifractality is measured in time series generated from shuffled returns, where all time-correlations are destroyed, while the return distributions are conserved. This effect is robust and it is reproduced in several real financial data including stock market indices, exchange rates and interest rates. …
University of Manchester（曼彻斯特大学）；AllianceBernstein（联博集团）；Aarhus University（奥胡斯大学）
Data augmentation methods in combination with deep neural networks have been used extensively in computer vision on classification tasks, achieving great success; however, their use in time series classification is still at an early stage. This is even more so in the field of financial prediction, where data tends to be small, noisy and non-stationary. In this paper we evaluate several augmentation methods applied to stocks datasets using two state-of-the-art deep learning models. The results show that several augmentation methods significantly improve financial performance when used in combin…
We study tick-by-tick financial returns belonging to the FTSE MIB index of the Italian Stock Exchange (Borsa Italiana). We can confirm previously detected non-stationarities. However, scaling properties reported in the previous literature for other high-frequency financial data are only approximately valid. As a consequence of the empirical analyses, we propose a simple method for describing non-stationary returns, based on a non-homogeneous normal compound Poisson process. We test this model against the empirical findings and it turns out that the model can approximately reproduce several sty…
Training deep learning models that generalize well to live deployment is a challenging problem in the financial markets. The challenge arises because of high dimensionality, limited observations, changing data distributions, and a low signal-to-noise ratio. High dimensionality can be dealt with using robust feature selection or dimensionality reduction, but limited observations often result in a model that overfits due to the large parameter space of most deep neural networks. We propose a generative model for financial time series, which allows us to train deep learning models on millions of …
A well-interpretable measure of information has been recently proposed based on a partition obtained by intersecting a random sequence with its moving average. The partition yields disjoint sets of the sequence, which are then ranked according to their size to form a probability distribution function and finally fed in the expression of the Shannon entropy. In this work, such entropy measure is implemented on the time series of prices and volatilities of six financial markets. The analysis has been performed, on tick-by-tick data sampled every minute for six years of data from 1999 to 2004, fo…
Seoul National University（首尔国立大学）；Department of Computational Science（计算科学系）；Department of Mathematics（数学系）
Financial time series prediction, especially with machine learning techniques, is an extensive field of study. In recent times, deep learning methods (especially time series analysis) have performed outstandingly for various industrial problems, with better prediction than machine learning methods. Moreover, many researchers have used deep learning methods to predict financial time series with various models in recent years. In this paper, we will compare various deep learning models, such as multilayer perceptron (MLP), one-dimensional convolutional neural networks (1D CNN), stacked long shor…
Centre for Translational Data Science（转化数据科学中心）；University of Sydney（悉尼大学）；University of Sydney Business School（悉尼大学商学院）
Discrimination between non-stationarity and long-range dependency is a difficult and long-standing issue in modelling financial time series. This paper uses an adaptive spectral technique which jointly models the non-stationarity and dependency of financial time series in a non-parametric fashion assuming that the time series consists of a finite, but unknown number, of locally stationary processes, the locations of which are also unknown. The model allows a non-parametric estimate of the dependency structure by modelling the auto-covariance function in the spectral domain. All our estimates a…
We describe the impact of the intra-day activity pattern on the autocorrelation function estimator. We obtain an exact formula relating estimators of the autocorrelation functions of non-stationary process to its stationary counterpart. Hence, we proved that the day seasonality of inter-transaction times extends the memory of as well the process itself as its absolute value. That is, both processes relaxation to zero is longer.
