Skip to content

Literature review: related methods for assembling synthetic series

Methods related to assembling a long series from pieces that were not included in the method list (BASELINES.md): they have no implementation, come from another field or use the real train directly instead of a generator pool.

Analogues from other fields

Method Idea Literature Implementation
Unit selection (concatenative speech synthesis) Selection and ordering of speech fragments by the sum of target cost + concatenation cost, Viterbi search. A conceptual analogue of assembly from a window pool Hunt A., Black A. Unit selection in a concatenative speech synthesis system using a large speech database. ICASSP 1996. doi:10.1109/ICASSP.1996.541110 Festival (C++, speech only) — cstr.ed.ac.uk/projects/festival
Video Textures A transition matrix between frames by similarity; a random walk on the Markov chain gives an endless video Schödl A., Szeliski R., Salesin D., Essa I. Video Textures. SIGGRAPH 2000. doi:10.1145/344779.345012 no official one; on a pool it coincides with matched-block from BASELINES.md; its frame distance is the seam cost of the solvers there (greedy, ATSP, PCTSP)
Motion Graphs A graph of motion clips with transitions at similar poses, path search under constraints Kovar L., Gleicher M., Pighin F. Motion Graphs. SIGGRAPH 2002. doi:10.1145/566654.566605 no official one
Graphcut textures Optimal seam between overlapping patches via min-cut; in 1D it coincides with image quilting Kwatra V., Schödl A., Essa I., Turk G., Bobick A. Graphcut textures: image and video synthesis using graph cuts. SIGGRAPH 2003. doi:10.1145/882262.882264 no official one

Diffusion generation of long content

Method Idea Literature Implementation
RePaint Inpainting with an unconditional diffusion model: the known part is resampled at every step Lugmayr A. et al. RePaint: Inpainting using denoising diffusion probabilistic models. CVPR 2022. arXiv:2201.09865 github.com/andreas128/RePaint — images only, a separate diffusion model for series is needed
MultiDiffusion Overlapping windows are reconciled at every denoising step (averaging of overlaps) Bar-Tal O., Yariv L., Lipman Y., Dekel T. MultiDiffusion: Fusing diffusion paths for controlled image generation. ICML 2023. arXiv:2302.08113 github.com/omerbt/MultiDiffusion — for Stable Diffusion; for series this is a custom implementation on top of Diffusion-TS
DiffCollage A factor graph of overlapping pieces, parallel generation of content of arbitrary length Zhang Q., Song J., Huang X., Chen Y., Liu M.-Y. DiffCollage: Parallel generation of large content with diffusion models. CVPR 2023. arXiv:2303.17076 no official code; project page

Resampling the real series (bootstrap and surrogates)

Method Idea Literature Implementation
Moving block bootstrap Concatenation of random overlapping blocks of fixed length Künsch H. The jackknife and the bootstrap for general stationary observations. Ann. Statist. 17(3), 1989. doi:10.1214/aos/1176347265 arch (MovingBlockBootstrap), tsbootstrap
Circular block bootstrap The same, with the series wrapped into a circle — all points are equally likely Politis D., Romano J. A circular block-resampling procedure for stationary data. In: LePage R., Billard L. (eds.) Exploring the Limits of Bootstrap, Wiley, 1992 (book chapter, no open link) arch (CircularBlockBootstrap), tsbootstrap
Stationary bootstrap The block length is random (geometric) — the result is stationary Politis D., Romano J. The stationary bootstrap. JASA 89(428), 1994. doi:10.1080/01621459.1994.10476870 arch (StationaryBootstrap), tsbootstrap, recombinator
Optimal block length Automatic selection of the block length for the stationary / circular bootstrap Politis D., White H. Automatic block-length selection for the dependent bootstrap. Econometric Reviews 23(1), 2004. doi:10.1081/ETC-120028836 arch (optimal_block_length)
Seasonal block bootstrap Blocks start at the same seasonal phase, so seasonality is not broken Dudek A., Leśkow J., Paparoditis E., Politis D. A generalized block bootstrap for seasonal time series. J. Time Series Analysis 35(2), 2014. ideas.repec.org no ready-made Python one
Sieve bootstrap Fitting AR(p) with growing p, resampling the residuals, generation by recursion Bühlmann P. Sieve bootstrap for time series. Bernoulli 3(2), 1997. projecteuclid.org tsbootstrap (SieveBootstrap)
Markov bootstrap Resampling via a kernel estimate of the transition density of a Markov chain Rajarshi M. Bootstrap in Markov-sequences based on estimates of transition density. Ann. Inst. Statist. Math. 42, 1990. doi:10.1007/BF00050835 tsbootstrap (its own variation: HMM over blocks)
AAFT surrogates Random Fourier phases with matching of the value distribution Theiler J. et al. Testing for nonlinearity in time series: the method of surrogate data. Physica D 58, 1992. doi:10.1016/0167-2789(92)90102-S nolitsa
IAAFT surrogates Iterative matching of both the spectrum and the value distribution Schreiber T., Schmitz A. Improved surrogate data for nonlinearity tests. Phys. Rev. Lett. 77, 1996. doi:10.1103/PhysRevLett.77.635 nolitsa

Augmentations of real series

Method Idea Literature Implementation
Window warping / window slicing Speeding up or slowing down a segment of the series and returning to the original length; cutting out sub-windows Le Guennec A., Malinowski S., Tavenard R. Data augmentation for time series classification using convolutional neural networks. AALTD @ ECML/PKDD 2016. HAL tsgm (tsgm.models.augmentations), tsaug
DBA augmentation Synthetic series as weighted DTW barycentres of real ones Forestier G., Petitjean F., Dau H. A., Webb G. I., Keogh E. Generating synthetic time series to augment sparse datasets. ICDM 2017. IEEE Xplore; DBA: Petitjean F. et al. Pattern Recognition 44(3), 2011. doi:10.1016/j.patcog.2010.09.013 tsgm (DTWBarycentricAveraging), MSD-IRIMAS/Augmenting-TSC-Elastic-Averaging