• Title/Summary/Keyword: Savitzky-Golay

Search Result 52, Processing Time 0.024 seconds

Salient Chromagram Extraction Based on the Savitzky-Golay Filter for Cover Song Identification

  • Seo, Jin Soo
    • Journal of Multimedia Information System
    • /
    • v.9 no.1
    • /
    • pp.69-72
    • /
    • 2022
  • Extraction of a salient chromagram is utmost important for cover song identification. Cover song refers to a live performance, a remix, or a new recording of a previously recorded track. This paper utilizes the Savitzky-Golay filters in chromagram extraction for suppressing timber-related components of a music signal, which is not preserved while generating cover songs. By removing the timber-related components, the discriminative tonal components, which are conducive for cover song identification, are emphasized in chromagram. Experiments on cover song identification over two datasets show that the Savitzky-Golay filters are more effective in reducing timber effects in chromagram than other types of filters.

Analysis of biodiesel quality based on infrared spectroscopy and multivariate statistics (적외선 분광분석과 다변량 통계에 기반한 바이오디젤 품질분석)

  • Kim, Hye-Sil;Cho, Hyun-Woo;Liu, J. Jay
    • Analytical Science and Technology
    • /
    • v.25 no.4
    • /
    • pp.214-222
    • /
    • 2012
  • ASTM (American Society for Testing and Materials) D6751-10 suggests analytical methods as well as specifications for biodiesel quality. However, it is expensive and time-consuming to follow the ASTM testing methods to analyze biodiesel and various impurities. This paper develops a quantitative analysis system for biodiesel and impurities based on Infrared spectroscopy and a multivariate statistical method, PLS (partial least squares). In addition, four different pre-processing techniques were compared for spectrum correction and noise reduction. Savitzky-Golay pre-processing showed the best performance.

Comparison of Savitzky-Golay filtering results for quality control of soil moisture data (토양수분량 자료의 품질관리를 위한 Savitzky-Golay 필터링 적용결과 비교)

  • Lee, Yongjun;Kim, Kiyoung
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.268-268
    • /
    • 2020
  • 토양수분량은 수문연구에 있어 중요한 인자 중의 하나이며, 그 필요성이 점차 강조되고 있다. 국내에서도 최근 새로운 관측기기의 도입이나 수자원위성의 개발 등에 관한 연구가 점차 활발하게 이뤄지고 있으나, 토양수분량 자료의 생산, 품질관리 및 배포 시스템에 관한 연구 및 개발이 부족한 실정이다. 반면에 해외에서는 International Soil Moisture Network(ISMN)을 통해 토양수분량 자료의 품질관리 및 배포가 활발하게 이루어지고 있는데, ISMN에서는 토양특성, 강우에 대한 반응, 토양온도, 시계열특성을 이용해 토양수분량 관측 자료를 품질관리 하고 있다. 본 연구에서는 ISMN의 spike 검출 알고리즘에서 그래프 평활화(smoothing)를 위해 이용되는 Savitzky-Golay 필터의 window size와 polynomial order(filter order)를 다양하게 변화시키고, 이를 설마천 관측소에서 측정한 토양수분량 원시자료에 적용하여 window size와 polynomial order별로 편의(bias), 변동(variation), 평균 제곱근 오차(Root Mean Square Error, RMSE)를 산정하였다. 통계산정 결과 원시자료와의 bias는 window size가 3이고 polynomial order가 2인 필터를 적용했을 때 가장 작은 것으로 나타났으며, variance는 window size가 3이고 polynomial order가 2인 필터를 이용했을 때가 원시자료와 가장 유사한 것으로 나타났다. 또한, RMSE는 window size가 5이고 polynomial order가 3일 때 가장 작은 것으로 나타났다. 이는 추후 토양수분량 품질관리를 수행하기 위해 적절한 필터 계수 값을 제시할 수 있는 논문으로 사료된다.

  • PDF

Evaluating Spectral Preprocessing Methods for Visible and Near Infrared Reflectance Spectroscopy to Predict Soil Carbon and Nitrogen in Mountainous Areas (산지토양의 탄소와 질소 예측을 위한 가시 근적외선 분광반사특성 분석의 전처리 방법 비교)

  • Jeong, Gwanyong
    • Journal of the Korean Geographical Society
    • /
    • v.51 no.4
    • /
    • pp.509-523
    • /
    • 2016
  • The soil prediction can provide quantitative soil information for sustainable mountainous ecosystem management. Visible near infrared spectroscopy, one of soil prediction methods, has been applied to predict several soil properties with effective costs, rapid and nondesctructive analysis, and satisfactory accuracy. Spectral preprocessing is a essential procedure to correct noisy spectra for visible near infrared spectroscopy. However, there are no attempts to evaluate various spectral preprocessing methods. We tested 5 different pretreatments, namely continuum removal, Savitzky-Golay filter, discrete wavelet transform, 1st derivative, and 2nd derivative to predict soil carbon(C) and nitrogen(N). Partial least squares regression was used for the prediction method. The total of 153 soil samples was split into 122 samples for calibration and 31 samples for validation. In the all range, absorption was increased with increasing C contents. Specifically, the visible region (650nm and 700nm) showed high values of the correlation coefficient with soil C and N contents. For spectral preprocessing methods, continuum removal had the highest prediction accuracy(Root Mean Square Error) for C(9.53mg/g) and N(0.79mg/g). Therefore, continuum removal was selected as the best preprocessing method. Additionally, there were no distinct differences between Savitzky-Golay filter and discrete wavelet transform for visual assessment and the methods showed similar validation results. According to the results, we also recommended Savitzky-Golay filter that is a simple pre-treatment with continuum removal.

  • PDF

A Comparative study on smoothing techniques for performance improvement of LSTM learning model

  • Tae-Jin, Park;Gab-Sig, Sim
    • Journal of the Korea Society of Computer and Information
    • /
    • v.28 no.1
    • /
    • pp.17-26
    • /
    • 2023
  • In this paper, we propose a several smoothing techniques are compared and applied to increase the application of the LSTM-based learning model and its effectiveness. The applied smoothing technique is Savitky-Golay, exponential smoothing, and weighted moving average. Through this study, the LSTM algorithm with the Savitky-Golay filter applied in the preprocessing process showed significant best results in prediction performance than the result value shown when applying the LSTM model to Bitcoin data. To confirm the predictive performance results, the learning loss rate and verification loss rate according to the Savitzky-Golay LSTM model were compared with the case of LSTM used to remove complex factors from Bitcoin price prediction, and experimented with an average value of 20 times to increase its reliability. As a result, values of (3.0556, 0.00005) and (1.4659, 0.00002) could be obtained. As a result, since crypto-currencies such as Bitcoin have more volatility than stocks, noise was removed by applying the Savitzky-Golay in the data preprocessing process, and the data after preprocessing were obtained the most-significant to increase the Bitcoin prediction rate through LSTM neural network learning.

Soft Independent Modeling of Class Analogy for Classifying Lumber Species Using Their Near-infrared Spectra

  • Yang, Sang-Yun;Park, Yonggun;Chung, Hyunwoo;Kim, Hyunbin;Park, Se-Yeong;Choi, In-Gyu;Kwon, Ohkyung;Yeo, Hwanmyeong
    • Journal of the Korean Wood Science and Technology
    • /
    • v.47 no.1
    • /
    • pp.101-109
    • /
    • 2019
  • This paper examines the classification of five coniferous species, including larch (Larix kaempferi), red pine (Pinus densiflora), Korean pine (Pinus koraiensis), cedar (Cryptomeria japonica), and cypress (Chamaecyparis obtusa), using near-infrared (NIR) spectra. Fifty lumber samples were collected for each species. After air-drying the lumber, the NIR spectra (wavelength = 780-2500 nm) were acquired on the wide face of the lumber samples. Soft independent modeling of class analogy (SIMCA) was performed to classify the five species using their NIR spectra. Three types of spectra (raw, standard normal variated, and Savitzky-Golay $2^{nd}$ derivative) were used to compare the classification reliability of the SIMCA models. The SIMCA model based on Savitzky-Golay $2^{nd}$ derivatives preprocessing was determined as the best classification model in this study. The accuracy, minimum precision, and minimum recall of the best model (PCA models using Savitzky-Golay $2^{nd}$ derivative preprocessed spectra) were evaluated as 73.00%, 98.54% (Korean pine), and 67.50% (Korean pine), respectively.

Determination of Nitrogen in Fresh and Dry Leaf of Apple by Near Infrared Technology (근적외 분석법을 응용한 사과의 생잎과 건조잎의 질소분석)

  • Zhang, Guang-Cai;Seo, Sang-Hyun;Kang, Yeon-Bok;Han, Xiao-Ri;Park, Woo-Churl
    • Korean Journal of Soil Science and Fertilizer
    • /
    • v.37 no.4
    • /
    • pp.259-265
    • /
    • 2004
  • A quicker method was developed for foliar analysis in diagnosis of nitrogen in apple trees based on multivariate calibration procedure using partial least squares regression (PLSR) and principal component regression (PCR) to establish the relationship between reflectance spectra in the near infrared region and nitrogen content of fresh- and dry-leaf. Several spectral pre-processing methods such as smoothing, mean normalization, multiplicative scatter correction (MSC) and derivatives were used to improve the robustness and performance of the calibration models. Norris first derivative with a seven point segment and a gap of six points on MSC gave the best result of partial least squares-1 PLS-1) model for dry-leaf samples with root mean square error of prediction (RMSEP) equal to $0.699g\;kg^{-1}$, and that the Savitzky-Golay first derivate with a seven point convolution and a quadratic polynomial on MSC gave the best results of PLS-1 model for fresh-samples with RMSEP of $1.202g\;kg^{-1}$. The best PCR model was obtained with Savitzky-Golay first derivative using a seven point convolution and a quadratic polynomial on mean normalization for dry leaf samples with RMSEP of $0.553g\;kg^{-1}$, and obtained with the Savitzky-Golay first derivate using a seven point convolution and a quadratic polynomial for fresh samples with RMSEP of $1.047g\;kg^{-1}$. The results indicate that nitrogen can be determined by the near infrared reflectance (NIR) technology for fresh- and dry-leaf of apple.

Enhancement of Common-path Fourier-domain Optical Coherence Tomography using Active Surface Tracking Algorithm (표면 추적 알고리즘을 적용한 공통경로 FD-OCT의 성능개선)

  • Kim, Min-Ho;Kim, Keo-Sik;Song, Chul-Gyu
    • The Transactions of The Korean Institute of Electrical Engineers
    • /
    • v.61 no.4
    • /
    • pp.639-642
    • /
    • 2012
  • Optical coherence tomography(OCT) can provide real-time and non-invasive subsurface imaging with ultra-high resolution of micrometer scale. However, conventional OCT systems generally have a limited imaging depth range within a depth of only 1-2 mm. To overcome the limitation, we have proposed an active surface tracking algorithm used in common-path Fourier-domain OCT system in order to extend the imaging depth range. The surface tracking algorithm based on the threshold and Savitzky-Golay filter of A-scan data was applied to real-time tracking. The algorithm has controlled a moving stage according to the sample's surface variance in real time. An OCT image obtained by the algorithm clearly show an extended imaging depth range. Consequently, the proposed algorithm demonstrated the potential for improving the conventional OCT systems with limitary depth range.

Filtering Correction Method and Performance Comparison for Time Series Data

  • Baek, Jongwoo;Choi, Jiyoung;Jung, Hoekyung
    • Journal of information and communication convergence engineering
    • /
    • v.20 no.2
    • /
    • pp.125-130
    • /
    • 2022
  • In modern society, as many data are used for research or commercial purposes, the value of data is gradually increasing. In related fields, research is being actively conducted to collect valuable data, but it is difficult to collect proper data because the value of collection is determined according to the performance of existing sensors. To solve this problem, a method to effectively reduce noise has been proposed, but there is a point in which performance is degraded due to damage caused by noise. In this paper, a device capable of collecting time series data was designed to correct such data noise, and a correction technique was performed by giving an error value based on the representatively collected ultrafine dust data, and then comparing before and after Compare performance. For the correction method, Kalman, LPF, Savitzky-Golay, and Moving Average filter were used. Savitzky-Golay filter and Moving Average Filter showed excellent correction rate as an experiment. Through this, the performance of the sensor can be supplemented and it is expected that data can be effectively collected.

Performance Comparison of LSTM-Based Groundwater Level Prediction Model Using Savitzky-Golay Filter and Differential Method (Savitzky-Golay 필터와 미분을 활용한 LSTM 기반 지하수 수위 예측 모델의 성능 비교)

  • Keun-San Song;Young-Jin Song
    • Journal of the Semiconductor & Display Technology
    • /
    • v.22 no.3
    • /
    • pp.84-89
    • /
    • 2023
  • In water resource management, data prediction is performed using artificial intelligence, and companies, governments, and institutions continue to attempt to efficiently manage resources through this. LSTM is a model specialized for processing time series data, which can identify data patterns that change over time and has been attempted to predict groundwater level data. However, groundwater level data can cause sen-sor errors, missing values, or outliers, and these problems can degrade the performance of the LSTM model, and there is a need to improve data quality by processing them in the pretreatment stage. Therefore, in pre-dicting groundwater data, we will compare the LSTM model with the MSE and the model after normaliza-tion through distribution, and discuss the important process of analysis and data preprocessing according to the comparison results and changes in the results.

  • PDF