• Title/Summary/Keyword: Copy-Transformer

Search Result 7, Processing Time 0.028 seconds

Copy-Transformer model using Copy-Mechanism and Inference Penalty for Document Abstractive Summarization (복사-메커니즘과 추론 단계의 페널티를 이용한 Copy-Transformer 기반 문서 생성 요약)

  • Jeon, Donghyeon;Kang, In-Ho
    • Annual Conference on Human and Language Technology
    • /
    • 2019.10a
    • /
    • pp.301-306
    • /
    • 2019
  • 문서 생성 요약은 최근 딥러닝을 이용한 end-to-end 시스템을 통해 유망한 결과들을 보여주고 있어 연구가 활발히 진행되고 있는 자연어 처리 분야 중 하나이다. 하지만 문서 생성 요약 모델을 구성하기 위해서는 대량의 본문과 요약문 쌍의 데이터 셋이 필요한데, 이를 구축하기가 쉽지 않다. 따라서 본 논문에서는 정교한 뉴스 기사 요약 데이터 셋을 기계적으로 구축하는 방법을 제안한다. 또한 딥러닝 기반의 생성 요약은 입력 문서와 다른 정보를 생성하거나, 또는 같은 단어를 반복하여 생성하는 문제점들이 존재한다. 이를 해결하기 위해 요약문을 생성할 때 입력 문서의 내용을 인용하는 복사-메커니즘과, 추론 단계에서 단어 반복을 직접적으로 제어하는 페널티를 사용하면 상대적으로 안정적인 문장이 생성될 수 있다. 그리고 Transformer 모델은 순환 신경망 모델보다 요약문 생성 과정에서 시퀀스 길이가 긴 본문의 정보를 적절히 인코딩하여 줄 수 있는 모델이다. 따라서 본 논문에서는 복사-메커니즘과 추론 단계의 페널티를 이용한 Copy-Transformer 모델을 한국어 문서 생성 요약 데이터에 적용하였다. 네이버 지식iN 질문 요약 데이터 셋과 뉴스 기사 요약 데이터 셋 상에서 실험한 결과, 제안한 모델을 이용한 생성 요약이 비교 모델들 대비 가장 좋은 성능을 보이고 양질의 요약을 생성하는 것을 확인하였다.

  • PDF

Deep Learning based Korean Dialect Machine Translation Research (딥러닝 기반 한국어 방언 기계번역 연구)

  • Lim, Sangbeom;Park, Chanjun;Jo, Jaechoon;Yang, Yeongwook
    • Annual Conference on Human and Language Technology
    • /
    • 2021.10a
    • /
    • pp.490-495
    • /
    • 2021
  • 표준어와 방언사이에는 위계가 존재하지 않고 열등하지 않다는 사상을 기반으로 방언을 보존하기 위한 다양한 노력들이 이루어지고있다. 또한 동일한 국가내에서 표준어와 방언간의 의사소통이 잘 이루어져야한다. 본 논문은 방언 연구보존과 의사소통의 중요성을 바탕으로 한국어 방언 기계번역 연구를 진행하였다. 대표적인 방언 중 하나인 제주어와 더불어 강원어, 경상어, 전라어, 충청어 기반의 기계번역 연구를 진행하였다. 공개된 AI Hub 데이터를 바탕으로 Transformer기반 copy mechanism을 적용하여 방언 기계번역의 성능을 높이는 모델링 연구를 진행하였으며 모델배포의 효율성을 위하여 Many-to-one기반 universal한 방언 기계번역기를 개발하였고 이를 one-to-one 모델과의 성능비교를 진행하였다. 실험결과 copy mechanism이 방언 기계번역 모델에 매우 효과적인 요소임을 알 수 있었다.

  • PDF

Analysis of the polychlorinated biphenyls in transformer oils using peak matching method (피크패턴법을 이용한 절연유 중 PCBs 분석)

  • Shin, Sun Kyoung;Kim, Hye-Jin;Chung, David;Jeon, Tae Wan;Kim, Jin Kyoung;Park, Seok Un;Chung, Young Hee;Chung, Il Rok
    • Analytical Science and Technology
    • /
    • v.18 no.5
    • /
    • pp.410-418
    • /
    • 2005
  • PCBs had numerous uses such as hydraulic fluid, heat exchange fluid, sealant, lubricant, and carbonless copy paper. They are most likely found in electric utilities, power stations, industrial facilities, electronic manufacturing plants, petrochemical plants, railroad systems, electric equipment repair facilities, mining sites (active or abandoned), and military camps. Due to its outstanding chemical and thermal stabilities and electrical insulation properties, the commercial and industrial products of PCBs, such as Aroclors, Kaneclors, Clophens, Phenaclors etc., had been widely used as thermal oil and transformer oil from 1930s until the 1970s. The transformer oils were analyzed as a main source of polychlorinated biphenyls (PCBs) emission into the environment. Qualitative estimation of oil extracts as carried out with Aroclor 1242, 1248, 1254, 1260. The transformer oils contained the pure and mixed of Aroclor 1242, Aroclor 1254, and Aroclor 1260. Also, commercial screening kit of 20 ppm and 50 ppm were applied to the transformer oil samples.

Deep Learning-based Korean Dialect Machine Translation Research Considering Linguistics Features and Service (언어적 특성과 서비스를 고려한 딥러닝 기반 한국어 방언 기계번역 연구)

  • Lim, Sangbeom;Park, Chanjun;Yang, Yeongwook
    • Journal of the Korea Convergence Society
    • /
    • v.13 no.2
    • /
    • pp.21-29
    • /
    • 2022
  • Based on the importance of dialect research, preservation, and communication, this paper conducted a study on machine translation of Korean dialects for dialect users who may be marginalized. For the dialect data used, AIHUB dialect data distributed based on the highest administrative district was used. We propose a many-to-one dialect machine translation that promotes the efficiency of model distribution and modeling research to improve the performance of the dialect machine translation by applying Copy mechanism. This paper evaluates the performance of the one-to-one model and the many-to-one model as a BLEU score, and analyzes the performance of the many-to-one model in the Korean dialect from a linguistic perspective. The performance improvement of the one-to-one machine translation by applying the methodology proposed in this paper and the significant high performance of the many-to-one machine translation were derived.

Lossless Inductor Snubber-Assisted ZCS-PFM High Frequency Series Resonant Inverter for Eddy Current-Heated Roller

  • Feng Y. L.;Ishitobi M.;Okuno A.;Nakaoka M.;Lee H. W.
    • Proceedings of the KIPE Conference
    • /
    • 2001.10a
    • /
    • pp.304-308
    • /
    • 2001
  • This paper presents a novel prototype of ZCS-PFM high frequency series resonant inverter using IGBT power module for electromagnetic induction eddy current-heated roller in copy and printing machines. The operating principle and unique features of this voltage source half bridge inverter with two additional soft commutation inductor snubber are presented including the transformer modeling of induction heated rolling drum. This soft switching inverter can achieve stable zero current soft commutation under a discontinuous and continuous resonant load current for a widely specified power regulation processing. The experimental results and computer-aided analysis of this inverter are discussed from a practical point of view.

  • PDF

Novel ZCS-PFM Series Resonant High Frequency Inverter for Electromagnetic Induction Eddy Current-Heated Roller

  • Mun, Sang-Pil;Kang, Shin-Chul;Kim, Soo-Wook;Nakaoka, Mutsuo
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.22 no.7
    • /
    • pp.28-36
    • /
    • 2008
  • This paper presents a novel prototype of zero current switching pulse frequency modulation (ZCS-PFM )high frequency series resonant inverter using IGBT power module for electromagnetic induction eddy current heated roller in copy and printing machines. The operating principle and unique features of this voltage-fed half bridge inverter with two additional soft commutation inductor snubber are presented including the transformer modeling of induction heated rolling drum. This soft switching inverter can achieve stable zero current soft commutation under a discontinuous and continuous resonant load current for a widely specified power regulation processing. The experimental results and computer-aided analysis of this inverter are discussed from a practical point of view.

ZCS-PFM Series Resonant High Frequency Inverter for Electromagnetic Induction Eddy Current-Heated Roller

  • Mun, Sang-Pil;Jung, Sang-Hwa;Kim, Chang-Il;Kim, Sang-Don;Nakaoka, Mutsuo
    • Proceedings of the Korean Institute of IIIuminating and Electrical Installation Engineers Conference
    • /
    • 2008.05a
    • /
    • pp.419-422
    • /
    • 2008
  • This paper presents a novel prototype of ZCS-PFM high frequency series resonant Inverter using IGBT power module for electromagnetic induction eddy current-heated roller in copy and printing machines. The operating principle and unique features of this voltage source half bridge inverter with two additional soft commutation inductor snubber are presented Including the transformer modeling of induction heated rolling drum. This soft switching inverter can achieve stable zero current soft commutation under a discontinuous and continuous resonant load current for a widely specified power regulation processing. The experimental results and computer-aided analysis of this inverter are discussed from a practical point of view.

  • PDF