<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="fei-etal-2020-mimic">
    <titleInfo>
        <title>Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Hao</namePart>
        <namePart type="family">Fei</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Yafeng</namePart>
        <namePart type="family">Ren</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Donghong</namePart>
        <namePart type="family">Ji</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-11</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: EMNLP 2020</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Trevor</namePart>
            <namePart type="family">Cohn</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yulan</namePart>
            <namePart type="family">He</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yang</namePart>
            <namePart type="family">Liu</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Syntax has been shown useful for various NLP tasks, while existing work mostly encodes singleton syntactic tree using one hierarchical neural network. In this paper, we investigate a simple and effective method, Knowledge Distillation, to integrate heterogeneous structure knowledge into a unified sequential LSTM encoder. Experimental results on four typical syntax-dependent tasks show that our method outperforms tree encoders by effectively integrating rich heterogeneous structure syntax, meanwhile reducing error propagation, and also outperforms ensemble methods, in terms of both the efficiency and accuracy.</abstract>
    <identifier type="citekey">fei-etal-2020-mimic</identifier>
    <identifier type="doi">10.18653/v1/2020.findings-emnlp.18</identifier>
    <location>
        <url>https://aclanthology.org/2020.findings-emnlp.18</url>
    </location>
    <part>
        <date>2020-11</date>
        <extent unit="page">
            <start>183</start>
            <end>193</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP
%A Fei, Hao
%A Ren, Yafeng
%A Ji, Donghong
%Y Cohn, Trevor
%Y He, Yulan
%Y Liu, Yang
%S Findings of the Association for Computational Linguistics: EMNLP 2020
%D 2020
%8 November
%I Association for Computational Linguistics
%C Online
%F fei-etal-2020-mimic
%X Syntax has been shown useful for various NLP tasks, while existing work mostly encodes singleton syntactic tree using one hierarchical neural network. In this paper, we investigate a simple and effective method, Knowledge Distillation, to integrate heterogeneous structure knowledge into a unified sequential LSTM encoder. Experimental results on four typical syntax-dependent tasks show that our method outperforms tree encoders by effectively integrating rich heterogeneous structure syntax, meanwhile reducing error propagation, and also outperforms ensemble methods, in terms of both the efficiency and accuracy.
%R 10.18653/v1/2020.findings-emnlp.18
%U https://aclanthology.org/2020.findings-emnlp.18
%U https://doi.org/10.18653/v1/2020.findings-emnlp.18
%P 183-193

Markdown (Informal)

[Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP](https://aclanthology.org/2020.findings-emnlp.18) (Fei et al., Findings 2020)

• Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP (Fei et al., Findings 2020)

ACL

• Hao Fei, Yafeng Ren, and Donghong Ji. 2020. Mimic and Conquer: Heterogeneous Tree Structure Distillation for Syntactic NLP. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 183–193, Online. Association for Computational Linguistics.