EP3577571A4 - Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof - Google Patents

Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof Download PDF

Info

Publication number: EP3577571A4
Authority: EP; European Patent Office
Prior art keywords: electronic apparatus; language model; operation methods; recommendation word; providing recommendation
Prior art date: 2017-03-09
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.): Ceased

Application number

EP18763492.8A

Other languages

German (de)

French (fr)

Other versions

EP3577571A1 (en

Inventor

Seung-hak YU

Nilesh Kulkarni

Hee-Jun Song

Hae-Jun Lee

Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)

Samsung Electronics Co Ltd

Original Assignee

Samsung Electronics Co Ltd

Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)

2017-03-09

Filing date

2018-02-06

Publication date

2020-02-26

2018-02-06 Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd

2018-02-06 Priority claimed from PCT/KR2018/001611 external-priority patent/WO2018164378A1/en

2019-12-11 Publication of EP3577571A1 publication Critical patent/EP3577571A1/en

2020-02-26 Publication of EP3577571A4 publication Critical patent/EP3577571A4/en

Status Ceased legal-status Critical Current

Classifications

- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/16—Matrix or vector computation, e.g. matrix-matrix or matrix-vector multiplication, matrix factorization
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
- G06F16/33—Querying
- G06F16/3331—Query processing
- G06F16/334—Query execution
- G06F16/3347—Query execution using vector based model
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/205—Parsing
- G06F40/216—Parsing using statistical methods
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/274—Converting codes to words; Guess-ahead of partial word inputs
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/279—Recognition of textual entities
- G06F40/284—Lexical analysis, e.g. tokenisation or collocates
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/044—Recurrent networks, e.g. Hopfield networks
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/02—Knowledge representation; Symbolic representation
- G06N5/022—Knowledge engineering; Knowledge acquisition

Landscapes

Engineering & Computer Science (AREA)
Theoretical Computer Science (AREA)
Physics & Mathematics (AREA)
General Physics & Mathematics (AREA)
General Engineering & Computer Science (AREA)
Computational Linguistics (AREA)
Mathematical Physics (AREA)
Data Mining & Analysis (AREA)
Artificial Intelligence (AREA)
Health & Medical Sciences (AREA)
General Health & Medical Sciences (AREA)
Software Systems (AREA)
Computing Systems (AREA)
Molecular Biology (AREA)
Biophysics (AREA)
Evolutionary Computation (AREA)
Biomedical Technology (AREA)
Life Sciences & Earth Sciences (AREA)
Audiology, Speech & Language Pathology (AREA)
Mathematical Analysis (AREA)
Computational Mathematics (AREA)
Mathematical Optimization (AREA)
Pure & Applied Mathematics (AREA)
Databases & Information Systems (AREA)
Algebra (AREA)
Human Computer Interaction (AREA)
Probability & Statistics with Applications (AREA)
Machine Translation (AREA)

EP18763492.8A 2017-03-09 2018-02-06 Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof Ceased EP3577571A4 (en)

Applications Claiming Priority (3)

Application Number	Priority Date	Filing Date	Title
US201762469089P	2017-03-09	2017-03-09
KR1020170147922A KR102488338B1 (en)	2017-03-09	2017-11-08	Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof
PCT/KR2018/001611 WO2018164378A1 (en)	2017-03-09	2018-02-06	Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof

Publications (2)

Publication Number	Publication Date
EP3577571A1 EP3577571A1 (en)	2019-12-11
EP3577571A4 true EP3577571A4 (en)	2020-02-26

Family

ID=63719251

Family Applications (1)

Application Number	Title	Priority Date	Filing Date
EP18763492.8A Ceased EP3577571A4 (en)	2017-03-09	2018-02-06	Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof

Country Status (3)

Country	Link
EP (1)	EP3577571A4 (en)
KR (1)	KR102488338B1 (en)
CN (1)	CN110168542B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
KR102234155B1 (en)	2018-08-31	2021-03-30	주식회사 엘지화학	System and method for correcting current value of shunt resistor
US11741356B2 (en) *	2019-02-08	2023-08-29	Korea Advanced Institute Of Science & Technology	Data processing apparatus by learning of neural network, data processing method by learning of neural network, and recording medium recording the data processing method
KR102331242B1 (en) *	2019-05-20	2021-11-25	에스케이텔레콤 주식회사	Memory network apparatus and deducing method using the same
CN110781690B (en) *	2019-10-31	2021-07-13	北京理工大学	Fusion and compression method of multi-source neural machine translation model
KR20210098247A (en)	2020-01-31	2021-08-10	삼성전자주식회사	Electronic device and operating method for the same
CN111597825B (en) *	2020-05-13	2021-07-23	北京字节跳动网络技术有限公司	Voice translation method and device, readable medium and electronic equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
JP5410355B2 (en) *	2010-04-13	2014-02-05	富士フイルム株式会社	Matrix generation apparatus, method, program, and information processing apparatus
US9728184B2 (en)	2013-06-18	2017-08-08	Microsoft Technology Licensing, Llc	Restructuring deep neural network acoustic models
KR102167719B1 (en) *	2014-12-08	2020-10-19	삼성전자주식회사	Method and apparatus for training language model, method and apparatus for recognizing speech
KR102305584B1 (en) *	2015-01-19	2021-09-27	삼성전자주식회사	Method and apparatus for training language model, method and apparatus for recognizing language
CN104636317A (en) *	2015-03-09	2015-05-20	湘潭大学	Method for optimizing interactive projection measurement matrix based on feature value decomposition
JP6628350B2 (en)	2015-05-11	2020-01-08	国立研究開発法人情報通信研究機構	Method for learning recurrent neural network, computer program therefor, and speech recognition device
CN106407211B (en) *	2015-07-30	2019-08-06	富士通株式会社	The method and apparatus classified to the semantic relation of entity word

2017
- 2017-11-08 KR KR1020170147922A patent/KR102488338B1/en active IP Right Grant
2018
- 2018-02-06 EP EP18763492.8A patent/EP3577571A4/en not_active Ceased
- 2018-02-06 CN CN201880005774.XA patent/CN110168542B/en active Active

Non-Patent Citations (7)

* Cited by examiner, † Cited by third party
Title
GEOFFREY HINTON ET AL: "Distilling the Knowledge in a Neural Network", CORR (ARXIV), vol. 1503.02531v1, 9 March 2015 (2015-03-09), pages 1 - 9, XP055549014 *
HAKAN INAN ET AL: "Tying Word Vectors and Word Classifiers: A Loss Framework for Language Modeling", 4 November 2016 (2016-11-04), XP055657987, Retrieved from the Internet <URL:https://arxiv.org/pdf/1611.01462v2.pdf> [retrieved on 20200115] *
JIAN XUE ET AL: "Restructuring of Deep Neural Network Acoustic Models with Singular Value Decomposition", PROC. INTERSPEECH 2013, 25 August 2013 (2013-08-25), Lyon, France, pages 2365 - 2369, XP055193450, Retrieved from the Internet <URL:http://www.isca-speech.org/archive/archive_papers/interspeech_2013/i13_2365.pdf> [retrieved on 20150603] *
OFIR PRESS ET AL: "Using the Output Embedding to Improve Language Models", PROCEEDINGS OF THE 15TH CONFERENCE OF THE EUROPEAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: VOLUME 2, SHORT PAPERS, 21 February 2017 (2017-02-21), Stroudsburg, PA, USA, pages 157 - 163, XP055657986, DOI: 10.18653/v1/E17-2025 *
PRABHAVALKAR ROHIT ET AL: "On the compression of recurrent neural networks with an application to LVCSR acoustic modeling for embedded speech recognition", 2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), IEEE, 20 March 2016 (2016-03-20), pages 5970 - 5974, XP032901749, DOI: 10.1109/ICASSP.2016.7472823 *
SAINATH TARA N ET AL: "Low-rank matrix factorization for Deep Neural Network training with high-dimensional output targets", ICASSP, IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING - PROCEEDINGS 1999 IEEE, IEEE, 26 May 2013 (2013-05-26), pages 6655 - 6659, XP032508392, ISSN: 1520-6149, ISBN: 978-0-7803-5041-0, [retrieved on 20131018], DOI: 10.1109/ICASSP.2013.6638949 *
See also references of WO2018164378A1 *

Also Published As

Publication number	Publication date
CN110168542A (en)	2019-08-23
EP3577571A1 (en)	2019-12-11
CN110168542B (en)	2023-11-24
KR20180103671A (en)	2018-09-19
KR102488338B1 (en)	2023-01-13

Publication	Publication Date	Title
EP3679492A4 (en)	2021-01-20	Methods and apparatus for efficiently implementing a fast-copyable database
EP3605352A4 (en)	2020-05-27	Short-link parsing method, apparatus and device
EP3726476A4 (en)	2021-04-07	Object modeling movement method, apparatus and device
EP3683724A4 (en)	2021-02-17	Training method for image-text matching model, bidirectional search method, and related apparatus
EP3695597A4 (en)	2021-06-30	An apparatus, a method and a computer program for volumetric video
EP3726525A4 (en)	2021-01-06	Electronic device for analyzing meaning of speech, and operation method therefor
EP3579150A4 (en)	2020-03-25	Operation apparatus and method
EP3577571A4 (en)	2020-02-26	Electronic apparatus for compressing language model, electronic apparatus for providing recommendation word and operation methods thereof
EP3179473A4 (en)	2017-07-12	Training method and apparatus for language model, and device
AU2017310900C1 (en)	2020-01-30	Polar coding method, apparatus, and device
EP3405947A4 (en)	2020-03-04	Method and apparatus for initiating an operation using voice data
EP3346397A4 (en)	2018-11-07	Content recommendation method, apparatus and system
EP3819785A4 (en)	2021-08-18	Feature word determining method, apparatus, and server
EP3351172A4 (en)	2019-04-17	Ear shape analysis method, ear shape analysis device, and method for generating ear shape model
EP3620940A4 (en)	2020-04-08	Dialogue generation method and apparatus, and electronic device
EP3777319A4 (en)	2021-11-17	Apparatus, method and computer program
EP3523710A4 (en)	2019-11-13	Apparatus and method for providing sentence based on user input
EP3718032A4 (en)	2021-08-11	Customization method and apparatus
EP3523726A4 (en)	2019-08-14	Database processing method, apparatus, and electronic device
EP3619709A4 (en)	2021-01-06	Microphone, vocal training apparatus comprising microphone and vocal analyzer, vocal training method, and non-transitory tangible computer-readable storage medium
EP3539056A4 (en)	2019-11-27	Electronic apparatus and operation method thereof
EP3739571A4 (en)	2021-10-06	Speech synthesis method, speech synthesis device, and program
EP3563247A4 (en)	2020-09-02	Method and apparatus for compressing an application
EP3733005A4 (en)	2021-09-15	Prompt method and apparatus, and electronic cigarette
EP3674686A4 (en)	2020-08-12	Learning device, method, and program for determiner, and determiner

Legal Events

Date	Code	Title	Description
2018-09-17	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE
2019-11-08	PUAI	Public reference made under article 153(3) epc to a published international application that has entered the european phase	Free format text: ORIGINAL CODE: 0009012
2019-11-08	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE
2019-12-11	17P	Request for examination filed	Effective date: 20190904
2019-12-11	AK	Designated contracting states	Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
2019-12-11	AX	Request for extension of the european patent	Extension state: BA ME
2020-02-26	A4	Supplementary search report drawn up and despatched	Effective date: 20200127
2020-02-26	RIC1	Information provided on ipc code assigned before grant	Ipc: G06N 5/02 20060101ALI20200121BHEP Ipc: G06F 17/16 20060101AFI20200121BHEP Ipc: G06N 3/08 20060101ALI20200121BHEP Ipc: G06F 40/284 20200101ALI20200121BHEP Ipc: G06F 40/274 20200101ALI20200121BHEP Ipc: G06N 3/04 20060101ALI20200121BHEP Ipc: G06F 40/216 20200101ALI20200121BHEP
2020-06-17	DAV	Request for validation of the european patent (deleted)
2020-06-17	DAX	Request for extension of the european patent (deleted)
2020-12-10	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: EXAMINATION IS IN PROGRESS
2020-12-11	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: EXAMINATION IS IN PROGRESS
2021-01-13	17Q	First examination report despatched	Effective date: 20201209
2023-03-24	REG	Reference to a national code	Ref country code: DE Ref legal event code: R003
2023-06-30	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED
2023-08-02	18R	Application refused	Effective date: 20230324