[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

JP6011641B2 - Encoder - Google Patents

Encoder Download PDF

Info

Publication number
JP6011641B2
JP6011641B2 JP2014557241A JP2014557241A JP6011641B2 JP 6011641 B2 JP6011641 B2 JP 6011641B2 JP 2014557241 A JP2014557241 A JP 2014557241A JP 2014557241 A JP2014557241 A JP 2014557241A JP 6011641 B2 JP6011641 B2 JP 6011641B2
Authority
JP
Japan
Prior art keywords
picture
video
buffer
encoding
video signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2014557241A
Other languages
Japanese (ja)
Other versions
JPWO2014112071A1 (en
Inventor
啓介 篠沢
啓介 篠沢
弘徳 遠藤
弘徳 遠藤
哲司 名幸
哲司 名幸
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NTT Electronics Corp
Original Assignee
NTT Electronics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NTT Electronics Corp filed Critical NTT Electronics Corp
Application granted granted Critical
Publication of JP6011641B2 publication Critical patent/JP6011641B2/en
Publication of JPWO2014112071A1 publication Critical patent/JPWO2014112071A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output
    • H04N19/152Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/132Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/189Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
    • H04N19/196Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
    • H04N19/198Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters including smoothing of a sequence of encoding parameters, e.g. by averaging, by choice of the maximum, minimum or median value
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Description

本発明は、エンコーダバッファの使用率に応じたリピート処理を実施することができる符号化装置に関する。   The present invention relates to an encoding apparatus capable of performing repeat processing according to the usage rate of an encoder buffer.

符号化装置では、入力された原画像を一旦ビデオバッファに格納し、その後ビデオ符号化部に入力して符号化しエンコーダバッファに格納する。しかし、低ビットレート時の難映像の場合、符号量を抑えきれずに、エンコーダバッファの破綻が起き、それにより符号化装置の動作が停止するなどの問題が発生していた。   In the encoding apparatus, the input original image is temporarily stored in the video buffer, and then input to the video encoding unit, encoded, and stored in the encoder buffer. However, in the case of a difficult video at a low bit rate, there has been a problem that the encoding amount cannot be suppressed and the encoder buffer is broken down, thereby stopping the operation of the encoding device.

これに対して、ビデオバッファへの入力フレーム数が出力フレーム数よりも少ない場合にリピート信号を発生し、同一フレームを繰り返し符号化する技術が提案されている(例えば、特許文献1参照)。この技術では、リピート信号が発生しない場合に選択するフレームよりも時間的に1フレーム前のフレームを選択し、選択したフレーム又はその直前のフレームを繰り返し符号化する。そして、リピート信号が発生したタイミング以降の符号化フレームの符号化タイプによって符号化するフレームを適応的に切り替えて符号化する。   On the other hand, a technique has been proposed in which a repeat signal is generated when the number of input frames to the video buffer is smaller than the number of output frames, and the same frame is repeatedly encoded (see, for example, Patent Document 1). In this technique, a frame that is one frame earlier than a frame that is selected when no repeat signal is generated is selected, and the selected frame or the frame immediately before it is repeatedly encoded. Then, encoding is performed by adaptively switching the frame to be encoded according to the encoding type of the encoded frame after the timing at which the repeat signal is generated.

特開2002−34040号公報JP 2002-34040 A

しかし、従来技術ではビデオバッファの状態のみを見ており、エンコーダバッファの使用率に応じたリピート処理を実施することはできなかった。そして、リピート処理の方式も一通りに限られていた。   However, the conventional technique only looks at the state of the video buffer, and cannot perform repeat processing according to the usage rate of the encoder buffer. In addition, the repeat processing method is limited to one.

本発明は、上述のような課題を解決するためになされたもので、その目的はエンコーダバッファの使用率に応じたリピート処理を実施することができる符号化装置を得るものである。   The present invention has been made to solve the above-described problems, and an object of the present invention is to obtain an encoding apparatus capable of performing repeat processing according to the usage rate of an encoder buffer.

本発明に係る符号化装置は、入力された映像信号を格納するビデオバッファと、前記ビデオバッファから読み出された前記映像信号を符号化する符号化部と、前記符号化部から出力されたビデオストリームを格納するエンコーダバッファと、前記映像信号の上位フィールドのIピクチャまたはPピクチャを前記ビデオバッファから繰り返し読み出して前記符号化部により符号化させるリピート処理の方式を前記エンコーダバッファの使用率に応じて切り替える制御部とを備えることを特徴とする。 An encoding apparatus according to the present invention includes a video buffer that stores an input video signal, an encoding unit that encodes the video signal read from the video buffer, and a video output from the encoding unit. An encoder buffer for storing a stream, and a repeat processing method in which an I picture or a P picture in the upper field of the video signal is repeatedly read from the video buffer and encoded by the encoding unit according to the usage rate of the encoder buffer And a switching control unit.

本発明により、エンコーダバッファの使用率に応じたリピート処理を実施することができる。この結果、リピートして低減させた符号量を他の映像に割り振ることにより、映像全体の画質が向上する。   According to the present invention, it is possible to perform repeat processing according to the usage rate of the encoder buffer. As a result, the image quality of the entire video is improved by allocating the code amount reduced by repetition to other video.

本発明の実施の形態1に係る符号化装置を示すブロック図である。It is a block diagram which shows the encoding apparatus which concerns on Embodiment 1 of this invention. 従来の一般処理の方式を示す図である。It is a figure which shows the system of the conventional general process. リピート処理の第1の方式を示す図である。It is a figure which shows the 1st system of a repeat process. リピート処理の第2の方式を示す図である。It is a figure which shows the 2nd system of repeat processing.

図1は、本発明の実施の形態1に係る符号化装置を示すブロック図である。上位フィールド(Top Field)と下位フィールド(Bottom Field)のペアを持つ映像信号が順に外部から入力される。ビデオバッファ1は、入力された映像信号を格納する。符号化部2は、ビデオバッファ1から読み出された映像信号を符号化する。エンコーダバッファ3は、符号化部2から出力されたビデオストリームを一時的に格納した後に出力する。   FIG. 1 is a block diagram showing an encoding apparatus according to Embodiment 1 of the present invention. A video signal having a pair of an upper field (Top Field) and a lower field (Bottom Field) is sequentially input from the outside. The video buffer 1 stores the input video signal. The encoding unit 2 encodes the video signal read from the video buffer 1. The encoder buffer 3 temporarily stores the video stream output from the encoding unit 2 and then outputs it.

制御部4は、エンコーダバッファ3の使用率又は外部からのモード強制指示に応じて、直前のフィールドと同じ読み出しアドレスをビデオバッファ1に繰り返し供給する。これにより、制御部4は、映像信号の同一フィールドをビデオバッファ1から繰り返し読み出して符号化部2により符号化させるリピート処理の方式を、エンコーダバッファ3の使用率又は外部からのモード強制指示に応じて切り替える。   The control unit 4 repeatedly supplies the video buffer 1 with the same read address as that of the immediately preceding field in accordance with the usage rate of the encoder buffer 3 or an external mode forced instruction. As a result, the control unit 4 determines the repeat processing method in which the same field of the video signal is repeatedly read from the video buffer 1 and encoded by the encoding unit 2 in accordance with the usage rate of the encoder buffer 3 or the mode forcing instruction from the outside. To switch.

図2は、従来の一般処理の方式を示す図である。エンコーダバッファ3の使用率が80%未満の場合、各フィールドが格納された順にビデオバッファ1から読み出される。なお、従来の方式において符号量を低減させる場合、主にQP値等を上げて符号量を抑制するため、映像は劣化する。   FIG. 2 is a diagram showing a conventional general processing method. When the usage rate of the encoder buffer 3 is less than 80%, the fields are read from the video buffer 1 in the order in which they are stored. Note that when the code amount is reduced in the conventional method, the video amount deteriorates mainly because the code amount is suppressed by increasing the QP value or the like.

符号化において、上位フィールドのIピクチャ直後の下位フィールドのPピクチャはIピクチャ(T2)のみを参照する。その他のPピクチャは直前のIピクチャ又はPピクチャの2フィールドを参照する。例えば、Pピクチャ(B5)は2つのPピクチャ(T5,B2)を参照する。Bピクチャは、直前のIピクチャ又はPピクチャとその前のIピクチャ又はPピクチャの4フィールドを参照する。例えば、Bピクチャ(B6)は4つのPピクチャ(T5,B5,T8,B8)を参照する。   In encoding, the P picture in the lower field immediately after the I picture in the upper field refers only to the I picture (T2). Other P pictures refer to two fields of the immediately preceding I picture or P picture. For example, the P picture (B5) refers to two P pictures (T5, B2). The B picture refers to the four fields of the immediately preceding I picture or P picture and the preceding I picture or P picture. For example, the B picture (B6) refers to four P pictures (T5, B5, T8, B8).

図3は、リピート処理の第1の方式を示す図である。エンコーダバッファ3の使用率が80%以上かつ90%未満の場合、符号量を低減させるために、制御部4は映像信号の上位フィールドを1回繰り返してビデオバッファ1から読み出して符号化部2により符号化させる。その際に読み出す予定だった下位フィールドは捨てるため、ピクチャ数は増えない。例えばT2を繰り返し読み出し、B2は読み出さずに捨てる。   FIG. 3 is a diagram illustrating a first method of repeat processing. When the usage rate of the encoder buffer 3 is 80% or more and less than 90%, the control unit 4 reads the upper field of the video signal once from the video buffer 1 and reduces the code amount by the encoding unit 2. Encode. Since the lower field that was scheduled to be read at that time is discarded, the number of pictures does not increase. For example, T2 is repeatedly read and B2 is discarded without being read.

符号化において、Iピクチャ直後の下位フィールドのPピクチャ(T2)は、参照するIピクチャ(T2)と同じ映像であるため、符号量を低減することができる。また、下位フィールドのPピクチャ(T5)は、参照する上位フィールドのPピクチャ(T5)と同じ映像であるため、符号量を低減することができる。   In encoding, since the P picture (T2) in the lower field immediately after the I picture is the same video as the I picture (T2) to be referenced, the amount of codes can be reduced. Further, since the P picture (T5) of the lower field is the same video as the P picture (T5) of the upper field to be referred to, the code amount can be reduced.

Bピクチャは他のBピクチャを参照できないため、上位フィールドのBピクチャと同じピクチャにする意味が無い。そこで、映像をリピートするピクチャタイプがBピクチャにならないようにする必要がある。   Since the B picture cannot refer to other B pictures, there is no point in making the same picture as the B picture in the upper field. Therefore, it is necessary to prevent the picture type for repeating video from being a B picture.

このように映像信号の同一フィールドを繰り返し読み出して符号化させることにより、符号量を低減することができる。そして、従来の方式に比べて符号量制御によるQP値等の上昇を抑えることができるため、映像の劣化を避けることができる。   Thus, the code amount can be reduced by repeatedly reading and encoding the same field of the video signal. Since the increase in the QP value and the like due to the code amount control can be suppressed as compared with the conventional method, the deterioration of the video can be avoided.

図4は、リピート処理の第2の方式を示す図である。エンコーダバッファ3の使用率が90%以上の場合、制御部4は映像信号の上位フィールドを3回以上の奇数回繰り返してビデオバッファ1から読み出して符号化部2により符号化させる。例えばT2を3回繰り返し読み出し、B2,T3,B3は読み出さずに捨てる。   FIG. 4 is a diagram illustrating a second method of repeat processing. When the usage rate of the encoder buffer 3 is 90% or more, the control unit 4 reads out the upper field of the video signal from the video buffer 1 by repeating it three times or more odd times and causes the encoding unit 2 to encode it. For example, T2 is read three times, and B2, T3, and B3 are discarded without being read.

第1の方式と同様に、Iピクチャ直後の下位フィールドのPピクチャ(T2)は、参照するIピクチャ(T2)と同じ映像であるため、符号量を低減することができる。また、下位フィールドのPピクチャ(T5)は、参照する上位フィールドのPピクチャ(T5)と同じ映像であるため、符号量を低減することができる。   Similarly to the first method, the P picture (T2) in the lower field immediately after the I picture is the same video as the I picture (T2) to be referred to, and therefore the code amount can be reduced. Further, since the P picture (T5) of the lower field is the same video as the P picture (T5) of the upper field to be referred to, the code amount can be reduced.

Bピクチャは、直前のIピクチャ又はPピクチャとその前のIピクチャ又はPピクチャの4フィールドを参照する。従って、その4フィールドのどれかが同じ映像だと符号量を低減することができる。   The B picture refers to the four fields of the immediately preceding I picture or P picture and the preceding I picture or P picture. Therefore, the code amount can be reduced if any of the four fields is the same video.

このように映像信号の上位フィールドを3回以上の奇数回繰り返して符号化させることにより、第1の方式よりも符号量を低減することができる。そして、従来の方式と比べて符号量制御によるQP値等の上昇を抑えることができるため、映像の劣化を避けることができる。   In this way, by encoding the upper field of the video signal by repeating the odd number of times three or more times, the code amount can be reduced as compared with the first method. And since the increase of QP value etc. by code amount control can be suppressed compared with the conventional system, degradation of a video can be avoided.

なお、第2の方式において、繰り返しできる最大の回数はビデオバッファ量に依存する。また、95%未満は3回、95%以上は5回繰り返すなど、使用率が増えるほど繰り返し回数を増やすこともできる。   In the second method, the maximum number of repetitions depends on the video buffer amount. Further, the number of repetitions can be increased as the usage rate increases, such as 3 times less than 95% and 5 times more than 95%.

以上説明したように、本実施の形態では、エンコーダバッファの使用率に応じたリピート処理を実施することができる。第1、第2の方式の順に同一フィールドの使用が増えるが、エンコーダバッファの使用率を低減して画像の乱れを防ぐことができる。   As described above, in the present embodiment, it is possible to perform repeat processing according to the usage rate of the encoder buffer. Although the use of the same field increases in the order of the first and second methods, it is possible to reduce the usage rate of the encoder buffer and prevent image distortion.

1 ビデオバッファ、2 符号化部、3 エンコーダバッファ、4 制御部 1 video buffer, 2 encoding unit, 3 encoder buffer, 4 control unit

Claims (2)

入力された映像信号を格納するビデオバッファと、
前記ビデオバッファから読み出された前記映像信号を符号化する符号化部と、
前記符号化部から出力されたビデオストリームを格納するエンコーダバッファと、
前記映像信号の上位フィールドのIピクチャまたはPピクチャを前記ビデオバッファから繰り返し読み出して前記符号化部により符号化させるリピート処理の方式を前記エンコーダバッファの使用率に応じて切り替える制御部とを備えることを特徴とする符号化装置。
A video buffer for storing the input video signal;
An encoding unit for encoding the video signal read from the video buffer;
An encoder buffer for storing the video stream output from the encoding unit;
A control unit that switches a repeat processing method in which an I picture or a P picture of an upper field of the video signal is repeatedly read from the video buffer and encoded by the encoding unit according to a usage rate of the encoder buffer. A characteristic encoding apparatus.
前記エンコーダバッファの使用率が第1の閾値以上かつ第2の閾値未満の場合、前記制御部は前記映像信号の上位フィールドのIピクチャまたはPピクチャを1回繰り返して前記ビデオバッファから読み出して前記符号化部により符号化させ、
前記エンコーダバッファの使用率が前記第2の閾値以上の場合、前記制御部は前記映像信号の上位フィールドのIピクチャまたはPピクチャを3回以上の奇数回繰り返して前記ビデオバッファから読み出して前記符号化部により符号化させることを特徴とする請求項1に記載の符号化装置。
When the usage rate of the encoder buffer is greater than or equal to a first threshold value and less than a second threshold value, the control unit repeatedly reads the I picture or P picture of the upper field of the video signal once from the video buffer and reads the code Encoding by the encoding unit,
When the usage rate of the encoder buffer is equal to or greater than the second threshold, the control unit reads out the I-picture or P-picture of the upper field of the video signal from the video buffer by repeating the odd-numbered times of three or more times from the video buffer. The encoding device according to claim 1, wherein the encoding is performed by a unit.
JP2014557241A 2013-01-17 2013-01-17 Encoder Active JP6011641B2 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2013/050807 WO2014112071A1 (en) 2013-01-17 2013-01-17 Encoding device

Publications (2)

Publication Number Publication Date
JP6011641B2 true JP6011641B2 (en) 2016-10-19
JPWO2014112071A1 JPWO2014112071A1 (en) 2017-01-19

Family

ID=51209194

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014557241A Active JP6011641B2 (en) 2013-01-17 2013-01-17 Encoder

Country Status (2)

Country Link
JP (1) JP6011641B2 (en)
WO (1) WO2014112071A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005094546A (en) * 2003-09-19 2005-04-07 Hitachi Kokusai Electric Inc Moving image compression equipment
JP2008005163A (en) * 2006-06-21 2008-01-10 Matsushita Electric Ind Co Ltd Image coding apparatus and image coding method
JP2010213187A (en) * 2009-03-12 2010-09-24 Mitsubishi Electric Corp Video coding transmission apparatus

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005094546A (en) * 2003-09-19 2005-04-07 Hitachi Kokusai Electric Inc Moving image compression equipment
JP2008005163A (en) * 2006-06-21 2008-01-10 Matsushita Electric Ind Co Ltd Image coding apparatus and image coding method
JP2010213187A (en) * 2009-03-12 2010-09-24 Mitsubishi Electric Corp Video coding transmission apparatus

Also Published As

Publication number Publication date
JPWO2014112071A1 (en) 2017-01-19
WO2014112071A1 (en) 2014-07-24

Similar Documents

Publication Publication Date Title
US10382778B2 (en) Method for motion vector storage in video coding and apparatus thereof
RU2654129C2 (en) Features of intra block copy prediction mode for video and image coding and decoding
JP5285682B2 (en) Image coding apparatus and image coding method
US9826245B2 (en) Method, apparatus and recording medium for encoding/decoding using parallel processing of image tiles
US9641850B2 (en) Video compression device
US10298931B2 (en) Coupling sample metadata with media samples
JP2016506698A (en) Syntax and semantics for buffering information that simplify video splicing
JP2009021907A (en) Moving image encoding apparatus and method
JP6129574B2 (en) Image processing device
JP2015012410A (en) Image decoder
US9641867B2 (en) Image processor
US10027969B2 (en) Parallel decoder with inter-prediction of video pictures
KR101528269B1 (en) A method for playing a moving picture
JP6011641B2 (en) Encoder
US20140105306A1 (en) Image processing apparatus and image processing method
US20160014415A1 (en) Method and apparatus for performing wave-front parallel encoding procedure with constraint on coding mode and/or quantization parameter selection
JP5845202B2 (en) Image compression apparatus and image processing system
JP2016005245A (en) Encoding device, decoding device, encoding method and decoding method
CN105323587B (en) The image outgoing management method and device of video, the method for transmitting video code flow
JP2011109364A (en) Image processing apparatus
JP2009017472A (en) Image decoding unit and image decoding method
JP2008311824A (en) Image encoding device, and image encoding program
JP2012151690A (en) Deblocking filter device, deblocking filter processing method, and encoding device and decoding device using the same
JP2011205476A (en) Moving image encoding apparatus and moving image encoding method
US20170055001A1 (en) Image encoding apparatus and image decoding apparatus

Legal Events

Date Code Title Description
TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20160823

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20160905

R150 Certificate of patent or registration of utility model

Ref document number: 6011641

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250