Subset selection with structured dictionaries in classification

Tam metin

(1)15th European Signal Processing Conference (EUSIPCO 2007), Poznan, Poland, September 3-7, 2007, copyright by EURASIP. 68%6(76(/(&7,21:,7+6758&785('',&7,21$5,(6,1&/$66,),&$7,21 1XUL),QFH)LNUL*RNVX$KPHG+7HZILN,EUDKLP2QDUDQ$(QLV&HWLQ . 'HSDUWPHQWRI(OHFWULFDODQG&RPSXWHU(QJLQHHULQJ8QLYHUVLW\RI0LQQHVRWD 8QLRQ6W6(0LQQHDSROLV86$ SKRQH

(2) ID[

(3) HPDLOILUDW#XPQHGX 'HSDUWPHQWRI(OHFWULFDODQG(OHFWURQLFV(QJLQHHULQJ%LONHQW8QLYHUVLW\$QNDUD7XUNH\ . $%675$&7 7KLV SDSHU GHVFULEHV D QHZ DSSURDFK IRU WKH VHOHFWLRQ RI GLVFULPLQDQW WLPHIUHTXHQF\ IHDWXUHV IRU FODVVLILFDWLRQ 8QOLNHSUHYLRXVDSSURDFKHVWKDWXVHWKHLQGLYLGXDOGLVFULPL QDWLRQ SRZHU RI H[SDQVLRQ FRHIILFLHQWV WKH SURSRVHG DS SURDFKVHOHFWVDVXEVHWRIIHDWXUHVE\LPSOHPHQWLQJDFODVVL ILHUGLUHFWHGSUXQLQJRIDQLQLWLDOUHGXQGDQWVHWRIFDQGLGDWH IHDWXUHV7KHFDQGLGDWHIHDWXUHVDUHFDOFXODWHGIURPDVWUXF WXUHG UHGXQGDQW WLPHIUHTXHQF\ DQDO\VLV RI WKH VLJQDO VXFK DVDQXQGHFLPDWHGZDYHOHWWUDQVIRUP:HVKRZWKDWWKHSUR SRVHGDSSURDFKKDVDSHUIRUPDQFHWKDWLVDVJRRGDVRUEHW WHU WKDQ WUDGLWLRQDO FODVVLILFDWLRQ DSSURDFKHV ZKLOH XVLQJ D PXFK VPDOOHU QXPEHU RI IHDWXUHV ,Q SDUWLFXODU ZH SURYLGH H[SHULPHQWDO UHVXOWV WR GHPRQVWUDWH WKH VXSHULRU SHUIRUP DQFHRIWKHDOJRULWKPLQWKHDUHDRILPSDFWDFRXVWLFFODVVLIL FDWLRQ IRU IRRG NHUQHO LQVSHFWLRQ 7KH SURSRVHG DOJRULWKP DFKLHYHGDQGFODVVLILFDWLRQDFFXUDFLHVLQVHSD UDWLQJ RSHQ VKHOO IURP FORVHG VKHOO SLVWDFKLR QXWV DQG GLV FULPLQDWLQJ EHWZHHQ HPSW\ DQG IXOO KD]HOQXWV UHVSHFWLYHO\ 7UDGLWLRQDO PHWKRGV XVHG LQ WKLV DUHD UHVXOWHG LQ DQG FODVVLILFDWLRQDFFXUDFLHVUHVSHFWLYHO\ ,1752'8&7,21 7KH WLPHIUHTXHQF\ WI

(4) FRQWHQW RI WKH VLJQDO SURYLGHV LP SRUWDQWLQIRUPDWLRQIRUFODVVLILFDWLRQ6LQFHWKHWISODQHLVD KLJKGLPHQVLRQDOVSDFHXVLQJDOOIHDWXUHVIURPWKLVSODQHLV QRWDJRRGVWUDWHJ\,QWKHODVWVHYHUDO\HDUVWKHUHKDVEHHQD JURZLQJLQWHUHVWWRH[SORUHWKHWLPHIUHTXHQF\SODQHIRUFODV VLILFDWLRQE\XVLQJDGDSWLYHVWUDWHJLHV7KHORFDOGLVFULPLQDQW EDVLV DQ DOJRULWKP RI >@ KDVEHHQ SURSRVHG WR DFKLHYH WKLV WDVN 7KH /'% DOJRULWKP ILUVW UHSUHVHQWV D JLYHQ VLJQDO IRU HDFKFODVVLQDUHGXQGDQWPDQQHURYHUDVLQJOHS\UDPLGDOWUHH VWUXFWXUHE\XVLQJZDYHOHWSDFNHWVRUFRVLQHSDFNHWV,QRUGHU WRILQGDFRPSOHWHUHSUHVHQWDWLRQRIWKHVLJQDOVLQWKLVUHGXQ GDQWGLFWLRQDU\DERWWRPWRWRSSUXQLQJDOJRULWKPLVLPSOH PHQWHG7KHQWKHHQHUJLHVRIH[SDQVLRQFRHIILFLHQWVEHWZHHQ FODVVHVLQHDFKQRGHRIWKHWUHHVWUXFWXUHDUHHYDOXDWHGE\D FRVW IXQFWLRQ %DVHG RQ WKH GLIIHUHQFHV EHWZHHQ WKH FODVVHV WKH S\UDPLGDO WUHH VWUXFWXUH LV SUXQHG IURP ERWWRP WR WRS VXFKWKDWWKHGLVFULPLQDWLRQSRZHUEHWZHHQH[SDQVLRQFRHI ILFLHQWVLQWKHQRGHVRIWKHWUHHLVPD[LPL]HG . 3UXQHG7UHH DUJ PD[ ' \ M N

(5) . ©2007 EURASIP. 1877. ZKHUH WKH \ M N LV WKH GXDO WUHH VWUXFWXUH ZLWK IUHTXHQF\ M DQGWLPHNLQGLFHVDQG'LVDFRVWIXQFWLRQ2QFHWKHWUHHLV SUXQHG D FRPSOHWH UHSUHVHQWDWLRQ RI WKH VLJQDO LV REWDLQHG ZKLFKLVWXQHGIRUGLVFULPLQDWLRQ7KLVLVIROORZHGE\VRUWLQJ WKH H[SDQVLRQ FRHIILFLHQWV DFFRUGLQJ WR WKHLU GLVFULPLQDWLRQ SRZHUDQGLQSXWWLQJDWRSVXEVHWWRDFODVVLILHUIRUILQDOGHFL VLRQ7KLVSRZHUIXOPHWKRGKDVEHHQXVHGLQVHYHUDODSSOLFD WLRQV VXFK DV ((* DQG (0* FODVVLILFDWLRQ DQG VXFFHVVIXO UHVXOWV KDYH EHHQ REWDLQHG > @ +RZHYHU WKH /'% DOJR ULWKP KDV PDQ\ GUDZEDFNV )LUVW WKH ZDYHOHW SDFNHWV :3

(6) FRVLQH SDFNHWV &3

(7) ZKLFK DUH XVHG WR UHSUHVHQW WKH VLJQDOLQWKHQRGHVRIWKHWUHHVWUXFWXUHGRQRWVDWLVI\WKHVKLIW LQYDULDQFH SURSHUW\ %ULHIO\ D VKLIW LQ WKH VLJQDO JHQHUDWHV XQSUHGLFWDEOH FKDQJHV LQ WKH H[SDQVLRQ FRHIILFLHQWV 7KLV EHKDYLRU LV QRW DSSURSULDWH IRU SDWWHUQ UHFRJQLWLRQ DSSOLFD WLRQV)XUWKHUPRUHVLQFHDVLQJOHWUHHLVXVHGWKLVDOJRULWKP FDQRQO\DGDSWDORQJDVLQJOHD[LVVXFKDVHLWKHUWLPHRUIUH TXHQF\6HYHUDOVWXGLHVKDYHVKRZQWKDWWKHDGDSWDWLRQDORQJ ERWK D[HV LV FUXFLDO >@ ,Q DGGLWLRQ WR WKLV SRVW SURFHVVLQJ PHWKRGVVXFKDV3&$KDVEHHQDSSOLHGRQWKHVRUWHGH[SDQ VLRQ FRHIILFLHQWV WR LPSURYH WKH FODVVLILFDWLRQ DFFXUDF\ >@ )LQDOO\WKHSUXQLQJDQGIHDWXUHVRUWLQJVWDJHVGRQRWDFFRXQW IRU WKH LQWHUDFWLRQVUHODWLRQV LQ EHWZHHQ GLIIHUHQW WI FHOOV 7KH REWDLQHG FRPSOHWH UHSUHVHQWDWLRQ PD\ QRW EH WKH EHVW VXEVHWIRUWKHFODVVLILHU ,QWKLVSDSHUZHWDFNOHWKHVHSUREOHPVE\LQWURGXFLQJDVWUXF WXUHGVXEVHWVHOHFWLRQDSSURDFKZKLFKLVEDVHGRQWKHHYDOXD WLRQ RI WKH UHDO FODVVLILFDWLRQ SHUIRUPDQFH RI WKH VHOHFWHG VXEVHWVRIIHDWXUHV8QOLNHSULRUPHWKRGVRXUDSSURDFKLVD ZUDSSHU PHWKRG WKDW LPSOHPHQWV D FODVVLILHU GLUHFWHG SUXQ LQJRIDKLJKO\UHGXQGDQWVHWRIIHDWXUHVDVVKRZQLQ)LJXUH 7KH IHDWXUHV DUH REWDLQHG E\ FRPSXWLQJ D UHGXQGDQW WI DQDO\VLV RI VLJQDOV VXFK DV DQ XQGHFLPDWHG ZDYHOHW WUDQV IRUP 8':7

(8) RYHUDGXDOWUHHVWUXFWXUH$VFRPSDUHGWRWKH GHFLPDWHGZDYHOHWWUDQVIRUP :7

(9) WKH8':7\LHOGVDVKLIW LQYDULDQW VLJQDO UHSUHVHQWDWLRQ ,Q >@ WKH DXWKRU KDV VKRZQ WKDW WKH FODVVLILFDWLRQ UHVXOWV REWDLQHG ZLWK 8':7 LV VXSH ULRUWR:7$EORFNGLDJUDPVXPPDUL]LQJRXUSURSRVHGDS SURDFKLVJLYHQLQ)LJXUH:HVKRZWKDWRXUSURSRVHGDS SURDFKDFKLHYHVVLPLODURUEHWWHUSHUIRUPDQFHWKDQWUDGLWLRQDO DSSURDFKHV ZKLOH XVLQJD PXFK VPDOOHU QXPEHU RI IHDWXUHV +HUH ZH LOOXVWUDWH WKLV E\ WHVWLQJ RXU SURSRVHG DSSURDFK LQ WZRLPSDFWDFRXVWLFFODVVLILFDWLRQSUREOHPVIRUIRRGVDIHW\ 7KH SDSHU LV RUJDQL]HG DV IROORZV 'HWDLOV RI RXU DSSURDFK DUH DYDLODEOH LQ WKH IROORZLQJ VHFWLRQV 6HFWLRQ GHVFULEHV.

(10) 15th European Signal Processing Conference (EUSIPCO 2007), Poznan, Poland, September 3-7, 2007, copyright by EURASIP. )LJXUH7KHEORFNGLDJUDPRIWKHSURSRVHGFODVVLILFDWLRQPHWKRG. WKH H[WUDFWLRQ RI WLPH IUHTXHQF\ IHDWXUHV XVLQJ GRXEOH WUHH XQGHFLPDWHGZDYHOHWWUDQVIRUP7KHVHDUFKIRUWKHEHVWFRP ELQDWLRQVRIIHDWXUHVFRPSULVHV6HFWLRQ%RWKJUHHG\VHDUFK DQG SUXQLQJ XVLQJ WKH GRXEOH WUHH VWUXFWXUH ZLWK FODVVLILHU IHHGEDFN DQG DQRWKHU DOWHUQDWLYH ZLWKRXW IHHGEDFN DUH FRQ VLGHUHGKHUHIRUIHDWXUHVHOHFWLRQ6HFWLRQLQFOXGHVWKHPD WHULDOVXVHGWRUHFRUGQXWVVRXQGVLJQDOVIURPLPSDFWDFRXV WLFV ,Q 6HFWLRQ ZH UHSRUW WKH H[SHULPHQWDO UHVXOWV DQG FRPSDUHWKHPZLWKSUHYLRXVO\DYDLODEOHRQHV *(1(5$7,212)6758&785('',&7,21$5,(6. /HWXVKHUHGHVFULEHWKHUHGXQGDQWGXDOWUHHVWUXFWXUHZKHUH D VFKHPDWLF GLDJUDP LV DOVR JLYHQ LQ )LJ 7KH GXDO WUHH IHDWXUH GLFWLRQDU\ LV FRQVWUXFWHG E\ XVLQJ DQ XQGHFLPDWHG ZDYHOHWWUDQVIRUPZKLFKSURYLGHVDS\UDPLGDOVXEEDQGWUHH ZLWKGLIIHUHQWIUHTXHQF\UHVROXWLRQV,QHDFKVXEEDQGDQWKRU S\UDPLGDO WUHH LV XWLOL]HG WR REWDLQ IHDWXUHV ZLWK GLIIHUHQW WLPHUHVROXWLRQ7KHGHWDLOVRIREWDLQLQJWKHWLPHIUHTXHQF\ IHDWXUHVZLWKGLVWLQFWUHVROXWLRQVDUHGHVFULEHGLQWKHIROORZ LQJVHFWLRQ 8QGHFLPDWHG:DYHOHW7UDQVIRUP 'LVFUHWH :DYHOHW 7UDQVIRUP ':7

(11) DQG LWV YDULDQWV KDYH EHHQ H[WHQVLYHO\ XVHG LQ ' DQG ' VLJQDO DQDO\VLV >@ +HUH ZH FRQVLGHU WKH EDQG ':7 ,Q WKH EDQG V\VWHP HDFKRXWSXWRIWKHILOWHUV VXEEDQG

(12) LVGRZQVDPSOHGE\IRU FULWLFDOVDPSOLQJ,QRXULPSOHPHQWDWLRQRIWKH':7GRZQ VDPSOLQJ LV UHPRYHG WR PDNH WKH 8':7 VKLIW LQYDULDQW 7KLVPHDQVWKDWWKHQXPEHURIVDPSOHVLQDVXEEDQGDWDQ\ OHYHOLVVDPHDVWKDWRILQWKHRULJLQDOVLJQDO7KHRXWSXWDW DQ\ OHYHO FDQ EH FRPSXWHG E\ XVLQJ DQ DSSURSULDWH ILOWHU GHULYHGIURPWKHZDYHOHWWUHHVWUXFWXUH:HILQGWKHHTXLYD OHQWILOWHUIRUHDFKVXEEDQGXVLQJRQHRIWKH1REOHLGHQWLWLHV ZKLFKLQYROYHVGRZQVDPSOLQJ o p . o / ]

(13) RU+ ]

(14) o{o / ] .

(15) RU+ ] .

(16) o p .

(17) . ,Q PDWKHPDWLFDO IRUP ZKDW ZH DUH ORRNLQJ IRU LV DV LQ WKH IROORZLQJH[DPSOHJLYHQWKH=WUDQVIURPRIORZSDVVILOWHU / ]

(18) DQG KLJK SDVV ILOWHU + ]

(19) ZKDW ZLOO EH WKH HTXLYDOHQW ILOWHUFRUUHVSRQGLQJWRRQHRIWKHVXEEDQGVDWWKHUGOHYHO" 7KLVPHDQVWKDWWKLVVXEEDQGLVFRPSXWHGXVLQJWKUHHILOWHUV HDFKRI ZKLFKLVHLWKHU / ]

(20) RU+ ]

(21) $VVXPH WKH\DUH/ ]

(22) + ]

(23) DQG/ ]

(24) UHVSHFWLYHO\:HKDYH ; ]

(25) o / ]

(26) o p o + ]

(27) o p o / ]

(28) o p o < ]

(29). ©2007 EURASIP.

(30) . 1878. )LJXUH'XDOWUHHVWUXFWXUH. . $QGZHZDQWWRILQGDQ0 ]

(31) VXFKWKDWWKHIROORZLQJKROGV ; ]

(32) o 0 ]

(33) o p o < ]

(34) .

(35) . 8VLQJ WKH 1REOH LGHQWLW\ WZLFH DSSURSULDWHO\ ZH UHDFK WKH IROORZLQJHTXLYDOHQWLQSXWRXWSXWUHODWLRQVKLS ; ]

(36) o / ]

(37) + ]

(38) / ]

(39) o p o < ]

(40) .

(41) . 7KLV PHDQV 0 ]

(42) / ]

(43) + ]

(44) / ]

(45) DQG ZH FDQ ILQG FRUUH VSRQGLQJ ILOWHU P>Q@ LQ WKH WLPH GRPDLQ HDVLO\ ,Q WKH ZD\ H[SODLQHG DERYH ZH NHHS WKH RXWSXW ULJKW DIWHU WKH HTXLYD OHQW ILOWHU 0 ]

(46) EHIRUH WKH GRZQ VDPSOLQJ 7KLV FRQVWLWXWHV WKHIUHTXHQF\EUDQFKRIWKHGXDOWUHH8':7 '\DGLF7LPH6HJPHQWDWLRQ 2QHFDQXVHWKH8':7FRHIILFLHQWVLQHDFKVXEEDQG+RZ HYHUVLQFHWKLVFDXVHVDKLJKGLPHQVLRQDOVSDFHWKLVLVQRWD SUDFWLFDO DSSURDFK ,Q RUGHU WR GHFUHDVH WKH GLPHQVLRQDOLW\ DQGSUHVHUYHWKHHQHUJ\EDVHGLQIRUPDWLRQLQHDFKVXEEDQG OLNH LQ WKH IUHTXHQF\ GHFRPSRVLWLRQ WUHH HYHU\ VXEEDQG LV VHJPHQWHGLQWRWLPHVHJPHQWVDWHDFKOHYHOZLWKDS\UDPLGDO WUHHVWUXFWXUHVXFFHVVLYHO\,QHDFKWLPHVHJPHQWWKHVXPRI WKHVTXDUHV RI WKHVDPSOHV HQHUJ\ LVFRPSXWHG DVRQH IHD WXUH WR EH XVHG LQ RIIOLQH WUDLQLQJ 7KH WLPH VHJPHQWDWLRQ H[SODLQHGDERYHIRUPVWKHVHFRQGEUDQFKRIWKHGRXEOHWUHH )URPQRZRQZHNHHSWKHLQGH[LQIRUPDWLRQRIWKHGXDOWUHH VWUXFWXUHWREHXVHGLQWKHODWHUVWDJHIRUGLPHQVLRQUHGXFWLRQ YLDSUXQLQJ 7RVXPPDUL]HWKLVVHFWLRQWKHUHDGHULVUHIHUUHGWRWKHGRX EOHWUHHVWUXFWXUHLQ)LJXUH7KLVGRXEOHWUHHXVHVOHYHOLQ ERWK SODQHV 7KH YHUWLFDO PLGGOH ER[HV DUH WKH IUHTXHQF\ VXEEDQGV %R[ UHSUHVHQWVXQILOWHUHG RULJLQDOVLJQDOER[ UHSUHVHQWV ORZ SDVV ILOWHUHG VLJQDO DQG ER[ KLJK SDVV ILO WHUHG VLJQDO (DFK RI WKHVH VXEEDQGV DUH VHJPHQWHG LQ WLPH LQWRVHJPHQWVDVVKRZQ6HJPHQWFRYHUVWKHZKROHVXE EDQGVHJPHQWFRYHUVWKHILUVWKDOIRILWDQGVHJPHQWWKH VHFRQGSDUWRILW3OHDVHQRWHWKDW7KHGXDOWUHHVWUXFWXUHVDW LVILHVWKHVHWZRFRQGLWLRQV )RUDVHOHFWHGQRGHLQWKHIUHTXHQF\WUHHPRWKHUEDQGFRY HUVWKHVDPHIUHTXHQF\EDQGZLGWK %:

(47) RILWVFKLOGUHQ. %:0RWKHU %:&KLOG %:&KLOG

(48) .

(49) . 7KLVVDPHFRQGLWLRQLVDOVRVDWLVILHGLQWLPHD[LV)RUDVH OHFWHG QRGH WKH QXPEHU RI WLPH VDPSOHV 76

(50) RI PRWKHU LV HTXDOWRWKHQXPEHURILWVFKLOGUHQ.

(51) 15th European Signal Processing Conference (EUSIPCO 2007), Poznan, Poland, September 3-7, 2007, copyright by EURASIP. 76 0RWKHU 76&KLOG 76&KLOG

(52) .

(53) . 7KHVHWZRSURSHUWLHVDOORZXVWRSUXQHWKHWUHHVWUXFWXUH7KH SDUDPHWHUVIRUGHFLGLQJWKHQXPEHURIIHDWXUHVDUHWKHQXP EHURIOHYHOVIRUIUHTXHQF\DQGWLPHVHJPHQWDWLRQ/HW7EH WKHQXPEHURIOHYHOVLQWLPHDQG)WKHQXPEHUOHYHOVLQIUH TXHQF\WKHUHZLOOEH )

(54) VXEEDQGV LQFOXGLQJWKHRULJLQDO VLJQDO

(55) DQG 7

(56) WLPH VHJPHQWV IRU HDFK VXEEDQG 7KLV ZLOOPDNHWKHWRWDOQXPEHURIIHDWXUHV )

(57)

(58) [ 7

(59)

(60) 68%6(76(/(&7,21 $VHPSKDVL]HGEHIRUHWKHVHOHFWLRQRIIHDWXUHVIURP D UHGXQGDQW GLFWLRQDU\ LV FULWLFDO 7KH UHGXQGDQF\ FRPHV IURPERWKWKH8':7FRHIILFLHQWVDQGGXDOWUHHVWUXFWXUH$V H[SODLQHG LQ WKH SUHYLRXV VHFWLRQ WKH GXDO WUHH KDV WRWDO 1) )

(61)

(62) [ 7

(63)

(64) QXPEHU RI IHDWXUHV IRU HDFK VRXQG VLJQDOZKHUH)LVWKHIUHTXHQF\OHYHODQG7LVWKHWLPHOHYHO 7KH/'%DSSURDFKXVHVIHDWXUHVRUWLQJDIWHUSUXQLQJZKLFK GRHVQRWDFFRXQWIRUWKHLQWHUUHODWLRQVEHWZHHQIHDWXUHV)XU WKHUPRUH WKH VXEVHW RI D JLYHQ IHDWXUH RUGHU ZKLFK LV RE WDLQHGZLWKDFRVWIXQFWLRQLVQRWQHFHVVDULO\WKHEHVWVXEVHW IRU WKH FODVVLILHU +HUH ZH UHVKDSH WKH VWUDWHJ\ IRU IHDWXUH VHOHFWLRQE\HYDOXDWLQJWKHDFWXDOFODVVLILFDWLRQSHUIRUPDQFH :HTXDQWLI\WKHHIILFLHQF\RIHDFKIHDWXUHVHWE\HYDOXDWLQJ LWVFODVVLILFDWLRQDFFXUDF\E\DFRVWPHDVXUHDQGZHXVHWKLV FRVWWRUHIRUPXODWHRXUGLFWLRQDU\ 7KUHHGLIIHUHQWW\SHVRIPHWKRGVDUHFRQVLGHUHGIRU IHDWXUHVHOHFWLRQ7KHVWUXFWXUHLQ)LJXUHLVJHQHUDOIRUDOO WKUHHPHWKRGVZLWKVOLJKWYDULDWLRQV7KHOHIWPRVWER[LVWKH GLFWLRQDU\RIIHDWXUHYHFWRUV /'$

(65) RQWKHULJKWLVXVHGERWK IRUFODVVLILFDWLRQDQGH[WUDFWLQJWKHUHODWLRQVKLSDPRQJFRP ELQDWLRQVRIIHDWXUHV7KLVRXWSXWLVIHGWRDFRVWIXQFWLRQWR PHDVXUH WKH GLVFULPLQDWLRQ SRZHU IRU WKDW FRPELQDWLRQ RI IHDWXUHVEHWZHHQFODVVHV7KLVPHDVXUHZLOOEHXVHGWRVHOHFW WKH EHVW IHDWXUH FRPELQDWLRQ DPRQJ RWKHU IHDWXUH FRPELQD WLRQV ,Q WKLV SDUWLFXODU VWXG\ )LVKHU 'LVFULPLQDWLRQ )'

(66) IXQFWLRQLVXVHGDVDFRVWIXQFWLRQ7KHWKUHHGLIIHUHQWVWUDWH JLHVDVH[SODLQHGDERYHDUH x 7\SH, 6HTXHQWLDOO\ VHOHFW IHDWXUHV IURP WKH GLFWLRQ DU\ E\ HYDOXDWLQJ WKHLU FODVVLILFDWLRQ SHUIRUPDQFH ZLWKDFRVWIXQFWLRQ x 7\SH,,6HTXHQWLDOO\VHOHFWIHDWXUHVIURPWKHGLFWLRQ DU\ E\ HYDOXDWLQJ WKHLU FODVVLILFDWLRQ SHUIRUPDQFH ZLWK D FRVW IXQFWLRQ ,Q HDFK VWHS WKH GLFWLRQDU\ LV SUXQHGIRUWKHVHOHFWHGLQGH[ x 7\SH,,, 3UXQH WKH GXDO WUHH XVLQJ WKH ROG /'% DS SURDFKEDVHGVHTXHQWLDOIHDWXUHVHOHFWLRQ 7\SH, 7\SH,LVD6HTXHQWLDO)RUZDUG6HOHFWLRQ 6)6

(67) PHWKRG$OO RI WKH IHDWXUH YHFWRUV IURP WKH GLFWLRQDU\ IURP HDFK FODVV

(68) HQWHU WR WKH /'$ RQH E\ RQH DQG D FRUUHVSRQGLQJ FRVW LV PHDVXUHGIRUHDFKXVLQJWKHFRVWIXQFWLRQ$IWHUWKLVVHDUFKLV GRQHRYHUDOO1)IHDWXUHYHFWRUVWKHEHVWIHDWXUHLVVHOHFWHG E\FRPSDULQJFRVWYDOXHVRIHDFKIHDWXUHYHFWRU,QWKHQH[W VWHSWKHVHFRQGEHVWIHDWXUHYHFWRUZKLFKZLOOGRWKHEHVWLQ FRPELQDWLRQ ZLWKWKH ILUVWVHOHFWHG RQHLV VHDUFKHG RYHU WKH. ©2007 EURASIP. 1879. UHPDLQLQJ IHDWXUH YHFWRU VHW RQH E\ RQH 7KLV SURFHGXUH LV UXQ XQWLO D GHVLUHG QXPEHU RI IHDWXUHV DUH UHDFKHG 7\SH, XVHV DOO WKH ER[HV DQG FRQQHFWLRQV LQ )LJXUH H[FHSW WKH IHHGEDFN IURP WKH FRVW IXQFWLRQ WR WKH GLFWLRQDU\ 6LQFH QR GLPHQVLRQ UHGXFWLRQ LV LPSOHPHQWHG LQ WKH HQWLUH IHDWXUH VSDFHWKLVDSSURDFKKDVKLJKFRPSXWDWLRQDOFRPSOH[LW\ 7\SH,, 7\SH,,LVDZUDSSHUPHWKRGZLWKDQDGGLWLRQDOSUXQLQJPRG XOHIRUGLPHQVLRQUHGXFWLRQ$VLQW\SH,IHDWXUHYHFWRUVDUH IHG WR WKH /'$ RQH E\ RQH DQG FRUUHVSRQGLQJ FRVWV DUH PHDVXUHG%\FRPSDULQJWKHFRVWYDOXHVRYHUDOOIHDWXUHYHF WRUVWKHEHVWIHDWXUHLVVHOHFWHG $IWHU WKH ILUVW IHDWXUH LV VHOHFWHG QRZ ZH XVH WKH IHHGEDFNSDWKIURP WKH FRVW IXQFWLRQWRWKHGLFWLRQDU\ DVLQ )LJXUH7KHLQGH[RIWKHVHOHFWHGIHDWXUHFRUUHVSRQGVWRD QRGHRQWKHGRXEOHWUHHZKLFKKDVDIUHTXHQF\WUHHLQGH[DQG D WLPH WUHH LQGH[ LQ WKDW VXEEDQG ,Q WKH IUHTXHQF\ WUHH WKH QRGHV VXEEDQGV

(69) ZKLFKRYHUODSWKHVHOHFWHGIUHTXHQF\LQGH[ DUHUHPRYHG6LPLODUO\LQWKHWLPHWUHHWKHQRGHVZKLFKRYHU ODS WKH VHOHFWHG WLPH LQGH[ DUH UHPRYHG 7KLV ZD\ RQO\ ³JRRG´ SRWHQWLDO IHDWXUH YHFWRUV DUH NHSW LQ WKH GLFWLRQDU\ +HQFH WKH GLFWLRQDU\ LV SUXQHG EDVHG RQ WKH ODVW VHOHFWHG IHDWXUH1RZWKHQH[WIHDWXUHZKLFKZLOOGREHVWLQFRPELQD WLRQZLWKWKHILUVWVHOHFWHGRQHLVVHDUFKHGRQWKHSUXQHGGLF WLRQDU\ 7KLV SURFHGXUH LV UXQ XQWLO WKH GHVLUHG QXPEHU RI IHDWXUHV LV UHDFKHG 7KHUHIRUH WKH RQO\ GLIIHUHQFH EHWZHHQ W\SH ,, DQG W\SH , LV WKDW SUXQLQJ LV GRQH RQ WKH GLFWLRQDU\ EDVHGRQWKHVHOHFWHGIHDWXUHV 7\SH,,, 7KLVW\SHLVWKHVLPSOHVWRQH,WGRHVQRWXVHWKH/'$QRUD IHHGEDFN SDWK ZKHQ )LJXUH LV FRQVLGHUHG ,QVWHDG XVLQJ FRVWIXQFWLRQ)'DFRVWYDOXHLVFRPSXWHGIRUHDFKQRGHRQ WKHGRXEOHWUHHLQGLYLGXDOO\7KHQDSUXQLQJDOJRULWKPLVUXQ RQWKHGRXEOHWUHHIURPERWWRPWRWRSDFFRUGLQJWRDUXOHWR ILQG WKH QRGHV ZLWK PD[LPXP GLVFULPLQDWLRQ SRZHU PHDV XUHGE\WKH)'FRVWIXQFWLRQ $VVWDWHGEHIRUHWKHVHOHFWHGIHDWXUHVXVLQJRQHRI WKH W\SHV GHVFULEHG VR IDU DUH XVHG WR FODVVLI\ D QXW VRXQG VLJQDO LQ WKH YDOLGDWLRQ SKDVH 6HOHFWHG IHDWXUHV DUH FDOFX ODWHGRQWKHVRXQGVLJQDODQGDELQDU\GHFLVLRQLVJLYHQ &/$66,),&$7,212))22'.(51(/,03$&7 $&2867,&6 ,Q RUGHU WR HYDOXDWH WKH SHUIRUPDQFH RI WKH DGDSWLYH VXEVHW VHOHFWLRQ DSSURDFKHV ZH WHVW WKHP RQ WZR FODVVLILFDWLRQ SUREOHPV EDVHG RQ LPSDFW DFRXVWLF VLJQDOV IRU QXW NHUQHO LQVSHFWLRQDQGVHSDUDWLRQ7KHILUVWRQHLVRSHQFORVHGSLVWD FKLRVHSDUDWLRQ7KHVHFRQGRQHLVHPSW\IXOOKD]HOQXWFODVVL ILFDWLRQ 7KH TXDOLW\ RI QXW VKHOOV LV D FULWLFDO LVVXH ZKLFK PD\FDXVHORZFRQVXPHUDFFHSWDQFHLQWKHQXWLQGXVWU\)RU LQVWDQFHFORVHGVKHOOSLVWDFKLRQXWVFRXOGEHUHMHFWHGE\FRQ VXPHUV EHFDXVH WKH\ DUH GLIILFXOW WR RSHQ DQG PD\ FRQWDLQ LPPDWXUH NHUQHOV &XUUHQWO\ FORVHG VKHOO SLVWDFKLR QXWV DUH VHSDUDWHGIURPRSHQVKHOOQXWVE\PHFKDQLFDOGHYLFHV7KHVH GHYLFHV FDOOHG SLQSLFNHUV´ FDQ LQDGYHUWHQWO\ GDPDJH WKH NHUQHORIRSHQVKHOOQXWVE\LQVHUWLQJDQHHGOHLQWRWKHNHUQHO PHDW,QDGGLWLRQDFFRUGLQJWR>@DSSUR[LPDWHO\WR.

(70) 15th European Signal Processing Conference (EUSIPCO 2007), Poznan, Poland, September 3-7, 2007, copyright by EURASIP. 4. 4. x 10. 1. 0.5. ADC Readings. ADC Readings. 1. 0. −0.5. −1. 50. 100. 150. 200. x 10. 0.5. 0. −0.5. −1. 250. 50. Samples. 150. 200. 250. Samples. . 0.8. 0.6. 0.6. 0.4 0.2 0 −0.2 −0.4. . E

(71) . 0.8. ADC Readings. ADC Readings. D

(72) . 100. 0.4 0.2 0 −0.2 −0.4. −0.6 100. 200. 300. Samples. 400. 500. −0.6. 100. 200. 300. 400. 500. Samples. F

(73) G

(74) )LJXUH 6DPSOH LPSDFW DFRXVWLF VLJQDOV D

(75) 2SHQ DQG E

(76) &ORVHGSLVWDFKLRDFRXVWLF F

(77) (PSW\DQG G

(78) )XOOKD]HOQXWVDFRXV WLF. RIDOO86RSHQVKHOOSLVWDFKLRQXWVDUHLQFRUUHFWO\FODVVLILHG E\ PHFKDQLFDO GHYLFHV DV KDYLQJ D FORVHG VKHOO FRVWLQJ WKH LQGXVWU\ WR PLOOLRQ SHU D \HDU LQ ORVW UHYHQXH 7KHUHIRUHKLJKDFFXUDF\FODVVLILFDWLRQV\VWHPVDUHQHHGHGLQ WKHLQGXVWU\ +D]HOQXWVDQRWKHUZLGHO\XVHGQXWLQWKHIRRGPDU NHW DUH RQH RI WKH PDLQ LQJUHGLHQWV XVHG LQ FKRFRODWH DQG IODYRUHGFRIIHHLQGXVWULHV2QHRIWKHPDMRUTXDOLW\DWWULEXWHV RI UDZ EXON KD]HOQXWV LV WKH UDWLR RI NHUQHO ZHLJKW WR VKHOO ZHLJKW (PSW\ KD]HOQXWV DQG KD]HOQXWV FRQWDLQLQJ XQGHYHO RSHGNHUQHOVQHJDWLYHO\DIIHFWWKLVUDWLR,IWKHUDWLRRINHUQHO ZHLJKWWRJURVVZHLJKWLVOHVVWKDQWKHQVRPHEX\HUVUH MHFWWKHSURGXFW&XUUHQWO\UDZKD]HOQXWVDUHSURFHVVHGE\DQ ³DLUOHJ´ ZKLFK LV D SQHXPDWLF GHYLFH WR VHSDUDWH HPSW\ KD ]HOQXWV IURP IXOO\ GHYHORSHG RQHV +RZHYHU WKHVH GHYLFHV KDYHKLJKFODVVLILFDWLRQHUURUUDWHV 5HFHQWO\ D QHZ QRQFRQWDFW V\VWHP EDVHG RQ LP SDFW DFRXVWLF HPLVVLRQ KDV EHHQ SURSRVHG IRU IRRG NHUQHO LQVSHFWLRQ ZKLFK RYHUFRPHV VHYHUDO OLPLWDWLRQV RI WKH DS SURDFKHVVXPPDUL]HGDERYH,QLWLDOO\WKLVV\VWHPZDVXVHGWR VHSDUDWH SLVWDFKLR QXWV ZLWK FORVHG VKHOOV IURP WKRVH ZLWK RSHQ VKHOOV ZKLFK DUH FROOHFWHG IURP &DOLIRUQLD UHJLRQ RI 86$ ,Q WKLV V\VWHP WKH SLVWDFKLR QXWV DUH LPSDFWHG RQWR D VWHHO SODWH DQG WKH UHVXOWLQJ DFRXVWLF VLJQDOV DUH UHFRUGHG 'XULQJ WKH RIIOLQH WUDLQLQJ OHDUQLQJ

(79) SKDVH D WRWDO RI IHDWXUHV DUH H[WUDFWHG 7KH\ DUH EDVHG RQ WKH REVHUYDWLRQV IURP RSHQ DQG FORVHG VKHOO SLVWDFKLR QXW VRXQG VLJQDOV DQG XVHWKHDEVROXWHYDOXHRIWKHVLJQDOPDJQLWXGHWKHDEVROXWH YDOXHRIWKHJUDGLHQWRUERWK$PRQJWKRVHIHDWXUHVWKH EHVWRIWKHPDUHVHOHFWHGXVLQJERWKOLQHDUDQGQRQOLQHDU GLVFULPLQDQW DQDO\VHV 7KH VHOHFWLRQ RI RQO\ WKH EHVW IHD WXUHVLVGXHWRWKHUHDOWLPHSURFHVVLQJFRQVWUDLQW7KLVFRQ VWUDLQWUHTXLUHVWKDWWKHQXWXQGHUH[DPLQDWLRQEHGHFLGHGRQ EHIRUHWKHQH[WQXWFRPHVLQWRWKHV\VWHP8VLQJZLWKWKHVH VHOHFWHGIHDWXUHVRQWKHYDOLGDWLRQVHWWKHFODVVLILFDWLRQDFFX. ©2007 EURASIP. 1880. UDF\ ZDV DSSUR[LPDWHO\ ZLWK D WKURXJKSXW RI QXWV SHU VHFRQG SURYLQJEHWWHUSHUIRUPDQFH WKDQ WUDGLWLRQDO PH FKDQLFDOGHYLFHV 7KLV VDPH LPSDFW DFRXVWLFV V\VWHP ZDV DSSOLHG WR HPSW\IXOO KD]HOQXW LQVSHFWLRQ DQG VXFFHVVIXO UHVXOWV ZHUH REWDLQHGLQ>@7KHDXWKRUVXVHGGLIIHUHQWVLJQDOIHDWXUHVIRU EHWWHU FODVVLILFDWLRQ DFFXUDFLHV 7KH IHDWXUHV DUH H[WUDFWHG IURP WKH WLPH GRPDLQ DQG IUHTXHQF\ GRPDLQ LQGLYLGXDOO\ &RPELQDWLRQVRIVHYHUDOVXEVHWVRIWKHVHIHDWXUHVDUHWUDLQHG DQGWHVWHGXVLQJDVXSSRUWYHFWRUPDFKLQHFODVVLILHU$QLP SURYHG FODVVLILFDWLRQ DFFXUDF\ RI ZDV REWDLQHG %RWK SLVWDFKLR DQG KD]HOQXWV VWXGLHV XVLQJ LPSDFW DFRXVWLFV HP SKDVL]HGWKHLPSRUWDQFHRIVLJQDOSURFHVVLQJVWDJHV ,QSDU WLFXODU LW KDV EHHQ VKRZQ WKDW KDYLQJ D SULRUL LQIRUPDWLRQ DERXWUHOHYDQW WLPHVHJPHQW DQGIUHTXHQF\LQGH[HV KDVLP SRUWDQW HIIHFWV RQ FODVVLILFDWLRQ DFFXUDF\ +RZHYHU WKH DG MXVWPHQWRIWKHVHSDUDPHWHUVLVGHPDQGLQJ)XUWKHUPRUHWKH GLIIHUHQFHVEHWZHHQQXWVIURPUHJLRQWRUHJLRQPDNHLWQHF HVVDU\WRGHYHORSDQDGDSWLYHFODVVLILFDWLRQV\VWHPZKLFKFDQ DGMXVWLWVSDUDPHWHUVIRUWKHJLYHQVLJQDO QXWW\SH

(80) $IWHUWKLVSRLQWZHWDFNOHWKHVHSUREOHPVE\XVLQJWKHDGDS WLYHWLPHIUHTXHQF\SODQHIHDWXUHVXEVHWVHOHFWLRQDQGFODVVL ILFDWLRQDOJRULWKPWKDWZHGHVFULEHGDERYH,QSDUWLFXODUZH WHVWRXUSURSRVHGV\VWHPWRGLVFULPLQDWHEHWZHHQRSHQDQG FORVHGVKHOOSLVWDFKLRQXWVDQGIXOODQGHPSW\KD]HOQXWVFRO OHFWHG IURP WKH *D]LDQWHS DQG %ODFNVHD UHJLRQ RI 7XUNH\ UHVSHFWLYHO\ 7KH UHFRUGLQJV XVHG LQ WKLV VWXG\ ZHUH SUR YLGHGE\%LONHQW8QLYHUVLW\7XUNH\ 7KH SLVWDFKLR DQG KD]HOQXW LPSDFW DFRXVWLFV DUH UH FRUGHGZLWKDKLJKO\GLUHFWLRQDOPLFURSKRQH2XWSXWRIWKH PLFURSKRQHLVGLJLWL]HGZLWKN+]VDPSOLQJIUHTXHQF\E\ DVRXQGFDUGDWWDFKHGWRD3&DQGVWRUHGIRUIXUWKHUDQDO\VLV )RU HDFK W\SH RI SLVWDFKLR UHFRUGLQJV ZHUH REWDLQHG (DFK UHFRUGLQJ ZDV VDPSOHV ORQJ )RU KD]HOQXWV UHFRUGLQJVZHUHREWDLQHGIRUHDFKFODVVDQGHDFKVLJQDOZDV VDPSOHV ORQJ 6DPSOH VLJQDOV UHFRUGHG ZLWK WKH GH VFULEHGVHWXSDUHJLYHQLQ)LJXUH7KHVRXQGVLJQDOVDYDLO DEOHWKLVZD\DUHDQDO\]HGLQDQRIIOLQHPDQQHUIRUIHDWXUH H[WUDFWLRQ$IWHUIHDWXUHVDUHVHOHFWHGDQGWKHGHFLVLRQUXOHV DUH VHW WKH V\VWHP LV UXQIRU YDOLGDWLRQ ,Q UHDO WLPH LPSOH PHQWDWLRQ D GHFLVLRQ LVJLYHQDQG HLWKHU WKH QXW LV GLYHUWHG E\DQDLUYDOYHWRRQHVWUHDPRUQRDFWLRQLVWDNHQDQGWKH QXWJRHVWRDQRWKHUVWUHDP2EYLRXVO\DWLPLQJFRQVWUDLQWLV SUHVHQWDQGWKLVLVDOVRRQHRIWKHUHDVRQVLWLVQHFHVVDU\WR JLYHDJRRGGHFLVLRQDVIDVWDVSRVVLEOH$OWKRXJKZHGRQRW YDOLGDWHWKHSHUIRUPDQFHRIRXUGDWDLQUHDOWLPHWKHVHWLPH FRQVWUDLQWVKDYHWREHWDNHQLQWRFRQVLGHUDWLRQIRUSUDFWLFH 5(68/76 :HWHVWHGWKHSURSRVHGDSSURDFKRQWKHSLVWDFKLRDQGKD]HO QXWDFRXVWLF VLJQDOV:HXVHGDWLPHV IROG FURVV YDOLGD WLRQPHWKRGWRHVWLPDWHWKHFODVVLILFDWLRQSHUIRUPDQFH%DVL FDOO\KDOIRIWKHGDWDVHWLVXVHGIRUWUDLQLQJDQGWKHUHVWIRU WHVWLQJ 7KHQ WKH WHVW DQG WUDLQ VHWV DUH VZDSSHG 7KLV H[ SHULPHQWLVUHSHDWHGWLPHV:HXVHDIUHTXHQF\OHYHO) DQGWLPHOHYHO7 IRUWKHGXDOWUHH)RU8':7'DXEHFKLHV ZDYHOHWILOWHURIRUGHULVXVHG$IWHUFDOFXODWLQJWKHHQHUJ\ IHDWXUHV LQ WKH QRGHV RI WKH GXDO WUHH WKH\ DUH FRQYHUWHG WR.

(81) 15th European Signal Processing Conference (EUSIPCO 2007), Poznan, Poland, September 3-7, 2007, copyright by EURASIP. 22. 7$%/( 2SHQ&ORVHG VKHOO SLVWDFKLR QXW FODVVLILFDWLRQ HUURUV IRU WKH SURSRVHGW\SHV7KHUHVXOWVIURPEDVHDSSURDFKHVZKLFKDUHXVHGLQWKLVDUHD LVJLYHQDVZHOO 7\SH 0LQLPXP(UURU RI)HDWXUHV . 7$%/((PSW\)XOOKD]HOQXWFODVVLILFDWLRQHUURUVIRUWKHSURSRVHGW\SHV 7KH UHVXOWV IURP EDVH DSSURDFKHV ZKLFK DUH XVHG LQ WKLV DUHD LV JLYHQ DV ZHOO 7\SH 0LQLPXP(UURU RI)HDWXUHV 7\SH, 7\SH,, 7\SH,, %$ . ORJVFDOH7DEOHDQG7DEOHVKRZWKHFODVVLILFDWLRQDFFXUD FLHVREWDLQHGZLWKWKHSURSRVHGDSSURDFKHVIRUSLVWDFKLRDQG KD]HOQXWVUHVSHFWLYHO\7KHFODVVLILFDWLRQHUURUVREWDLQHGZLWK WKRVH EDVH OLQH DOJRULWKPV SURSRVHG LQ WKH VDPH DUHD DUH JLYHQDV%$7KH7\SH,DQG7\SH,,DSSURDFKHVZKLFKXVH WKHIHHGEDFNIURPWKHFODVVLILHUKDVRXWSHUIRUPHGWKHW\SH,,, DQG %$ DSSURDFKHV $V LQGLFDWHG EHIRUH WKH W\SH,,, RQO\ XVHV WKH VDPH WUHH SUXQLQJ PHWKRG RI RULJLQDO /'% DOJR ULWKPDQGGRHVQRWDFFRXQWIRUWKHLQWHUDFWLRQVEHWZHHQIHD WXUHV7KHREWDLQHGFODVVLILFDWLRQDFFXUDFLHVVWURQJO\VXSSRUW WKDW WKH HYDOXDWLRQ RI WKH FODVVLILFDWLRQ SHUIRUPDQFH RI WKH FRPELQHG IHDWXUHV LQ WKH WUDLQLQJ VWDJH LV LPSRUWDQW DQG VKRXOG EH SUHIHUUHG WR HYDOXDWLQJ WKH LQGLYLGXDO GLVFULPLQD WLRQSRZHURIWKHIHDWXUHV)XUWKHUPRUHZHQRWHWKDW7\SH,, DSSURDFKXVHGDOZD\VVPDOOQXPEHURIIHDWXUHVWKHQWKHRWK HUDSSURDFKHVWRDFKLHYHWKHPLQLPDOHUURU7KHFODVVLILFDWLRQ HUURUFXUYHVYHUVXVWKHQXPEHURIIHDWXUHVDUHJLYHQLQ)LJ XUH7KLVFDQEHH[SODLQHGE\WKHHIIHFWRISUXQLQJ6LQFH HDFK VHOHFWHG IHDWXUH LQGH[ LV XVHG WR SUXQH WKH GXDO WUHH VWUXFWXUH WKH RUWKRJRQDOL]DWLRQ RI WKH UHSUHVHQWDWLRQ VSDFH KHOSVWKHFODVVLILHUWRXVHVPDOOQXPEHURIIHDWXUHVWRDFKLHYH PLQLPDOHUURUUDWH$OWKRXJKWKHREWDLQHGFODVVLILFDWLRQDFFX UDFLHV RI W\SH, DQG W\SH,, DUH FRPSDUDEOH WKH QXPEHU RI XVHG IHDWXUHV FDUULHV VLJQLILFDQW LPSRUWDQFH IRU UHDOWLPH DSSOLFDWLRQV ,W UHGXFHV FRPSXWDWLRQDO FRPSOH[LW\ 0DQ\ WLPHV3&$LVXVHGWRGHFRUUHODWHWKHWLPHIUHTXHQF\IHDWXUHV ZKLFKLQGXFHDQDGGLWLRQDOFRPSOH[LW\>@+HUHWKHW\SH ,,FRXOGSHUIRUPDVLPLODUGLPHQVLRQUHGXFWLRQZLWKRXWQHHG DQ\SRVWSURFHVVLQJVWDJH,QDGGLWLRQLWLVDFULWLFDOSURSHUW\ WRDFKLHYHKLJKHUJHQHUDOL]DWLRQFDSDELOLW\,QSUDFWLFHW\SH,, PD\JHQHUDOL]HPRUHWKDQW\SH,DQGW\SH,,, &21&/86,21 ,Q WKLV SDSHU ZH GHVFULEHG D QHZ DGDSWLYH WLPHIUHTXHQF\ SODQH IHDWXUH H[WUDFWLRQ DQG FODVVLILFDWLRQ DOJRULWKP :H WHVWHGWKHQHZDSSURDFKRQLPSDFWDFRXVWLFVLJQDOVIRUIRRG LQVSHFWLRQ7KHUHVXOWVZHREWDLQHGVKRZWKDWWKHDOJRULWKP LVVXSHULRUWRSUHYLRXVDOJRULWKPVDSSOLHGLQWKLVDUHD,WXVHV DVPDOOQXPEHURIIHDWXUHVWRDFKLHYHPLQLPDOFODVVLILFDWLRQ HUURUE\RUWKRJRQDOL]DWLRQRIUHGXQGDQWGLFWLRQDU\ZLWKFODV VLILHUGLUHFWHGSUXQLQJ7KHXVHRIVPDOOQXPEHURIIHDWXUHV IRU FODVVLILFDWLRQ PDNHV WKH DOJRULWKP FRPSXWDWLRQDOO\ HIIL. ©2007 EURASIP. 1881. Classification Error (%). . 18 16 14 12 10 8 0. 10. 20. 30. 40. 50. Number of Features. . D

(82) 8. Type−I Type−II Type−III. 7. Classification Error (%). 7\SH, 7\SH,, 7\SH,,, %$. Type−I Type−II Type−III. 20. 6 5 4 3 2 1 0 0. 10. 20. 30. 40. 50. Number of Features. E

(83) )LJXUH &ODVVLILFDWLRQ FXUYHV IRU D

(84) 3LVWDFKLR E

(85) +D]HOQXW FODVVLILFDWLRQ. FLHQW%DVHGRQWKHREVHUYDWLRQVIURPSUHYLRXVO\PHQWLRQHG DOJRULWKPV DERYH RXU SURSRVHG DOJRULWKP GRHV QRW GHSHQG RQDSULRULNQRZOHGJHRIWLPHIUHTXHQF\FRQWHQWRIWKHVLJ QDOVXQGHUH[DPLQDWLRQ,WVDGDSWDWLRQFDSDELOLW\WRGLIIHUHQW W\SHRIVLJQDOVPDNHVWKHDOJRULWKPDXQLYHUVDOPHWKRG 5()(5(1&(6 >@ 1 6DLWR 5 5 &RLIPDQ ) % *HVKZLQG ) :DUQHU ³'LV FULPLQDQWIHDWXUHH[WUDFWLRQXVLQJHPSLULFDOSUREDELOLW\GHQVLW\ DQG D ORFDO EDVLV OLEUDU\´ 3DWWHUQ 5HFRJQLWLRQ SS 9RO >@ 1 ) ,QFH 6 $ULFD $ + 7HZILN &ODVVLILFDWLRQ RI VLQJOH WULDOPRWRULPDJHU\((*UHFRUGLQJVZLWKVXEMHFWDGDSWHGQRQ G\DGLFDUELWUDU\WLPHIUHTXHQF\WLOLQJV-RI1HXUDO(QJLQHHU LQJSS±-XO\ >@.(QJOHKDUW%+XGJLQV3$3DUNHU06WHYHQVRQ³&ODVVL ILFDWLRQ RI WKH P\RHOHFWULF VLJQDO XVLQJ WLPHIUHTXHQF\ EDVHG UHSUHVHQWDWLRQV´0HG(QJ3K\VSS9RO >@08QVHU7H[WXUHFODVVLILFDWLRQDQGVHJPHQWDWLRQXVLQJZDYH OHW IUDPHV. ,((( 7UDQV ,PDJH 3URF SS ± 9RO

(86) 1RY >@ 0 9HWWHUOL :DYHOHWV DSSUR[LPDWLRQ DQG FRPSUHVVLRQ. ,(((6LJQDO3URF0DJD]LQHSS±6HSW >@7&3HDUVRQ'HWHFWLRQRISLVWDFKLRQXWVZLWKFORVHGVKHOOV XVLQJLPSDFWDFRXVWLFV$SSOLHG(QJLQ$JULF

(87) >@,2QDUDQ7&3HDUVRQ<<DUGLPFL$(&HWLQ'HWHFWLRQ RIXQGHUGHYHORSHGKD]HOQXWV IURPIXOO\GHYHORSHGQXWVE\LP SDFWDFRXVWLFV. 7UDQVRI$6$%(9RO

(88) .

(89)