Optimal stochastic design for multi-parameter estimation problems

237,0$/ 672&+$67,& '(6,*1 )25 08/7,3$5$0(7(5 (67,0$7,21 352%/(06

+DP]D 6RJDQFL

_{ 6LQDQ *H]LFL}

_{ DQG 2UKDQ $ULNDQ}

∗

_{%LONHQW 8QLYHUVLW\ 'HSDUWPHQW RI (OHFWULFDO DQG (OHFWURQLFV (QJLQHHULQJ  $QNDUD 7XUNH\}



_{78%,7$.6$*( *URXS RI (OHFWURQLF 6\VWHPV DQG )OLJKW 'LVFLSOLQHV  $QNDUD 7XUNH\}

{KVRJDQFL JH]LFL RDULNDQ}#HHELONHQWHGXWU

,Q WKLV VWXG\ ZH FRQVLGHU SHUIRUPDQFH LPSURYHPHQW RI DQ DU UD\ RI ¿[HG HVWLPDWRUV E\ XVLQJ VWRFKDVWLF GHVLJQ WHFKQLTXHV 7KH RSWLPDO GHVLJQ LV LQYHVWLJDWHG ERWK LQ WKH DEVHQFH DQG SUHVHQFH RI DQ DYHUDJH SRZHU FRQVWUDLQW 7ZR GLIIHUHQW SHU IRUPDQFH FULWHULD DUH FRQVLGHUHG WKH DYHUDJH %D\HV ULVN DQG WKH PD[LPXP %D\HV ULVN ,W LV VKRZQ WKDW WKH RSWLPDO VWRFKDV WLF SDUDPHWHU GHVLJQ UHVXOWV LQ D UDQGRPL]DWLRQ EHWZHHQ GLI IHUHQW QXPEHUV RI SDUDPHWHU YDOXHV GHSHQGLQJ RQ WKH W\SH RI WKH SHUIRUPDQFH FULWHULRQ

,QGH[ 7HUPV² 6WRFKDVWLF SDUDPHWHU GHVLJQ %D\HV ULVN

SDUDPHWHU HVWLPDWLRQ

 ,1752'8&7,21

,Q FRQYHQWLRQDO HVWLPDWLRQ SUREOHPV WKH DLP LV WR GHVLJQ WKH RSWLPDO HVWLPDWRU IRU D JLYHQ GLVWULEXWLRQ RI REVHUYDWLRQV LQ RUGHU WR PLQLPL]H D FHUWDLQ FRVW IXQFWLRQ 7KH HVWLPDWRUV FRQVLGHUHG LQ WKHVH FRQYHQWLRQDO IRUPXODWLRQV FDQ EH FDWHJR UL]HG LQWR WZR JURXSV EDVHG RQ WKH SULRU LQIRUPDWLRQ DERXW WKH SDUDPHWHU WR EH HVWLPDWHG ,I WKHUH H[LVWV D SULRU LQIRU PDWLRQ DERXW WKH SDUDPHWHU %D\HVLDQ HVWLPDWRUV VXFK DV WKH PLQLPXP PHDQVTXDUHG HUURU 006( HVWLPDWRU DQG WKH PLQLPXP PHDQDEVROXWH HUURU 00$( HVWLPDWRU DUH FRP PRQO\ XVHG >@ 2Q WKH RWKHU KDQG ZKHQ WKHUH LV QR SULRU LQIRUPDWLRQ DERXW WKH SDUDPHWHU WKH PLQLPXP YDULDQFH XQEL DVHG HVWLPDWRU 098( RU WKH PD[LPXP OLNHOLKRRG HVWLPDWRU 0/( FDQ EH HPSOR\HG >@ $OO WKHVH DSSURDFKHV UHTXLUH GHVLJQLQJ WKH RSWLPDO HVWLPDWRU XQGHU FHUWDLQ FRQVWUDLQWV ,Q D UHFHQW VWXG\ DQ DOWHUQDWLYH IRUPXODWLRQ LV LQYHVWLJDWHG E\ FRQVLGHULQJ WKH VWRFKDVWLF GHVLJQ RI D SDUDPHWHU ZKHQ WKH HVWLPDWRU LV ¿[HG DQG LW LV VKRZQ WKDW WKH SHUIRUPDQFH RI WKH JLYHQ HVWLPDWRU FDQ EH LPSURYHG E\ RSWLPDO VWRFKDVWLF SDUDPHWHU GHVLJQ ZKLFK FDQ LQYROYH UDQGRPL]DWLRQ RI WKH SDUDPHWHU EHWZHHQ DW PRVW WZR GLIIHUHQW YDOXHV >@

6LJQDO UDQGRPL]DWLRQ KDV DOVR EHHQ HPSOR\HG LQ YDULRXV IUDPHZRUNV WR LPSURYH WKH SHUIRUPDQFH RI GHWHFWLRQ DQG HV WLPDWLRQ V\VWHPV >@>@ )RU H[DPSOH WKH GHWHFWLRQ SURED ELOLW\ RI FHUWDLQ GHWHFWRUV FDQ EH LQFUHDVHG E\ WKH DGGLWLRQ RI D UDQGRPL]HG QRLVH FRPSRQHQW > @ $OVR WUDQVPLWWLQJ UDQ GRPL]HG VLJQDOV FDQ UHGXFH WKH SUREDELOLW\ RI HUURU IRU SRZHU FRQVWUDLQHG FRPPXQLFDWLRQ V\VWHPV LQ WKH SUHVHQFH RI QRQ *DXVVLDQ QRLVH >@ ,Q DGGLWLRQ SHUIRUPDQFH RI VRPH VXERS WLPDO HVWLPDWRUV FDQ DOVR EH HQKDQFHG E\ DGGLQJ UDQGRPL]HG QRLVH WR WKH REVHUYDWLRQV EHIRUH WKH HVWLPDWLRQ SURFHVV >@

,Q WKLV VWXG\ WKH DLP LV WR SURSRVH D IUDPHZRUN IRU WKH RSWLPDO VWRFKDVWLF GHVLJQ RI PXOWLSOH SDUDPHWHUV ,Q WKLV ZD\ WKH DSSURDFK LQ >@ IRU WKH VLQJOH SDUDPHWHU FDVH LV H[WHQGHG WR

WKH PXOWLSDUDPHWHU VFHQDULRV LQ ZKLFK WKH RSWLPDO VWRFKDV WLF GHVLJQ RI PXOWLSOH SDUDPHWHUV LV SHUIRUPHG LQ RUGHU WR RSWLPL]H WKH SHUIRUPDQFH RI ¿[HG HVWLPDWRUV 7ZR GLIIHUHQW SHUIRUPDQFH FULWHULD WKH WRWDO %D\HV ULVN DQG WKH PD[LPXP %D\HV ULVN DUH FRQVLGHUHG DQG WKH FKDUDFWHULVWLFV RI RSWLPDO SDUDPHWHU GLVWULEXWLRQV DUH VSHFL¿HG $ QXPHULFDO H[DPSOH LV SUHVHQWHG LQ RUGHU WR LOOXVWUDWH WKH LPSURYHPHQWV DFKLHYDEOH YLD WKH SURSRVHG DSSURDFK

 672&+$67,& '(6,*1 )25 08/7,3/( 3$5$0(7(56

,Q WKLV VHFWLRQ WKH DLP LV WR HVWDEOLVK D IUDPHZRUN IRU WKH VWRFKDVWLF GHVLJQ RI PXOWLSOH SDUDPHWHUV IRU D JLYHQ VHW RI ¿[HG HVWLPDWRUV :LWKRXW ORVV RI JHQHUDOLW\ DOO WKH IRUPXOD WLRQV DQG ¿JXUHV ZLOO EH SUHVHQWHG IRU WKH WZR SDUDPHWHU FDVH IRU WKH VDNH RI VLPSOLFLW\ ,W LV SRVVLEOH WR H[WHQG WKH UHVXOWV WR WKH FDVHV ZLWK PRUH WKDQ WZR SDUDPHWHUV

&RQVLGHU D SDUDPHWHU HVWLPDWLRQ VFHQDULR LQ ZKLFK WKHUH H[LVW WZR SDUDPHWHUVθ1DQGθ2 7KH DLP LV WR VHQG LQIRUPD WLRQ DERXW WKHVH WZR SDUDPHWHUV IURP WZR VHSDUDWH GHYLFHV A1DQG A2 WR WZR GHYLFHV B1DQG B2 UHVSHFWLYHO\ RYHU DG GLWLYH QRLVH FKDQQHOV DV GHSLFWHG LQ )LJ  8QOLNH D VWDQGDUG

HVWLPDWLRQ VFHQDULR SDUDPHWHUθiLV QRW QHFHVVDULO\ WUDQVPLW

WHG DV LW LV %XW LQVWHDG GHYLFH A_i FDQ WUDQVPLW DQ\ IXQFWLRQ RIθi VD\sθi )XQFWLRQsθi FDQ EH RI DQ\ W\SH LW FDQ EH D GHWHUPLQLVWLF IXQFWLRQ RIθi RU LW FDQ EH D VWRFKDVWLF IXQFWLRQ DV ZHOO 7KH DLP RI WKLV VWXG\ LV WR ¿QG WKH RSWLPDOsθi LH WKH RSWLPDO GLVWULEXWLRQ RIsθi IRU HDFKθi

,W VKRXOG EH QRWHG WKDW WKH GLIIHUHQFH EHWZHHQ WKH VLQJOH SDUDPHWHU FDVH FRQVLGHUHG LQ >@ DQG WKH PXOWLSDUDPHWHU FDVH LQYHVWLJDWHG LQ WKLV VWXG\ LV QRW RQO\ UHODWHG WR WKH QXPEHU RI SDUDPHWHUV 7KH SURSRVHG PXOWLSDUDPHWHU IRUPXODWLRQ DOVR WDNHV LQWR DFFRXQW WKH SRVVLEOH LQWHUIHUHQFH EHWZHHQ WKH SD UDPHWHU UHODWHG VLJQDOV DV VKRZQ E\ WKH GDVKHG FURVV OLQHV LQ )LJ  &RQVLGHULQJ WZR SDUDPHWHUV WKH UHFHLYHG VLJQDO RE VHUYDWLRQ DW GHYLFH B_iFDQ EH H[SUHVVHG DV

yi = sθi+ 2  j=1 j=i ρsθj+ ni 

IRU i∈ {1, 2} ZKHUH ρ LV WKH PXOWLSOLHU WKDW LV VHW DFFRUGLQJ WR WKH LQWHUIHUHQFH EHWZHHQ WKH SDUDPHWHU UHODWHG VLJQDOV DQG

ni GHQRWHV WKH FKDQQHO QRLVH ZKLFK KDV D SUREDELOLW\ GHQ

VLW\ IXQFWLRQ 3') UHSUHVHQWHG E\ pni(·) (DFK GHYLFH Bi

WULHV WR HVWLPDWHθi EDVHG RQ WKH FRUUHVSRQGLQJ REVHUYDWLRQ

yi VSHFL¿HG E\  ,W LV DVVXPHG WKDW WKHVH GHYLFHV HPSOR\

¿[HG HVWLPDWRUV VSHFL¿HG E\ ˆθi(yi) LQ RUGHU WR HVWLPDWH θi &RQVLGHULQJ SDUDPHWHUVθiDV HOHPHQWV RI YHFWRUθ WKH SULRU



$

$

%

%

V

V

T

Ö

\

T

T

T

)LJ  6\VWHP PRGHO 'HYLFHV A₁DQG A₂WUDQVPLW VWRFKDVWLF VLJQDOVsθ1 DQGsθ2 IRU HDFK YDOXH RI SDUDPHWHUVθ1 DQGθ2 UHVSHFWLYHO\ 'HYLFHV B₁DQG B₂HVWLPDWHθ1DQGθ2EDVHG RQ WKH QRLVH FRUUXSWHG YHUVLRQ RIsθ1 DQGsθ2

GLVWULEXWLRQ RIθ LV GHQRWHG E\ w(θ) DQG WKH SDUDPHWHU VSDFH

LQ ZKLFKθ UHVLGHV LV UHSUHVHQWHG E\ Λ

7KH DLP LV WR ¿QG WKH RSWLPDO SUREDELOLW\ GLVWULEXWLRQ RI

sθ IRU HDFK θ ∈ Λ LQ RUGHU WR PLQLPL]H D IXQFWLRQ RI WKH

%D\HV ULVN IRU WKH JLYHQ HVWLPDWRUV ZKHUHsθi¶V DUH WKH HO

HPHQWV RI WKH YHFWRUsθ 6LQFH WKH SDUDPHWHUV FDQ LQWHUIHUH

ZLWK HDFK RWKHU WKH RSWLPL]DWLRQ FDQQRW EH SHUIRUPHG LQGH SHQGHQWO\ IRU HDFK SDUDPHWHU +HQFH WKH RSWLPL]DWLRQ VKRXOG EH SHUIRUPHG MRLQWO\

 8QFRQVWUDLQHG 2SWLPL]DWLRQ

,Q RUGHU WR ¿QG WKH RSWLPDO SUREDELOLW\ GLVWULEXWLRQ RIsθ D

FHUWDLQ FRVW IXQFWLRQ LV FRQVLGHUHG DQG WKH RSWLPL]DWLRQ LV SHU IRUPHG E\ PLQLPL]LQJ WKDW FRVW IXQFWLRQ ,Q WKLV VHFWLRQ QR FRQVWUDLQWV DUH FRQVLGHUHG IRU WKH RSWLPL]DWLRQ SUREOHP ,Q WKDW FDVH WKH RSWLPDO VWRFKDVWLF SDUDPHWHU GHVLJQ FDQ EH IRU PXODWHG DV

{popt

sθ ,θ ∈ Λ} = arg min

{psθ, θ∈Λ}

r(ˆθ) 

ZKHUH{psθ,θ ∈ Λ} GHQRWHV WKH VHW RI 3')V IRU sθ IRU DOO

SRVVLEOH YDOXHV RI SDUDPHWHU θ DQG r(ˆθ) LV WKH FRVW IXQF

WLRQ IRU WKH RYHUDOO V\VWHP )RU WKH VLQJOH SDUDPHWHU FDVH WKH %D\HV ULVN RI WKH HVWLPDWRU ZDV D QDWXUDO FKRLFH IRU WKLV FRVW IXQFWLRQ >@ 2Q WKH RWKHU KDQG LW LV SRVVLEOH WR FRQ VLGHU GLIIHUHQW ULVN IXQFWLRQV IRU WKH PXOWLSDUDPHWHU FDVH ,Q WKLV VHFWLRQ WZR GLIIHUHQW FRVW IXQFWLRQV DUH FRQVLGHUHG 7KH ¿UVW RQH LV WKH VXP RI WKH %D\HV ULVNV RI WKH HVWLPDWRUV LQ WKH V\VWHP FDOOHG WKH WRWDO %D\HV ULVN DQG WKH VHFRQG RQH LV WKH PD[LPXP RI WKH %D\HV ULVNV RI WKH HVWLPDWRUV FDOOHG WKH PD[LPXP %D\HV ULVN )RU ERWK RI WKHVH FRVW IXQFWLRQV WKH %D\HV ULVN RI HDFK HVWLPDWRU VKRXOG EH FDOFXODWHG ¿UVW )RU WKH WZR SDUDPHWHU FDVH WKH %D\HV ULVN RI WKH ¿UVW HVWLPDWRU FDQ EH H[SUHVVHG DV r(ˆθ1) =  Λ1 w(θ1)  psθ1(x1)  C[ˆθ(y1), θ1] ×  ps_θ2(x2) pn1(y1− x1− ρx2) dx2dy1dx1dθ1  ZKHUHC[ˆθ(y1), θ1] UHSUHVHQWV WKH FRVW RI HVWLPDWLQJ θ1 DV ˆθ(y1) >@ DQG psθi LV WKH 3') RI WKH VLJQDO UHODWHG WR SD

UDPHWHU i 7KH %D\HV ULVN RI WKH VHFRQG HVWLPDWRU FDQ EH

H[SUHVVHG VLPLODUO\ 'H¿QLQJ DQ DX[LOLDU\ IXQFWLRQ gθ1(x)

IRU WKH ¿UVW HVWLPDWRU DV g_θ1(x) 



C[ˆθ1(y1), θ1] pn1(y1− x1− ρx2) dy1 

ZKHUHx = [x1 x2] DQG D VLPLODU IXQFWLRQ IRU WKH VHFRQG

HVWLPDWRU WKH WRWDO %D\HV ULVN FDQ EH VWDWHG DV r(ˆθ) =  Λw(θ)  psθ(x) (gθ1(x) + gθ2(x)) dx dθ =  Λw(θ) E{ ˜gθ(sθ)} dθ  ZKHUH ˆθ = [ˆθ1ˆθ2] DQG ˜g_θ(x) = gθ1(x) + gθ2(x) . 

,Q  HDFK H[SHFWDWLRQ RSHUDWLRQ LV RYHU WKH 3') RIsθIRU D

JLYHQ YDOXH RIθ :KHQ WKHUH DUH QR FRQVWUDLQWV RQ WKH GHVLJQ

RIsθ r(ˆθ) JLYHQ E\  FDQ EH PLQLPL]HG LI WKH 3') RI sθDV

VLJQV DOO WKH SUREDELOLW\ WR WKH PLQLPL]HU RI˜gθLQ  IRU HDFK

θ _{,Q RWKHU ZRUGV WKH VROXWLRQ RI WKH RSWLPL]DWLRQ SUREOHP}

LQ  FDQ EH VLPSOL¿HG DV

popt_sθ (x) = δ(x − sunc_θ ) , sunc_θ = arg min

x ˜gθ(x) 

IRU DOOθ ∈ Λ  6LQFH WKH VROXWLRQ UHTXLUHV sθWR DVVLJQ DOO WKH

SUREDELOLW\ WR D VLQJOH SRLQW LW FDQ EH FRQFOXGHG WKDW RSWLPDO 3')V IRU WKH VWRFKDVWLF SDUDPHWHU GHVLJQ DUH WKH RQHV ZLWK VLQJOH SRLQW PDVVHV +HQFH WKH GHWHUPLQLVWLF SDUDPHWHU GH VLJQ LV RSWLPDO DQG WKHUH LV QR QHHG IRU VWRFKDVWLF PRGHOLQJ $OVR LW FDQ EH REVHUYHG IURP  WKDW WKH VROXWLRQ LV LQGHSHQ GHQW RI WKH SULRU GLVWULEXWLRQ w(θ) VLQFH WKH RSWLPDO VROXWLRQ LV REWDLQHG IRU HDFKθ VHSDUDWHO\

:KHQ WKH PD[LPXP %D\HV ULVN FULWHULRQ LV FRQVLGHUHG WKH FRVW IXQFWLRQ LQ  FDQ EH XSGDWHG DV r(ˆθ) =  Λw(θ) maxi∈{1,2}  psθ(x) gθi(x) dx  dθ = 

Λw(θ) maxi∈{1,2}(E{gθi(sθ)}) dθ  IRU ZKLFK WKH VROXWLRQ LV VWLOO D 3') ZLWK D VLQJOH SRLQW PDVV +HQFH IRU WKH XQFRQVWUDLQHG FDVH FRQVLGHULQJ WKH WRWDO ULVN RU WKH PD[LPXP ULVN GRHV QRW FKDQJH WKH VWUXFWXUH RI WKH VROX

WLRQ +RZHYHU LQ SUDFWLFH WKH YDOXHV RIsθFDQQRW EH FKRVHQ

ZLWKRXW DQ\ FRQVWUDLQWV ,Q WKH QH[W VHFWLRQ WKH FDVHV ZLWK DYHUDJH SRZHU FRQVWUDLQWV DUH LQYHVWLJDWHG

 &RQVWUDLQHG 2SWLPL]DWLRQ

,Q WKLV VHFWLRQ DQ DYHUDJH SRZHU FRQVWUDLQW LV FRQVLGHUHG LQ WKH IRUPXODWLRQ RI WKH VWRFKDVWLF GHVLJQ SUREOHP $OWKRXJK WKLV LV D VSHFL¿F W\SH RI D FRQVWUDLQW RWKHU W\SHV RI FRQVWUDLQWV FDQ DOVR EH LQFRUSRUDWHG LQWR WKH WKHRUHWLFDO DQDO\VLV DV ZHOO

&RQVLGHU DQ DYHUDJH SRZHU FRQVWUDLQW LQ WKH IRUP RI

E{sθ2} ≤ Aθ 

IRUθ ∈ Λ ZKHUH sθ LV WKH (XFOLGHDQ QRUP RI YHFWRU sθ DQG

Aθ GHQRWHV WKH DYHUDJH SRZHU FRQVWUDLQW IRUθ ,Q JHQHUDO

FRQVWUDLQW AθFDQ EH D IXQFWLRQ RIθ

_{,I WKHUH DUH PXOWLSOH PLQLPL]HUV DQ\ FRPELQDWLRQ RI WKHP FDQ EH FKR} VHQ IRU WKH RSWLPDO VROXWLRQ

)URP  DQG  WKH RSWLPDO VWRFKDVWLF SDUDPHWHU GHVLJQ SUREOHP IRU WKH WRWDO %D\HV ULVN FULWHULRQ FDQ EH VWDWHG DV

min {p_sθ, θ∈Λ}



Λw(θ) E{˜gθ(sθ)} dθ

VXEMHFW WRE{sθ2} ≤ Aθ, ∀θ ∈ Λ 

ZKHUH˜gθ(·) LV DV GH¿QHG LQ  'XH WR WKH VWUXFWXUH RI WKH RE

MHFWLYH IXQFWLRQ DQG WKH FRQVWUDLQW WKH FRQVWUDLQHG RSWLPL]D

WLRQ SUREOHP LQ  FDQ EH VROYHG VHSDUDWHO\ IRU HDFKθ DV

min

p_sθ E{ ˜gθ(sθ)} VXEMHFW WR E{sθ

2_{} ≤ A}

θ 

IRUθ ∈ Λ +HQFH WKH VROXWLRQ GRHV QRW GHSHQG RQ WKH SULRU GLVWULEXWLRQ w(θ)

:KHQ WKH PD[LPXP %D\HV ULVN FULWHULRQ LV FRQVLGHUHG WKH SUREOHP LQ  WDNHV WKH IROORZLQJ IRUP

min

psθ i∈{1,2}max (E{gθi(sθ)}) VXEMHFW WR E{sθ

2_{} ≤ A}

θ 

6LPLODU RSWLPL]DWLRQ SUREOHPV LQ WKH IRUP RI  DQG  KDYH EHHQ LQYHVWLJDWHG LQ WKH OLWHUDWXUH >@>@ 7KH SURE OHP LQ  KDV WKH VDPH IRUP DV WKH RQH FRQVLGHUHG LQ >@ 7KHUHIRUH WKH VWDWLVWLFDO EHKDYLRU RI WKH RSWLPDO VROXWLRQ LV WKH VDPH WKDW LV WKH RSWLPDO VROXWLRQ FDQ EH DFKLHYHG E\

D UDQGRPL]DWLRQ EHWZHHQ DW PRVW WZR GLIIHUHQW YDOXHV RIθ

7KHQ WKH RSWLPDO VROXWLRQ FDQ EH REWDLQHG EDVHG RQ D VLPLODU DSSURDFK WR WKDW LQ >@ 2Q WKH RWKHU KDQG WKH SUREOHP LQ  KDV D GLIIHUHQW IRUP WKDQ WKDW LQ >@ %DVHG RQ DUJXPHQWV VLPLODU WR WKRVH LQ >@ WKH IROORZLQJ UHVXOW FDQ EH REWDLQHG

3URSRVLWLRQ  6XSSRVH g_θ LV D FRQWLQXRXV IXQFWLRQ DQG HDFK FRPSRQHQW RIsθUHVLGHV LQ D ¿QLWH FORVHG LQWHUYDO 7KHQ

DQ RSWLPDO VROXWLRQ WR  FDQ EH H[SUHVVHG DV popt_sθ (x) = 3  j=1 λθjδ(x − sθj)  ZKHUH λ_θj ≥ 0 DQG3_j=1λ_θj = 1 

3URRI &RQVLGHU WKH VHW RI DOO(g_θ1(sθ), gθ2(sθ), sθ2) WULSOHWV DQG WKH VHW RI DOO(E{gθ1(sθ)} , E{gθ2(sθ)} , E{sθ2}) WULSOHWV DQG GHQRWH WKHP DV U DQG W  UHVSHFWLYHO\ 1DPHO\ U = {(u1, u2, u3) : u1 = gθ1(sθ) , u2 = gθ2(sθ) , u3 = sθ2,∀ sθ} DQG W = {(w1, w2, w3) : w1= E{gθ1(sθ)} , w2 = E{gθ2(sθ)} , w3 = E{sθ2} , ∀ psθ} $V LQ >@ >@

DQG >@ LW FDQ EH VKRZQ WKDW WKH FRQYH[ KXOO RI U LV HTXDO WR W  7KHQ EDVHG RQ &DUDWKHRGRU\¶V WKHRUHP >@ LW LV FRQFOXGHG WKDW DQ\ SRLQW LQ W FDQ EH H[SUHVVHG DV D FRQYH[ FRPELQDWLRQ RI DW PRVW IRXU SRLQWV LQ U ,Q DGGLWLRQ VLQFH DQ RSWLPDO 3') VKRXOG DFKLHYH WKH PLQLPXP YDOXH LW PXVW FRUUHVSRQG WR WKH ERXQGDU\ RI W  UHVXOWLQJ LQ D FRQYH[ FRP ELQDWLRQ RI DW PRVW WKUHH SRLQWV LQ U 7KHUHIRUH DQ RSWLPDO

VROXWLRQ FDQ EH H[SUHVVHG DV LQ 

3URSRVLWLRQ  VWDWHV WKDW WKH RSWLPDO VROXWLRQ FDQ EH DFKLHYHG E\ D UDQGRPL]DWLRQ EHWZHHQ DW PRVW WKUHH GLIIHUHQW YDOXHV IRU HDFKθ %DVHG RQ WKLV UHVXOW WKH RSWLPDO VWRFKDVWLF SDUDPHWHU GHVLJQ SUREOHP FDQ EH H[SUHVVHG DV

min {λ_θj, s_θj}3 j=1 max i∈{1,2}  ₃  j=1 λθjgθi(sθj)   VXEMHFW WR 3  j=1 λθjsθj2≤ Aθ, 3  j=1 λθj = 1 , λθj ∈ [0, 1]

IRUθ ∈ Λ &RPSDUHG WR  WKH IRUPXODWLRQ LQ  SUR YLGHV D VLJQL¿FDQW VLPSOL¿FDWLRQ DV LW UHTXLUHV RSWLPL]DWLRQ RYHU D ¿QLWH QXPEHU RI YDULDEOHV LQVWHDG RI RYHU DOO SRVVLEOH 3')V 6LQFH JHQHULF FRVW IXQFWLRQV DQG QRLVH GLVWULEXWLRQV DUH FRQVLGHUHG LQ WKH WKHRUHWLFDO DQDO\VLV g_θ1 DQG g_θ2 LQ  DUH TXLWH JHQHULF DQG WKH RSWLPL]DWLRQ SUREOHP LQ  FDQ EH QRQFRQYH[ LQ JHQHUDO 7KHUHIRUH JOREDO RSWLPL]DWLRQ WHFK QLTXHV VXFK DV SDUWLFOH VZDUP RSWLPL]DWLRQ 362 RU GLIIHU HQWLDO HYROXWLRQ FDQ EH XVHG WR REWDLQ WKH VROXWLRQ > @

5HPDUN  ,Q WKH JHQHULF PXOWLSDUDPHWHU FDVH ZLWK K SDUDPHWHUV WKH SUHYLRXV UHVXOWV FDQ EH H[WHQGHG DV IROORZV )RU WKH WRWDO %D\HV ULVN FULWHULRQ WKH RSWLPDO VROXWLRQ LV LQ WKH IRUP D SUREDELOLW\ GLVWULEXWLRQ ZLWK WZR SRLQW PDVVHV IRU DQ\ YDOXH RI K 2Q WKH RWKHU KDQG IRU WKH PD[LPXP %D\HV ULVN FULWHULRQ WKH RSWLPDO VROXWLRQ LV DFKLHYHG E\ UDQGRPL]DWLRQ

DPRQJ DW PRVW(K + 1) GLIIHUHQW YDOXHV RI θ

 180(5,&$/ 5(68/76

)RU D QXPHULFDO H[DPSOH FRQVLGHU DQ HVWLPDWLRQ SUREOHP LQ ZKLFK SDUDPHWHU YHFWRUθ = [θ1θ2]TLV WR EH HVWLPDWHG EDVHG

RQ REVHUYDWLRQ YHFWRUy = [y1y2]T_{ ZKLFK LV PRGHOHG DV}

y = sθ+ ρ(1 − I)sθ+ n 

ZKHUHsθ = [sθ1 sθ2]Tn = [n1n2]TI LV WKH LGHQWLW\ PD

WUL[ RI VL]H2 × 2 DQG 1 LV WKH PDWUL[ RI RQHV ZLWK WKH VDPH

VL]H n LV WKH DGGLWLYH QRLVH FRPSRQHQW ZKHUH n1 DQGn2

DUH LQGHSHQGHQW DQG LGHQWLFDOO\ GLVWULEXWHG *DXVVLDQ UDQGRP

YDULDEOHV VSHFL¿HG E\ 3')V p_n1(n) = pn2(n) = exp{−(n−

μ)2/(2σ2)}/(√2π σ) 7KH HVWLPDWRU LV JLYHQ E\ ˆθ(y) = y

ZKHUH HDFK SDUDPHWHU LV HVWLPDWHG LQGHSHQGHQWO\ EDVHG RQ WKH FRUUHVSRQGLQJ REVHUYDWLRQ 7KH FRVW IXQFWLRQ IRU HDFK SDUDPHWHU LV VHOHFWHG DV WKH XQLIRUP FRVW IXQFWLRQ ZKLFK LV H[SUHVVHG DVC[ ˆθi(yi), θi] = 1 LI | ˆθi(yi) − θi| > Δ DQG C[ ˆθi(yi), θi] = 0 RWKHUZLVH IRU i = 1, 2 %DVHG RQ WKLV PRGHO gθ1LQ  FDQ EH REWDLQHG DV gθ1(x) = Q  x1+ ρx2− θ1+ μ + Δ σ  + Q  −x1− ρx2+ θ1− μ + Δ σ   ZKHUH Q(x) = (1/√2π) _x∞exp{−t2_{/2}dt GHQRWHV WKH Q}

IXQFWLRQ E{sθ2} ≤ θ2LV FRQVLGHUHG IRU HDFKθ DV WKH

FRQVWUDLQW VWDWHG LQ  gθ2 IRU WKH VHFRQG SDUDPHWHU FDQ EH REWDLQHG VLPLODUO\

)RU WKH QXPHULFDO H[DPSOHV WKH SDUDPHWHU VSDFHV IRU ERWK

SDUDPHWHUV DUH VSHFL¿HG DVΛ₁ = Λ₂ = [−10, 10] $OVR sθi

FDQ WDNH YDOXHV LQ WKH LQWHUYDO[−10, 10] XQGHU WKH DYHUDJH

SRZHU FRQVWUDLQWE{sθi2} ≤ θi2IRU i = 1, 2 ,Q DGGL WLRQ WKH *DXVVLDQ QRLVH LV WDNHQ WR EH ]HUR PHDQ ZLWK σ = 0.5 DQG ρ LV FKRVHQ WR EH 0.25 6LQFH WKH QRLVH LV D ]HURPHDQ

UDQGRP YDULDEOH ˆθ(y) = y FDQ EH UHJDUGHG DV D SUDFWLFDO HV

WLPDWRU _{)LQDOO\Δ = 1 LV FRQVLGHUHG IRU WKH XQLIRUP FRVW}

IXQFWLRQ GHVFULEHG LQ WKH SUHYLRXV SDUDJUDSK

_{$OWKRXJK WKLV LV QRW DQ RSWLPDO HVWLPDWRU LW FDQ EH XVHG LQ SUDFWLFH GXH} WR LWV VLPSOLFLW\ FRPSDUHG WR WKH RSWLPDO HVWLPDWRU

θ1 θ2 λθ1 sθ1 λθ2 sθ2 λθ1 sθ1 λθ2 sθ2 λθ3 sθ3                                                            

7DEOH  2SWLPDO VWRFKDVWLF VROXWLRQ popt

sθ (x) = λθ1δ(x−sθ1)+λθ2δ(x−sθ2) IRU WRWDO %D\HV ULVN FULWHULRQ OHIW DQG RSWLPDO VWRFKDVWLF VROXWLRQ popt

sθ (x) = λθ1δ(x − sθ1) + λθ2δ(x − sθ2) + λθ3δ(x − sθ3) IRU WKH PD[LPXP %D\HV ULVN FULWHULRQ ULJKW

í   í       7RWDO5LVN θ θ 2SW6WRFKDVWLF 8QFRQVWUDLQHG &RQYHQWLRQDO

)LJ  7RWDO %D\HV ULVN YHUVXVθ1DQGθ2

í   í      7RWDO5LVN 2SW'HWHUPLQLVWLF 2SW6WRFKDVWLF θ θ

)LJ  7RWDO %D\HV ULVN YHUVXVθ1DQGθ2

,Q )LJ  WKH WRWDO %D\HV ULVNV IRU WKH VWRFKDVWLF SDUDPHWHU GHVLJQ WKH XQFRQVWUDLQHG SDUDPHWHU GHVLJQ DQG WKH FRQYHQ WLRQDO SDUDPHWHU GHVLJQ ZKLFK WUDQVPLWV WKH SDUDPHWHUV DV WKH\ DUH LH HPSOR\Vsθi= θi DUH LOOXVWUDWHG $OVR LQ )LJ  WKH WRWDO %D\HV ULVNV IRU WKH VWRFKDVWLF SDUDPHWHU GHVLJQ DQG WKH GHWHUPLQLVWLF SDUDPHWHU GHVLJQ ZKLFK HPSOR\V QR UDQ GRPL]DWLRQ DUH FRPSDUHG ,W LV REVHUYHG WKDW WKH VWRFKDVWLF GHVLJQ DFKLHYHV DQ LPSURYHPHQW RYHU WKH GHWHUPLQLVWLF DQG

FRQYHQWLRQDO GHVLJQV $OVR IRU VRPH YDOXHV RIθ1 DQGθ2

WKH SHUIRUPDQFH RI WKH VWRFKDVWLF GHVLJQ LV WKH VDPH DV WKH XQFRQVWUDLQHG GHVLJQ

,Q )LJ  WKH PD[LPXP %D\HV ULVNV IRU WKH VWRFKDVWLF SD UDPHWHU GHVLJQ WKH XQFRQVWUDLQHG SDUDPHWHU GHVLJQ DQG WKH FRQYHQWLRQDO SDUDPHWHU GHVLJQ DUH VKRZQ $OVR LQ )LJ  WKH PD[LPXP %D\HV ULVNV IRU VWRFKDVWLF SDUDPHWHU GHVLJQ DQG WKH GHWHUPLQLVWLF SDUDPHWHU GHVLJQ DUH FRPSDUHG $JDLQ VLPLODU REVHUYDWLRQV DV LQ WKH SUHYLRXV VFHQDULR DUH PDGH

,Q 7DEOH  WKH RSWLPDO VROXWLRQV IRU WKH VWRFKDVWLF WKH GHWHUPLQLVWLF DQG WKH XQFRQVWUDLQHG SDUDPHWHU GHVLJQ DS

í   í       0D[LPXP5LVN θ θ 8QFRQVWUDLQHG 2SW6WRFKDVWLF &RQYHQWLRQDO )LJ  0D[LPXP %D\HV ULVN YHUVXVθ1DQGθ2 í   í        0D[LPXP5LVN θ θ 2SW'HWHUPLQLVWLF 2SW6WRFKDVWLF )LJ  0D[LPXP %D\HV ULVN YHUVXVθ1DQGθ2

SURDFKHV DUH SUHVHQWHG IRU YDULRXV YDOXHV RI θ ,W FDQ EH

REVHUYHG WKDW WKH PD[LPXP QXPEHU RI PDVV SRLQWV LV WZR IRU WKH WRWDO %D\HV ULVN FULWHULRQ DQG LW LV WKUHH IRU WKH PD[LPXP %D\HV ULVN FULWHULRQ LQ DFFRUGDQFH ZLWK WKH WKHRUHWLFDO UHVXOWV

 &21&/86,216

,Q WKLV VWXG\ WKH RSWLPDO VWRFKDVWLF GHVLJQ RI PXOWLSOH SD UDPHWHUV KDV EHHQ LQYHVWLJDWHG IRU D JLYHQ VHW RI ¿[HG HVWLPD WRUV 7ZR GLIIHUHQW SHUIRUPDQFH FULWHULD KDYH EHHQ SURSRVHG QDPHO\ WKH WRWDO %D\HV ULVN FULWHULRQ DQG WKH PD[LPXP %D\HV ULVN FULWHULRQ ,W KDV EHHQ REWDLQHG WKDW LQ WKH SUHVHQFH RI K SDUDPHWHUV WKH RSWLPDO VWRFKDVWLF SDUDPHWHU GHVLJQ UHVXOWV LQ

D UDQGRPL]DWLRQ DPRQJ DW PRVW WZR DQG(K + 1) GLIIHUHQW SD

UDPHWHU YDOXHV IRU WKH WRWDO DQG PD[LPXP %D\HV ULVN FULWHULD UHVSHFWLYHO\ 7KH QXPHULFDO H[DPSOHV KDYH EHHQ SUHVHQWHG WR LQYHVWLJDWH WKH WKHRUHWLFDO UHVXOWV DQG WR LOOXVWUDWH WKH OHYHO RI LPSURYHPHQWV DFKLHYDEOH YLD WKH SURSRVHG DSSURDFK

 5()(5(1&(6

>@ 6 0 .D\ )XQGDPHQWDOV RI 6WDWLVWLFDO 6LJQDO 3URFHVV LQJ (VWLPDWLRQ 7KHRU\ 3UHQWLFH +DOO ,QF 8SSHU 6DG GOH 5LYHU 1- 

>@ + 9 3RRU $Q ,QWURGXFWLRQ WR 6LJQDO 'HWHFWLRQ DQG (VWLPDWLRQ 6SULQJHU9HUODJ 1HZ <RUN 

>@ + 6RJDQFL 6 *H]LFL DQG 2 $ULNDQ ³2SWLPDO VWRFKDV WLF SDUDPHWHU GHVLJQ IRU HVWLPDWLRQ SUREOHPV´ ,((( 7UDQV 6LJ 3URFHVVLQJ YRO  QR  SS ± 6HSWHPEHU 

>@ + &KHQ 3 . 9DUVKQH\ 6 0 .D\ DQG - + 0LFKHOV ³7KHRU\ RI WKH VWRFKDVWLF UHVRQDQFH HIIHFW LQ VLJQDO GH WHFWLRQ 3DUW ,±)L[HG GHWHFWRUV´ ,((( 7UDQV 6LJ 3UR FHVVLQJ YRO  QR  SS ± -XO\  >@ 6 0 .D\ ³1RLVH HQKDQFHG GHWHFWLRQ DV D VSHFLDO FDVH

RI UDQGRPL]DWLRQ´ ,((( 6LJ 3URFHVVLQJ /HWW YRO  SS ± 

>@ 6 %D\UDP 6 *H]LFL DQG + 9 3RRU ³1RLVH HQ KDQFHG K\SRWKHVLVWHVWLQJ LQ WKH UHVWULFWHG %D\HVLDQ IUDPHZRUN´ ,((( 7UDQV 6LJ 3URFHVVLQJ YRO  QR  SS ± $XJ 

>@ & *RNHQ 6 *H]LFL DQG 2 $ULNDQ ³2SWLPDO VWRFKDVWLF VLJQDOLQJ IRU SRZHUFRQVWUDLQHG ELQDU\ FRPPXQLFDWLRQV V\VWHPV´ ,((( 7UDQV :LUHOHVV &RPPXQ YRO  QR  SS ± 'HF 

>@ % 'XOHN DQG 6 *H]LFL ³'HWHFWRU UDQGRPL]DWLRQ DQG VWRFKDVWLF VLJQDOLQJ IRU PLQLPXP SUREDELOLW\ RI HUURU UHFHLYHUV´ ,((( 7UDQV &RPPXQ YRO  QR  SS ± $SU 

>@ + &KHQ 3 . 9DUVKQH\ DQG - + 0LFKHOV ³1RLVH HQKDQFHG SDUDPHWHU HVWLPDWLRQ´ ,((( 7UDQV 6LJ 3UR FHVVLQJ YRO  QR  SS ± 2FW 

>@ $ 3DWHO DQG % .RVNR ³2SWLPDO QRLVH EHQH¿WV LQ

1H\PDQ3HDUVRQ DQG LQHTXDOLW\FRQVWUDLQHG VLJQDO GH WHFWLRQ´ ,((( 7UDQV 6LJ 3URFHVVLQJ YRO  QR  SS ± 0D\ 

>@ 6 %D\UDP DQG 6 *H]LFL ³6WRFKDVWLF UHVRQDQFH LQ ELQDU\ FRPSRVLWH K\SRWKHVLVWHVWLQJ SUREOHPV LQ WKH 1H\PDQ3HDUVRQ IUDPHZRUN´ 'LJLWDO 6LJQDO 3URFHVV LQJ YRO  QR  SS ± 0D\ 

>@ ' 3 %HUWVHNDV $ 1HGLF DQG $ ( 2]GDJODU &RQYH[ $QDO\VLV DQG 2SWLPL]DWLRQ $WKHQD 6SHFL¿F %RVWRQ 0$ 

>@ . ( 3DUVRSRXORV DQG 0 1 9UDKDWLV 3DUWLFOH VZDUP RSWLPL]DWLRQ PHWKRG IRU FRQVWUDLQHG RSWLPL]DWLRQ SURE OHPV SS ± ,26 3UHVV  LQ ,QWHOOLJHQW 7HFKQRORJLHV±7KHRU\ DQG $SSOLFDWLRQV 1HZ 7UHQGV LQ ,QWHOOLJHQW 7HFKQRORJLHV

>@ . 9 3ULFH 5 0 6WRUQ DQG - $ /DPSLQHQ 'LIIHU HQWLDO (YROXWLRQ $ 3UDFWLFDO $SSURDFK WR *OREDO 2SWL PL]DWLRQ 6SULQJHU 1HZ <RUN