41 LQWURGXFWLRQ
Wklv sdshu lv wkh uvw vwhs lq xqghuvwdqglqj krz wr frqvwuxfw wkh khwhurvnhgdvwlflw|
dqg dxwrfruuhodwlrq frqvlvwhqw +KDF, fryduldqfh pdwulfhv lq sdqho gdwd prghov1 Dq lp0
sruwdqw ghyhorsphqw lq sdqho gdwd prghov kdv ehhq wkh prghoolqj ri vhuldo fruuhodwlrq1 Wr
dffrxqw iru vhuldo fruuhodwlrq/ uhvhdufkhuv riwhq dvvxph d sduwlfxodu irup iru vhuldo fruuhod0
wlrq lq wkh prgho/ h1j1/ Kdxvh +4<::/ 4<;3,/ Oloodug dqg Zloolv +4<:;,/ Dqghuvrq dqg Kvldr
+4<;5,/ Ehuu| hw do1 +4<;;,/ Edowdjl dqg Ol +4<<4,/ Nhdqh dqg Uxqnoh +4<<;,/ Ohylww +4<<;,/
Nduovvrq dqg Vnrjoxqg +5333,/ Sdun dqg Vlfnohv +5333,/ dqg Eoxqghoo dqg Erqg +4<<<,1 Doo
wkhvh sdshuv dvvxphg d nqrzq irup +h1j1/ DU+4, ru PD+4,, iru vhuldo fruuhodwlrq wr rewdlq
frqvlvwhqw hvwlpdwruv dqg uhodwhg fryduldqfh pdwul{ hvwlpdwruv1 Kdxvh +4<::/ 4<;3,/ Oloodug
dqg Zloolv +4<:;,/ dqg Edowdjl dqg Ol +4<<4, xvhg wkh jhqhudol}hg ohdvw vtxduhv hvwlpdwru
+JOV,/ zkhuhdv Dqghuvrq dqg Kvldr +4<;5, frqvlghuhg d pd{lpxp olnholkrrg hvwlpdwlrq
+POH, zlwk qrupdolw|1 Nduovvrq dqg Vnrjoxqg +5333, dqg Vnrjoxqg dqg Nduovvrq +5334d,
frqvlghuhg wkh POH lq d wzr0zd| huuru frpsrqhqw prgho zkhq wkh wlph0vshflf frpsrqhqw
iroorzv dq DU+4, ru PD+4, surfhvv1 Vnrjoxqg dqg Nduovvrq +5334e, lqwurgxfhg wkh vhuldo
fruuhodwlrq ri jhqhudo irup lq wkh wlph hhfwv dv zhoo dv wkh huuru whupv1 Wkh| sursrvhg d
pd{lpxp olnholkrrg hvwlpdwru dqg glvfxvvhg d prgho vhohfwlrq surfhgxuh iru ghwhuplqlqj
wkh rughuv ri vhuldo fruuhodwlrq dqg wkh lpsruwdqfh ri wlph dqg lqglylgxdo hhfwv1
Wkhvhv hvwlpdwruv duh frqvlvwhqw dqg h!flhqw zkhq wkh dvvxphg irup ri vhuldo fruuhodwlrq
lv fruuhfw/ dqg wkh uhodwhg fryduldqfh pdwul{ hvwlpdwruv duh h{shfwhg wr shuirup zhoo lq qlwh
vdpsohv1 Krzhyhu/ lq sudfwlfh/ qr sulru lqirupdwlrq derxw vhuldo fruuhodwlrq lv dydlodeoh1 Lq
sduwlfxodu/ wkh dvvxpswlrq ri d frpprq vwuxfwxuh ri vhuldo fruuhodwlrq iru doo lqglylgxdov duh
ryhuo| vwurqj dqg duh olnho| qrw wr krog lq sudfwlfh1 Lw lv d uxoh udwkhu wkdq dq h{fhswlrq wkdw
ghjuhhv ri vhuldo fruuhodwlrq zloo ydu| dfurvv lqglylgxdov1 Dq| plvvshflfdwlrq ri vhuldo fru0
uhodwlrq pd| ohdg wr plvohdglqj frqfoxvlrqv lq hvwlpdwlrq/ lqihuhqfh dqg k|srwkhvlv whvwlqj1
Wklv lv vr hyhq zkhq hvwlpdwruv uhpdlq frqvlvwhqw +h1j1/ wkh ROV iru wkh vwdwlf sdqho prghov,/
ehfdxvh lq jhqhudo wkh fryduldqfh hvwlpdwruv wkdw lqfrusrudwh wkh dvvxphg vhuldo fruuhodwlrq
zloo eh qrw frqvlvwhqw1 Lw lv lpsruwdqw wr ghyhors surfhgxuhv wkdw duh urexvw wr vhuldo fru0
uhodwlrq ri xqnqrzq irup1 Wklv sdshu frqvlghuv d jhqhudo sdqho prgho iru wkh huuru whupv
wkdw pd| kdyh khwhurjhqhlw| dqg vhuldo ghshqghqfh ri xqnqrzq irup1 Pruh lpsruwdqwo|/ zh
sursrvh d fodvv ri KDF hvwlpdwlrq ri fryduldqfh pdwulfhv xvhg lq sdqho gdwd1
KDF hvwlpdwruv duh qrw dv riwhq xvhg lq sdqho prghov dv lq wlph vhulhv/ exw dwwhqwlrq
wr wklv lpsruwdqw lvvxh kdv ehhq lqfuhdvhg ryhu wkh odvw ihz |hduv1 Ryhu wkh orqj wlph lq