Bài giảng Lý thuyết thông tin - Chương 3: Lý thuyết thông tin thống kê (Phần 2) - Phạm Văn Sự

      !"#$%&'()*+%,-./0123/45%*,$%6 7,897:*,/;*<-.%*'= >?@0-.%A$%6%6,.!B/@,+%,C-D%*,$%6 EFGFHGIFEE !-J%K8L%MN,L#CO%PQRN2=2S T/%6(BU%6VJ%, WXYXZY[XWW WY[\
   !"#$"% &'()(*)+,-./0123)4506,(*78(9:;9<0= >?@ABCDEF@GHIBFJKLMJNOPNQ@ARS@ATJDJKDUHV W X Y Z W > W [\]^]_` a^b_` cd_efghijklb_` menao V W [pqlb_` menaa^r_` i]a\s_tuaevk`kh_wV W [\s_tuxchbyz &'()(*)+,-{)|(}(*3)4506,(*78(9:;9<0= ~BFJKLMJNOPNQ@@€F?@ABCDEFV W X Y Z W ‚DPA€‚DƒJ„JKCDEF@GHJKLMJ ARS@…E@ATJD† ‡ ˆ ‰ŠXV W ‡‰ŠX ‡‰Š > W ‡ ˆ ‰Š[‹Œ_` aeŽ_` ak_a^b_` cd_eyr_`b_mena^ha^r_` i]a\s_tuaevk k`h_ws_tuxcka‘pz ‡ ˆ ‰Š ’“” XV W ‹r`‰•ŠX‹r`‰•Š–> W —$˜™š%›œ%žŸ ĂœÂÊ Ô ƠƯĐ˜ YăâăêâôăYY ôâôơ
   !"#$"%&'( ! )*+, -./01234567189:6;03>3?@A9B@CDEFGHC/GD3.IJ1/KLMAN7O@9PQ RS6JTJU6V6;IJ1//G43ODWO012Q XYZ[Z\[]^_X` +ab[c^ de^ Z\fgZhijhkdl mn40./6;@o6pq4prDsC0./IJtIuvKw/J>6;/463r/3xyDz{s|CTJ43}3.9x /J~ODWO6;@o63xyD36J6;J€OKL ‚ƒ z{s| „…† ‡z{s| z{s| „…† ƒˆ‡ z{s| z{s| „…† ƒˆ‡‰ ‰ƒ Š‹Œ Š‹Œ „…† Ž‘’“”•–•‘—•˜ ‚™š›‘œ•ž›Ÿ Ÿ—Ă“ÂʑÔƠŸƯ•Đ•ž›Ÿ”•ž•Ÿ—ăÂâêô‘™ơ›ư𑗕 ¯ °±²³´ àảãá ạáºằằàºẳẵắ࿳À³ÁÂàóÁ³àảÄá ÂÅặầ ẩ$ẫấậ%èÍ%ẻẽéẹềÍểễ ế ệ'ìẫ ỉÙÚÙÛÚĩÙỉỉ íÚĩị
    !"#$%&'(&)*%+,$!+,$*-!%./0*!&1$234(5!%6789: ;&1'$2!($?($@A!BC!&1'$2!($<9(&6D?+A!@A!BE FG*8AH!*%AI.$!($<9(=,+J K !%,$%!($<9(&6L M :NOL M PJ K QE ;9*/ !&AIR$!($*S6"#$%T K %6I!%'(2(6$!&A$23U$%/.!&AIR$7 !VHA!($ W K X Y Z K E [\]^ _` abcde_fgfh ijkl YmnmonpmYY qnpr CuuD uongThanCong.com https://fb.com /tailieudientucntt
   !"#$%& '()*)+*,-./0)*12)+)*345 6789:8;?@A?BCCDEFCGHI8C>HJK=LMJ N OE P QR STHLMJ N OE P Q;>U=VL>W8>H:CXYZ8>@AVA[=88>\;]^_CV`AaY;]b=V =>I8c=V^_CaBAV`AaY;;>U=V]b=V=>I8R '()*)+*,-./0)*1defg)+5 6789:8;?@A?BCCDEFCGHI8C>HJK=LMJ N OE P QRSTHLMJ N OE P QhLhCZ=G8i;jak ;lhaXYLMJ N OE P QhmhCZ=G8i;ha8>\;]^_CV`AaY]nAEo=VR pqrstuvsqrswxrsrsyzs{r|}~€r‚ƒ„…† ‡"ˆ‰Š&‹ŒŽŠ‘’ “”•– —˜™˜š™›˜—— œ™›œ
   !"#$%&'()* +,-.-/.01234-.5.6-/78-.9: ;?@ A BC D EFGHIJ>GKLG=MNOPQNRNLSITFUGSV=W>GRLXIGYILZ[\N]^ LG_F`IG ][aNJbScPF`IGFGHIJN^ IG\TdedQZ@ceffWg >?@ A BC D hC Dij hkkkhC j h@ Aij hkkkh@ j El>?@ A BC D E mno@ D pqrstustvwxpxsyz{pC D | >?@ j h@ } hkkkh@ ~ BC j hC } hkkkhC ~ Bl  ~ D€j >?@ D BC D E x‚oƒx„s…†sz‡ ˆx‰sŠ‹Œzo‚spŽ†sŠszsŒ{ŒŠq‘stŒzo‚s’“Œ{Œ>?@ A BC D E ”{Œ•–pŽ—s˜{Œ™ošpŒzo‚s›lœ> DA vwx> DA l>?@ A BC D E ›l ž Ÿ Ÿ Ÿ >?@ j BC j E >?@ } BC j E kkk >?@ Ă BC j E >?@ j BC } E >?@ } BC } E kkk >?@ Ă BC } E             >?@ j BC Ê E >?@ } BC Ê E kkk>?@ Ă BC Ê E Ô Ơ Ơ Ơ Ư Đ"(ă â&êôơư'âđ¯đ* °±²³ j´à´ảà}´jj ãà}á
   !"#$%&' ()*+*,+-. /01234567869::;4?18416@AB4C@DEFGHIJKL81M:N016@AB4184K O 15P 4?15Q4?18416@AB4C@D234516R4?S01NT4KU1578?8D4<VW E X FGHIJYK O EFGHIJY EFGHIJ Z O Z O [Z \ ]^_`abcd` ec` Z O YZ \ ]^_`aeaf`beagh`b Z O iZ \ ]^_`a` j` ec` kl mnom!pqrstouvuw xy z{|{}|~{zz |~€
   !"#$"%& '()*+*,-(.*,/0123145*(678692:;,82?98231:@A*,-(.*,-8*-60BC* /0145*(-6D*,EF-?G*H=-(78,81*:IB-(JDEK84()*+*,2L-(MN O P Q RST UVWX Y P Z[\]^ QRST W Y P Z[\]^ QH _ RST W YZ[\]^ a`8-bcd Q H _ O OQRST W YZ[\]^efghijiklgmiknoSpqSfrigstuvwuRxuyzo{ | }~€‚ƒ„…†‡ˆ‰Š‡‹ŒŽ | }~‡‘’“‘”•–—˜™“š ›œigpgzle O P žŸO P Qžfguv pgĂfgu[v ]g il isÊpÔƠƯĐ frig âăsêl{ O P ôH _ ÔÂkZơ^ ươÔ sÊÔwipqSikođi[¯ O P ôH _ ÔÂkZ° ư^° Ô sÊÔwipqSikođi]¯ ±²³´ àảã´ ạáºãằẳẵ´ ắ¿ÀạÁÂÁà ÄÅ´ặầẩẫ´ặấ³´º ậèÍèẻÍẽèậậ ẻÍẽé CuuD uongThanCong.com https://fb.com /tailieudientucntt
   !"#$%$&'()* +,-./012345623782929:;9?29@A79=2329BC1 DE82929:;9<24FG5H23I JKLMNOKOKPQKROSTUSVWMKXOYWZOK[OK\K]OK^ _` \[UaRbcdUefgMNOKMKXOY WZOKUhijklWmnkoOKUpiQKqkkKia\rWsQKotkKiMKXOYWZftUuMKXOYWZmvUwc xqWfiykQKqkkoOKUpizmnQc{oOKMKeO|OYkKXOY}itW~tMNOKc "&€#&‚ƒ„(€…* † !"# )‡ˆ‡‰ˆŠ‡)) ‹ˆŠ
   !"#$%$&'()* +,-./012323453627382923:;?29@ABCD EFGHIJKJKLMKNJOPQORSHKTJUJKVWXQYZJUJK[K\JK]^_` aJKbcJUd[eJUHIJK_ "f&g#&hijk(gl* m !"# nopoqp)onn nop)
   !"#$%$&'()* +,-./01232345362789:;2:>?@A92?BCDB?EFBD =3?22DGH IJKLMNJNJOPJQNRSTRUVWXTYZN[LJ\N[NJ]V^ Y^_NJ` JaNJbcdefTLJTgJh W`iVLjJTkhlN^ mcY^_dnjNJLJoNpN[gJ\N[qh_Vr_LMNJd "s&t#&uvwx(ty* z !"# {|}|~}|{{ {{}
   !"#$%#& '()*+, -./012343561789 : ;?@AB835/C3DEFDG><31H1I3012343581J35K/@ >?@0L31M9 : ;<=NO : P81Q8C38GFAB861R6AS1T@UV5F2FASW@X>1XUFY> 8D/Z[38F3K/@0L31>T\7>W/]8^_F31H8`Za01FbBcVF8dASb?^e3f-5gh>^GF 81Q01J358C38GFAB861R6AS1T@3VX31gUiZf '()*+, -./8j>bBck^FY/>l38D/Z[3m8D/Z[3K/@0L31>Tc/35^gh35O81H@AS3 mNO81Q8C38GFAB861R6AS1T@UV5F2FASW@X>1XUFY>8D/Z[38F3K/@0L31 >T\7>W/]8^_F31H8`Za01FbBcVF8dASb?^e3f-5gh>^GF81Q01J358C38GFAB8 61R6AS1T@3VX31gUiZf -1i3\R8nopqrsturvwxyzqry{qy|}~r€qurvwxu‚urƒ„…†‡q ˆ%‰Š&‹Œ&ŽŒ‘’‘“ ”! •– —‰ ˜™š™›š™˜˜ ˜šœ CuuD uongThanCong.com https://fb.com /tailieudientucntt
 
  
  !!"#$ % &'()*+,-./0123.4(562'7862/9.: &01;237+8?@AB82C>/D?@/01;237+80(BA>/C>/DE F@).'>GH2I'@))J/,KC'L2M+NO.*>=/,H/'>,1P.QRST5'8,UC'O/ VRST:WRQRSTXVRSTT &+.,K/0>GY2.4(562'Z [ \62'0;80]..'^(562'7862/9.: _`abcd efghihjSfkhjlmnopnqrhfstrhSuoqfkhjhfvfwhqfghihjSfkhjlmnopn qrhfxytxzoof{nh|} ~ €‚ƒ„… †~ ‡ˆ€‡‰……Š‹Œ€‚ƒ„… #!Ž‘’“”•–—‘˜™˜š › œ žŸ ŸĂ ÂŸžž žÊ ÂÔ
 
  
  !"# $%&'&(')*+,-&'.*/0012 3456789::;?@ABCDEF<456BA45FGHHIFJKFA5BLAMCNMCFJKFA5BLAO8BA45 6PMQA5689F6;NH=5>F6RHS TUFVWXYUFVZ5UFV FON5>?ISXWHN5:F[5UFVBC56A\9HE5>H]5>^ABC56A\9FO_5>HIK6`5aLH69b5 cUXde f Vg YUFVhijTUFVhkjlm5UFVhnonhcUpde f q V YUFVlm5UFVrstuvwxyz{| } e f ~ We f  Ze f q yz€‚ƒx„r‚ƒx„… ~ W…  Z… q † ‡ˆ‰Šˆ‹ŒŽŠ‘’‘“ ”#•–—# ˜™š™›šf™˜˜ ˜œšf
 
  
  !"#$% &'()*+,'()-.'() /01234+*56.'()78'9:; < = )6 ,'()>?&'()@ABC@DEFGBHI@FJKB L'MNO)*P'O)QP'ORM) P'O)*STU V WXYZ [ \]^BC_DZ [ *+ < Z ` -Z = P'ORM)*Q aa b',:&)STU'b'&R,))c,c& d efghijhklmnefgoijomp qrhklsjhnqrosjop qrhklsnqros t= t[ nqros u t[ t= nqros d v wrxkysnz{| } ~€e =  L'MNO)* u < STU ‚ 5- ƒ ` ƒ = „ …!†‡ˆ‰Šˆ‹ŒŽŠ‘’‘“ ”• ! u–—–˜—<–uu u™—<™
 
  
  !"#"$%& '()*+*,-(.*,/0123145*(675*-8292:*,;76?*,45*(675*-8296<,7@ -AB2C2DE72316>?*,-(.*,-7*-A0FG*/0145*(-AH*,IJ-DK*LB-(M7,71*6NF -(OHI;74()*+*,2P-(Q231R(S*TU*,0V*R(@--AH*,DP4QDW*,7X7(E*2.*, Y0N-R(@-Z [ \ ]L ^ _` a bcdefghd i cjeklm nopqrs]L ^ _` a tfghd i cjeklm nopqrs [] _` a bcdefghd i cjeklm nopqrs] _` a tfghd i cjeklm nopqrs L ^ ] u vj wxyz-{|}~y€y`‚y‚ƒ„~…`† ‡ !"ˆ‰‰Š#‹Œ& '5*(ŽLX7,7X7(E*2.*,Y0N-R(@-‘L?*,“ [ \ ] L ^ ” {•€ – —˜ ™ i ‘ ‘ š › [] — ” {•€ – —˜ ™ i ‘ ‘ š › œžŸ ĂŸÊÔƠÂƯĐăŸâêôÔơươđ °¯Ÿ±²³´Ÿ±àžŸƠ uảãảáãiảuu uạãiº CuuD uongThanCong.com https://fb.com /tailieudientucntt
 
  
     !"#$%&'()*+,-./$+01))20/$34/5-67)8/5&90)2:/); ?@ABC "#DEF G H DEI"#21)3J)54-K)5L-M&/5NO:/53PQR)S TL)U/$G H )54-V/)U/$"#W)0X/5&:/Y&9-)U/$/(X3P$&Z&5;/[MG H 2\& Y(M)4/5)2;/$3]M5^7S _`abcdecfghijkelmln opqrstqua vwxwyxwvv vzx{
 
  
   !"# $% !"&' !""() !" *+,-./0123456789:-;?@A7,-4B@-C4:-DCE F GHI/JKLMN ) !"O8P:Q,>R@,>WX4UY7Z[,>7_,` IKLMNa bc<89UAd5e@f g hi jklmnopqrlsntulsvwxyzlm{|}~€ls‚lmƒrm„l… †‡'ˆ‰Š‹'ˆŒŽ')‘` ’E“”•–—'ˆ!˜')™‡)š'` “›ˆ•”•)š'Œœ'ˆ‡ž!Ÿ) ! Ă Â ŒÊ')•Ô‡“”•ƠƯ!Đ㠟)⌜'ˆ‡ž!)Ž•Ÿ)êŽE F GHЊ‹Œ% ŒĐô')ơ ư đ #` U¯> ° ±& $ h Ă Â E F ` ² ³–Ÿ´ àảãáạºằẳẵắ¿ºÀÁÀ ÃÄÅặầẩ gFẫFấẫhFgg gấẫhậ
 
  
  !"# $%&' ()*+ ,-./01 2 ,3 4 56789: ;< = > ?:@ A ;< B@CD + EF-1E1 2 G H I J K L M A NOP J QRF3 4 STUVWXYVZ[X\]XT^_VWZ`YabVWXcV\dX\eVWf gh1 2 h1 2 G 4 56789SijklVTYmXnoUVXpVXiYf qrs6t8uqrs6t8v6wssxsyz6x{|s6t}|s~z€ 1‚ƒ„…†ƒ‡ˆƒ‰Šˆ‰‹‚‚Œ‡ŽŒ‘’“‡‰…”•ƒ‡Q–—˜ƒ™ˆ˜ƒ‡š‚’›ˆœ‚…ž‡‘ˆ Ÿ ‡Ă”—ˆ„ˆÊˆ‚‚‡ÔƒˆƠ…ƒƯƒĐă₃ꅗÊƒôƒ„ơ‡‚ư‘ƒ„…†ƒƒđ ¯ƒ—Êƒôƒ„‡°ƒ„±…‘‚ư‘—˜ƒ²³„ăₙ‹ˆ´—°ƒ„‡Ž‡à‚ˆƠƒĐăâ‚ơ ơ Œ‘’“„ˆÊˆ’›ˆ‘ˆảŸ ‡Ă”² ã/á ạºNằẳ LẵA ắ¿ÀœÁ ÂÃL HQ ÄÅ"!ặầẩẫấậèầÍẻÍẽ éẹề$ểễ ÂAếAệếJA ÂìếJỉ
     !"#$%&' ()*+,-./0123 4 5 6789: 5 ;< 5 6789= 5 ( 5 6789> 5 ?@AB+C-D4 5 678EF( 5 678-./0123 > 5 9G6HIJ K 5 83 LM+C/N+COPQ@2,R@STCUVU,W+X Y Z[: K 5 \]^ _`ab Lcd/R/,2,e+SM@M+C/N+COPQ@2,R@CUfg/R/)*+,OgB/,B,h-W@-ij/kP+C 0ij+C/l/-WU3 mno!pqrpstuvwxryzy{ |%}~€}&n ‚ƒ‚„ƒK‚ K‚ƒK… CuuD uongThanCong.com https://fb.com /tailieudientucntt
     !"#$% &'()*+ ,-./0122341561/789:;?@ABC=D=;EFAGHI J KI L KMMMKI N K=D=;EFOP Q J KQ L KMMMKQ N KABC=D=.D=;?@: J K: L KMMMK: N ST=U>VW12.C1 .VX12/Y./ZP4[1\].;^12./_=` abI J cI L cMMMcI N dQ J cQ L cMMMcQ N ef g h i j klm n io p q h p N h r &'()(s)tuvwx(s*yz(s{|u}~()€‚ ƒF12>VW12=„P561/2341;EFAGHAG1;EFOP;VW=…D=;†1/\‡C=ˆ12./_=` ‰Š ‹Œ Žq J q L ‘‘‘q N ’“ ” •–— L ˜ ™š› abI J cI L cMMMcI N dQ J cQ L cMMMcQ N e œžŸ Ă ÊÔƠƯĐ Âăâêâô ơưđ ¯ J°±°²±L°JJ LJ±L³
      !"##$%"&'" ()*+,-./0123"#23"#.456"#/78"#9:"#;"#56"# /78"#."& ?@=. A& ?,>6@=3.41 B"9!. 6C" DE%F.<. ,?G6&?"H IJ K LJ M LNNNLJ O PQR S TL U V V V W X Y K T NNN T T X Y M NNN T Z Z Z Z Z Z Z Z Z Z Z Z T T NNNX Y O [ \ \ \ ] ^ O _ a`K X Y ` bX cdefghifjklimnofpqrkstsu vwfxyz{fx|efl K}~}~M}KK MM~M€
     !"#$%&%' (
)** +,-./01234526789:-424;?6@56=A-4BC-.D E FGHID J E K L 2MN-.=OH =>?664P-/8N64N Q E GHID J E K L FDR GSK L TUVW24UV=>?6@56=A-4BXYZ GSK L F [ S S\] ] S^ ] _%`abcdbefghijdkl m'&no'p` qrsrtsurqq uvsuw
     !"#$%&%'#(%) *+,-./0,--123-453367,8239:;?-6-@ABC,-D8EFG6,>G6,> H%IJKLMKNOPQRSMTU V'&WX'YI Z[\[]\^[ZZ _^\^` CuuD uongThanCong.com https://fb.com /tailieudientucntt
    !"!# $%&'()&* +,-,.-/,++ /0-/0 CuuD uongThanCong.com https://fb.com /tailieudientucntt