HBase????????ú?????????
??????????? ???????[ 2017/6/20 10:19:03 ] ?????????????? ??? Linux
???????????л?HBase???????????????????????????????????????????????????????????????Parquet??Carbondata??Hive??SparkSQL??TPC-DS/TPC-H????????????????????????????????????????????м????????????????????????????????????????????????????????????????о???????????????????????????????????檔
??????????????????????????????????ó?????????????????????????????????и????????????????????????????????????????????????????????????????????????????????????????????????????????????Щ?Σ????????г?????????????????????Щ???????????????飬??????????????????????????????????HBase??????????????????????????????
????????????????????????庬?壬?????????????о????????swap?????????????????????????????????ε?????????????????????????swap??Щ??????
????swap???????
??????Linux?£?SWAP??????????Windows???μ?“???????”??????????治??????ó??????????SWAP?????????????棩???????????????????????????
????SWAP????????????????壬?????????OS??????淢????????OS????????????????????????????????SWAP?????У??????????SWAP OUT????????????????Щ??????OS??????п?????????????????SWAP?????е??????????????????У??????????SWAP IN??
?????????swap??С?????????????swap???????????????OOM-Killer???????????????????kill?????????檔
??????????????????swap??
?????????swap????????????????????????t???????????OOM????????Ρ???????????????????????swap?????????????????MySQL??Oracal??MongoDB???HBase???????????????????????????й??
????1. ??????????????????????У???????swap??????棬?????????????????????????????????????е???????????????????????????κ???????????????????????swap????????????????????ζ????????????……??????????????swap???oom???????????????????????????????????????л?????????????????
????2. ???????????HBase???????????????????????????????崵?????????????????????????崵??????С????????????????????????????????????????????з??????????????????????????????ò????????????????????????????????????塣
?????????????????????????????????swap??????е?????
????swap?????????
???????????????swap???????????????????swapoff?????????????????????????????????????????????ζ??????????????????????????????????????????????????????0??1??????????????????????м???????Щ???0????Щ???1??????????????swap????????????????????????????á?HBase????????????????????????????????????????swap?????????????????????????swap??????ū???Linux???????????????????????????????κο???????
????????????swap????δ??????
???????????Linux????????????′??????????????????????????????????????????????????????????????????????????????swapd???????????????????м?飬???????潵???????????????????????????????????????????????????????????????????????
???????????????????????????????vm.min_free_kbytes????????????????????????watermark[min]?????????watermark[low]??watermark[high]?????????????
watermark[min] = min_free_kbytes
????watermark[low] = watermark[min] * 5 / 4 = min_free_kbytes * 5 / 4
????watermark[high] = watermark[min] * 3 / 2 = min_free_kbytes * 3 / 2
????watermark[high] - watermark[low] = watermark[low] - watermark[min] = min_free_kbytes / 4
?????????LInux???????λ???????min_free_kbytes???????min_free_kbytes???????????????????????????????????С??
????min_free_kbytes????С????min??low??????λ??buffer???С????kswapd??????????????????????????????????????????????????????漫?????watermark[min]???£???????????direct reclaim??????????????????ó??????????????н??л?????????????????????????????????????????????ó????????????????????????min_free_kbytes?????????????????????ó????????????????????????????????滹????kswapd??????????????????????????????????????????Java?????????????CMS?????????????????????????????????-XX:CMSInitiatingOccupancyFraction???????????????????min_free_kbytes????С??1G????????????????8G??????????????????????
???????????????????Linux??????????????????????????????????vm.min_free_kbytes??????????????Linux???????????Щ????Linux????????????????????
????1. ??????棬?????????????????????????ζ??????????????????????洢??????У????????????????????????????????????????????????漴????′???ζ???????????????????ж???????????HBase??????棩???????????????????????????????Щ?????????????????????????????????????????????????????д???????????????MySQL??????棩??
????2. ??????棬????????????????壬?????????????????????????????壬????????????????????????????????????????????д???????????y???У????????swap????????????????滻????????У???????????????????
????????Linux??????????????Щ????????????????????????????????????????????????ο??????????и???????????????????????????????????????????????????涼??????????????£?Linux????????ξ???????????????????????????????????????????????????????????????????swappiness????????????????????swap??????????????????????????swap????????????swap??????????????????Χ??0??100???????60?????swappiness????????????????????????????????????swappiness???????????????????????????????Щ???????????????????Щ???????Ч????swappiness????100???????????????????潫???????????????л???????60????????????????????????????????????????????????????????????????????????????2???????IO??????????????????С???????????????????swap??????????????????????????????0????????????????0????????????swap???
??????????????Linux??????????????Linux??????????????swap????????min_free_kbytes???swappiness???????????????????????????swap?й?????????zone_reclaim_mode????????????????????0??????NUMA??zone reclaim??????????????£?????NUMA????????????????????????DBA????????????????????????????С????NUMA??????NUMA??swap?????????zone_reclaim_mode????????壿
????NUMA??Non-Uniform Memory Access???????UMA?????????????CPU?????????????CPU????UMA?????????(??????????)?????
??????
???·???
??????????????????
2023/3/23 14:23:39???д?ò??????????
2023/3/22 16:17:39????????????????????Щ??
2022/6/14 16:14:27??????????????????????????
2021/10/18 15:37:44???????????????
2021/9/17 15:19:29???·???????·
2021/9/14 15:42:25?????????????
2021/5/28 17:25:47??????APP??????????
2021/5/8 17:01:11