XtremIOã®äž»ãªç¹åŸŽã¯ããã®ã¢ãŒããã¯ãã£ãšæ©èœã«ãããŸã ã ãŸããSSDã®ã¹ããŒã¹ãç¯çŽããã€ã³ã©ã€ã³éè€æé€ãå§çž®ãã·ã³ããããžã§ãã³ã°ãªã©ãåžžææ©èœããéåæãµãŒãã¹ã䜿çšããŠã¢ãŒããã¯ãã£ãæåã«æ§ç¯ãããŸããã 第äºã«ãXtremIOã¯æ°Žå¹³ã«ã¹ã±ãŒã©ãã«ãªã¢ãžã¥ãŒã«ã®ã¯ã©ã¹ã¿ãŒïŒX-BrickïŒã§ããããã®éã§ããŒã¿ãšè² è·ãèªåçã«åçã«åæ£ãããŸãã åæã«ãæšæºã®x86æ©åšãšSSDã䜿çšãããæ©èœã¯ãœãããŠã§ã¢ã«å®è£ ãããŸãã ãã®çµæãé«éãªãã£ã¹ã¯ã ãã§ãªããç¹ã«ãµãŒããŒä»®æ³åãVDIããŸãã¯è€æ°ã®ã³ããŒãå«ãããŒã¿ããŒã¹ãªã©ã®ã¿ã¹ã¯ã§ãéè€æé€ãšå§çž®ã«ãã容éãç¯çŽã§ããã¢ã¬ã€ãå€æããŸããã
ããŸããŸãªãã¹ããžã®ææ ã¯ãEMCã®é·æã§ã¯ãããŸããã ããã«ãé¢ããããç§ãã¡ã«ãšã£ãŠã¯ããªã¢ãŒããªãã£ã¹ã®å¥¥æ·±ãã«ããããŒã«ã«ãªãã£ã¹ã®ã€ãã·ã¢ããæ¯æŽã®ãããã§ã2ã€ã®X-Brickã·ã¹ãã ãå«ãã¹ã¿ã³ããçµã¿ç«ãŠãããŸããã ããã«ãããéçºããæ¹æ³è«ã«å¯èœãªéãè¿ãäžé£ã®ãã¹ããå®æœã§ããŸããã
ã³ãŒãã®ããŒãžã§ã³2.4ã§ãã¹ããè¡ââãããããŒãžã§ã³3.0ãå©çšå¯èœã«ãªããé 延ã®ååãèšèŒãããŠããŸãã
ãã¹ãæ¹æ³
ãã¹ãäžã«ã次ã®ã¿ã¹ã¯ã解決ãããŸããã
- é·ãæžã蟌ã¿è² è·ã§ã®ã¹ãã¬ãŒãžããã©ãŒãã³ã¹ã®äœäžã«é¢ããç 究ïŒWrite CliffïŒã
- ããŸããŸãªè² è·ãããã¡ã€ã«ã®EMC XtremIOã¹ãã¬ãŒãžããã©ãŒãã³ã¹ã®èª¿æ»ã
ãã¹ããããæ§æ
|
å³1.ãã¹ããã³ãã®ãããã¯å³ã |
ãµãŒããŒ
SHD
è¿œå ã®ãœãããŠã§ã¢ãšããŠãSymantec Storage Foundation 6.1ããã¹ããµãŒããŒã«ã€ã³ã¹ããŒã«ããã以äžãå®è£ ããŸãã
- è«çããªã¥ãŒã ãããŒãžã£ãŒïŒVeritas Volume ManagerïŒã®æ©èœã
- ãã£ã¹ã¯ã¢ã¬ã€ãžã®ãã§ãŒã«ã»ãŒãæ¥ç¶ã®æ©èœïŒãã€ãããã¯ãã«ããã¹ïŒã
éå±ãªè©³çŽ°ãšããããçš®é¡ã®ã¹ããŒãã¯ãŒããåç
§ããŠãã ããã
ãã£ã¹ã¯I / Oã®é
延ãæžããããšãç®çãšããŠããã¹ããµãŒããŒã§æ¬¡ã®èšå®ãè¡ããŸããã
ã¹ãã¬ãŒãžã·ã¹ãã ã§ã¯ããã£ã¹ã¯é åãããŒãã£ã·ã§ã³åå²ããããã®æ¬¡ã®æ§æèšå®ãå®è¡ãããŸãã
ã¹ãã¬ãŒãžã·ã¹ãã ã§åæè² è·ãäœæïŒåæãã¹ããå®è¡ïŒããã«ã¯ãFlexible IO TesterïŒfioïŒãŠãŒãã£ãªãã£ããŒãžã§ã³2.1.4ã䜿çšããŸãã ãã¹ãŠã®æš¡æ¬ãã¹ãã§ã¯ãfioã»ã¯ã·ã§ã³[ã°ããŒãã«]ã®æ¬¡ã®æ§æãã©ã¡ãŒã¿ãŒã䜿çšãããŸãã
次ã®ãŠãŒãã£ãªãã£ã¯ãåæè² è·ã®äžã§ããã©ãŒãã³ã¹ã€ã³ãžã±ãŒã¿ãååŸããããã«äœ¿çšãããŸãã
- I / Oã¹ã±ãžã¥ãŒã©ãŒã¯ããã©ã¡ãŒã¿ãŒã«noopå€ãå²ãåœãŠãããšã«ããããcfqããããnoopãã«å€æŽãããŸããã
/sys/<___Symantec_VxVM>/queue/scheduler
- 次ã®ãªãã·ã§ã³ã
/etc/sysctl.conf
è¿œå ãããSymantecè«çããªã¥ãŒã ãããŒãžã£ãŒã¬ãã«ã§ãã¥ãŒã®ãµã€ãºãæå°åãããŸããã«vxvm.vxio.vol_use_rq = 0»
; - ããã€ã¹ãžã®åæI / OèŠæ±ã®å¶éã¯ã1024ã®å€ã
/sys/<___Symantec_VxVM>/queue/nr_requests
å²ãåœãŠãããšã«ããã1024ãŸã§å¢å ã/sys/<___Symantec_VxVM>/queue/nr_requests
-
/sys/<___Symantec_VxVM>/queue/nomerges
å€1ãå²ãåœãŠãããšã«ãããI / Oæäœã®ããŒãžïŒiomergeïŒã®å¯èœæ§ã®ãã§ãã¯ãç¡å¹ã«ããŸãã - å
èªã¿ã¯ã0ã®å€ã
/sys/<___Symantec_VxVM>/queue/read_ahead_kb
å²ãåœãŠãããšã«ãã£ãŠç¡å¹ã«ãªã/sys/<___Symantec_VxVM>/queue/read_ahead_kb
- FC HBAã®ããã©ã«ãã®ãã¥ãŒãµã€ãºã䜿çšãããŸãïŒ30ïŒã
ã¹ãã¬ãŒãžã·ã¹ãã ã§ã¯ããã£ã¹ã¯é åãããŒãã£ã·ã§ã³åå²ããããã®æ¬¡ã®æ§æèšå®ãå®è¡ãããŸãã
- ã¹ãã¬ãŒãžã§ã¯ãããã©ã«ãã§ããã¹ãŠã®ã¹ããŒã¹ãããŒã¯ã¢ãããããç©ç容éã®è«çããŒãã£ã·ã§ã³ã®ã¿ã®å¯èœæ§ããããŸãã
- ã¹ãã¬ãŒãžã·ã¹ãã äžã«åããµã€ãºã®32åã®LUNãäœæãããããããäžç·ã«ã¹ãã¬ãŒãžå®¹éã®80ïŒ ãå ãã8ã€ã®ã ãŒã³ãæã«æ瀺ãããŸãã
ãã¹ããœãããŠã§ã¢
ã¹ãã¬ãŒãžã·ã¹ãã ã§åæè² è·ãäœæïŒåæãã¹ããå®è¡ïŒããã«ã¯ãFlexible IO TesterïŒfioïŒãŠãŒãã£ãªãã£ããŒãžã§ã³2.1.4ã䜿çšããŸãã ãã¹ãŠã®æš¡æ¬ãã¹ãã§ã¯ãfioã»ã¯ã·ã§ã³[ã°ããŒãã«]ã®æ¬¡ã®æ§æãã©ã¡ãŒã¿ãŒã䜿çšãããŸãã
- ãã€ã¬ã¯ã= 1
- ãµã€ãº= 3T
- ioengine = libaio
- group_reporting = 1
- norandommap = 1
- time_based = 1
- randrepeat = 0
次ã®ãŠãŒãã£ãªãã£ã¯ãåæè² è·ã®äžã§ããã©ãŒãã³ã¹ã€ã³ãžã±ãŒã¿ãååŸããããã«äœ¿çšãããŸãã
- ã¹ãã¬ãŒãžã·ã¹ãã ã®ç£èŠãšèšºæã®ããã®ã€ã³ã¿ãŒãã§ãŒã¹ãšããŒã«ã
- åè² è·ãããã¡ã€ã«ã®èŠçŽã¬ããŒããçæããããã®fioããŒãžã§ã³2.1.4
ãã¹ãããã°ã©ã ã
ãã¹ãã¯ããã¹ããããã·ã¹ãã ããæ瀺ããã8ã€ã®LUNããVeritas Volume Managerã䜿çšããŠäœæãããã¿ã€ã
stripe, 8 column, stripewidth=1MiB
è«çããªã¥ãŒã ã§ãããããã¯ããã€ã¹äžã®fioããã°ã©ã ã§4ã€ã®ãµãŒããŒããåæã«åæè² è·ãäœæããããšã«ãã£ãŠå®è¡ãããŸããåãµãŒããŒäžã äœæãããããªã¥ãŒã ã«ã¯ããŒã¿ãäºåã«å ¥åãããŠããŸãã
ãã¹ãã¯ã2ã€ã®ãã¹ãã°ã«ãŒãã§æ§æãããŸããã
詳现ãå°ãã
ãã¹ãè² è·ãäœæããå Žåãfioããã°ã©ã ã®æ¬¡ã®è¿œå ãã©ã¡ãŒã¿ãŒã䜿çšãããŸãã
ãã¹ãæé-18æéã
ãã¹ãçµæã«åºã¥ããŠãvxstatããŒã ã«ãã£ãŠåºåãããããŒã¿ã«åºã¥ããŠããã¹ãçµæãçµã¿åããããã£ãŒãã圢æãããŸãã
åŸãããæ å ±ã®åæãå®è¡ããã以äžã«ã€ããŠçµè«ãäžãããŸãã
ãã¹ãäžã«ã次ã®ã¿ã€ãã®è² è·ã調æ»ãããŸãã
ãã¹ãã¯3段éã§è¡ãããŸãã
åæ§ã®ãã¹ãã¢ã«ãŽãªãºã ã䜿çšãããšãç¹å®ã®è² è·ãããã¡ã€ã«ã«å¯Ÿãããã£ã¹ã¯ã¢ã¬ã€ã®æ倧ããã©ãŒãã³ã¹ãããã³è² è·ã«å¯Ÿããé 延ã®äŸåæ§ãå€æã§ããŸãã
ãã¹ãçµæã«åºã¥ããŠãååŸããiopsãšã¬ã€ãã³ã·ã®ãã£ãŒããšè¡šãäœæããçµæãåæããŠãã¹ãã¬ãŒãžã·ã¹ãã ã®ããã©ãŒãã³ã¹ã«é¢ããçµè«ãåºããŸãã
ã°ã«ãŒã1ïŒã©ã³ãã æžã蟌ã¿ã¿ã€ãã®é£ç¶ããŒããå®è£ ãããã¹ãã
ãã¹ãè² è·ãäœæããå Žåãfioããã°ã©ã ã®æ¬¡ã®è¿œå ãã©ã¡ãŒã¿ãŒã䜿çšãããŸãã
- rw = randwrite
- ãããã¯ãµã€ãº= 4K
- numjobs = 10
- iodepth = 8
ãã¹ãæé-18æéã
ãã¹ãçµæã«åºã¥ããŠãvxstatããŒã ã«ãã£ãŠåºåãããããŒã¿ã«åºã¥ããŠããã¹ãçµæãçµã¿åããããã£ãŒãã圢æãããŸãã
- æéã®é¢æ°ãšããŠã®IOPSã
- æéã®é¢æ°ãšããŠã®ã¬ã€ãã³ã·ãŒã
åŸãããæ å ±ã®åæãå®è¡ããã以äžã«ã€ããŠçµè«ãäžãããŸãã
- æžã蟌ã¿ãšèªã¿åãã®è² è·ãé·ããªããããã©ãŒãã³ã¹ãäœäžããã
- é·ãããŒã¯è² è·ã®äžã§èšé²ããããã®ãã£ã¹ã¯ã¢ã¬ã€ã®ããã©ãŒãã³ã¹ãå¶éããã¹ãã¬ãŒãžã·ã¹ãã ïŒã¬ããŒãžã³ã¬ã¯ã·ã§ã³ïŒã®ãµãŒãã¹ããã»ã¹ã®çç£æ§ã
ã°ã«ãŒã2ïŒããŸããŸãªçš®é¡ã®è² è·ã«å¯Ÿãããã£ã¹ã¯ã¢ã¬ã€ããã©ãŒãã³ã¹ãã¹ãã
ãã¹ãäžã«ã次ã®ã¿ã€ãã®è² è·ã調æ»ãããŸãã
- ãããã¡ã€ã«ã®ããŒãïŒå€æŽå¯èœãªãœãããŠã§ã¢ãã©ã¡ãŒã¿ãŒfioïŒrandomrwãrwmixedreadïŒïŒ
- ã©ã³ãã èšé²100ïŒ ;
- ã©ã³ãã æžã蟌ã¿30ïŒ ;ã©ã³ãã èªã¿åã70ïŒ ;
- ã©ã³ãã èªã¿åã100ïŒ ã
- ãããã¯ãµã€ãºïŒ1KBã8KBã16KBã32KBã64KBã1MBïŒå€æŽå¯èœãªãœãããŠã§ã¢ãã©ã¡ãŒã¿ãŒfioïŒãããã¯ãµã€ãºïŒ;
- å ¥åºåæäœã®åŠçæ¹æ³ïŒéåæïŒãœãããŠã§ã¢fioã®å¯å€ãã©ã¡ãŒã¿ãŒïŒioengineïŒã
ãã¹ãã¯3段éã§è¡ãããŸãã
- äžèšã®è² è·ã¿ã€ãã®çµã¿åããããšã«ããã©ã¡ãŒã¿ãŒfio numjobsããã³iodepthãå€æŽããããšã«ãããã¹ãã¬ãŒãžã·ã¹ãã ã®é£œåç¹ãæ€åºãããŸããã€ãŸããæ倧iopsãéæããããé 延ã¯æå°ã§ãããžã§ããšiodepthã®çµã¿åããã§ãã fioããã°ã©ã ã¯ãiopsãã¬ã€ãã³ã·ãnumjobsãããã³qdepthãèšé²ããŸãã
- ãã®åŸããã¹ãã¯åã®ã¹ããŒãžãšåæ§ã«å®è¡ãããããã©ãŒãã³ã¹ã®çŽååãéæããããã€ã³ãã®ã¿ãèŠã€ãããŸãã
- 次ã«ãåæ§ã®ãã¹ããå®è¡ãããçç£æ§ãååã»ã©æ±ããããŸãã
åæ§ã®ãã¹ãã¢ã«ãŽãªãºã ã䜿çšãããšãç¹å®ã®è² è·ãããã¡ã€ã«ã«å¯Ÿãããã£ã¹ã¯ã¢ã¬ã€ã®æ倧ããã©ãŒãã³ã¹ãããã³è² è·ã«å¯Ÿããé 延ã®äŸåæ§ãå€æã§ããŸãã
ãã¹ãçµæã«åºã¥ããŠãååŸããiopsãšã¬ã€ãã³ã·ã®ãã£ãŒããšè¡šãäœæããçµæãåæããŠãã¹ãã¬ãŒãžã·ã¹ãã ã®ããã©ãŒãã³ã¹ã«é¢ããçµè«ãåºããŸãã
è©Šéšçµæ
åæãã¹ãã§ã®ãã£ã¹ã¯ã¢ã¬ã€ã®ããã©ãŒãã³ã¹ã®ç 究ã
ã°ã«ãŒã1ïŒã©ã³ãã æžã蟌ã¿ã¿ã€ãã®é£ç¶ããŒããå®è£ ãããã¹ãã
ãã¹ãçµæã¯ã°ã©ãã§è¡šç€ºãããŸãïŒå³2ããã³3ïŒã
ã°ã©ãã衚瀺ããŸãã
|
å³2.é·æéèšé²äžã®IOPSïŒ4Kãããã¯ïŒ |
|
å³3.é·æéèšé²äžã®é 延ïŒ4Kãããã¯ïŒ |
äž»ãªèª¿æ»çµæïŒ
è² è·ãé·ãå Žåãæéã®çµéã«ããããã©ãŒãã³ã¹ã®äœäžã¯ä¿®æ£ãããŸããã ãWrite Cliffããªã©ã®çŸè±¡ããããŸããã ãããã£ãŠããã£ã¹ã¯ãµãã·ã¹ãã ãéžæããïŒãµã€ãžã³ã°ïŒå ŽåãããŒãã®æéïŒãã£ã¹ã¯äœ¿çšå±¥æŽïŒã«é¢ä¿ãªããå®å®ããããã©ãŒãã³ã¹ãæåŸ ã§ããŸãã
ã°ã«ãŒã2ïŒ ããŸããŸãªçš®é¡ã®è² è·ã«å¯Ÿãããã£ã¹ã¯ã¢ã¬ã€ããã©ãŒãã³ã¹ãã¹ãã
ãã¹ãçµæã¯ã°ã©ãïŒå³4-9ïŒã«ç€ºãããè¡š1-3ã«ãŸãšããããŠããŸãã
ã°ã©ããšè¡šã衚瀺ããŸãã
|
å³4.ã©ã³ãã èšé²ã§ã®IOPSã |
|
å³5.ã©ã³ãã èšé²äžã®é 延ã ïŒããªç§ïŒ |
|
è¡š1.ã©ã³ãã æžã蟌ã¿ããã©ãŒãã³ã¹ |
|
å³6. I / Oãæ··åšããIOPSïŒ70ïŒ èªã¿åã30ïŒ æžã蟌ã¿ïŒ |
|
å³7. I / Oãæ··åšããå Žåã®é 延ïŒèªã¿åã70ïŒ ãæžã蟌ã¿30ïŒ ïŒïŒããªç§ïŒ |
|
è¡š2. I / Oãæ··åšããå Žåã®ããã©ãŒãã³ã¹ïŒèªã¿åã70ïŒ ãæžã蟌ã¿30ïŒ ïŒ |
|
å³8.ã©ã³ãã èªã¿åãã§ã®IOPSã |
|
å³9.ã©ã³ãã èªã¿åãã®é 延ã ïŒããªç§ïŒ |
|
è¡š3.ã©ã³ãã èªã¿åãããã©ãŒãã³ã¹ã |
èšé²ãããã¹ãã¬ãŒãžããã©ãŒãã³ã¹ã®æ倧ãã©ã¡ãŒã¿ãŒïŒ
èšé²ïŒ
- é 延1.2msïŒ4Kãããã¯ïŒã§160,000 IOPSã
èªæžïŒ
- é 延1.4msã§455000 IOPSïŒ4Kãžã§ã= 10ãããã¯qd = 16ïŒ;
æ··åè² è·ïŒ70/30 rwïŒ
- é 延1.15msã®264000 IOPSïŒãããã¯4Kãžã§ã= 8 qd = 10ïŒ;
- ã¹ãã¬ãŒãžã¯ã蚱容å¯èœãªé 延ã§å®£èšãããããã©ãŒãã³ã¹ãæäŸããŸãã
- ååŸãããé 延å€ã¯ãæå°ãšèŠãªãããšã¯ã§ããŸããã ãã¹ãã¯ããã¥ãŒã®æ·±ãã1ãè¶ ããéåæI / Oã®ã¿ã§å®è¡ãããŸããã
- 1MBãããã¯ã§ã¯ãããã©ãŒãã³ã¹ã¯äºæ³ãããäœããªããŸãã ãããªãç 究ã«ãããã¹ãã¬ãŒãžã·ã¹ãã äžã®1MBãããã¯ã§ã®ãã¹ãäžã«ã256KBãããã¯ã§ã®æäœãçºçããããšã瀺ãããŸããã ã€ãŸããããŒã¿ãããã¯ã¯éä¿¡åã«ãµãŒããŒã§å ±æãããŠãããããããã©ãŒãã³ã¹ãäœäžããŠããŸããã ããã¯ãSymantec VxVMããªã¥ãŒã ãäœæãããšãã«ãstripeunit = 1mã§ã¯ãªãswidth = 1mãã©ã¡ãŒã¿ãŒã䜿çšããããã§ãã
- ã©ã³ãã èšé²ã®å Žåããããã¯ãµã€ãºã®å¢å ã«äŒŽãããã©ãŒãã³ã¹ã®å€åã¯çŽç·çã«çºçãããããã¹ãã¬ãŒãžã·ã¹ãã ã®ã¹ãã¬ãŒãžåž¯åå¹ ã¯çŽ700ã750MB / sã«å¶éãããŠãããšçµè«ä»ããããšãã§ããŸãã
è¿œå ã®ããŒãã¹ãšããŠãã¹ãããã·ã§ããã®ããã©ãŒãã³ã¹ã瀺ãããŸããã ã¬ã³ãŒãã«æ倧éã«ããŒãããã32åã®ãŠãŒãã¡ãŒããåæã«æ®åœ±ããã32åã®ã¹ãããã·ã§ããã¯ãæãããã©ãŒãã³ã¹ã«ç®ã«èŠãã圱é¿ãäžããªãã£ããããã·ã¹ãã ã®ã¢ãŒããã¯ãã£ãè³è³ããããåŸãŸããã
çµè«
ãŸãšãããšããã®ã¢ã¬ã€ã¯å¥œå°è±¡ãäžããã¡ãŒã«ãŒãçºè¡šããiopsãå®èšŒãããšèšããŸãã ä»ã®ãã©ãã·ã¥ãœãªã¥ãŒã·ã§ã³ãšæ¯èŒãããšã次ã®ç¹ãæå©ã§ãã
- æžã蟌ã¿æäœã®ããã©ãŒãã³ã¹äœäžã®æ¬ åŠïŒæžã蟌ã¿ã¯ãªãïŒ
- ããªã¥ãŒã ã®ç¯çŽã ãã§ãªããèšé²é床ã®åäžãå¯èœã«ãããªã³ã©ã€ã³éè€æé€ã
- æ©èœã¹ãããã·ã§ãããšãã®å°è±¡çãªããã©ãŒãã³ã¹ã
- 1ã4ãããã®æ¡åŒµæ§ïŒXããªãã¯ïŒ
ã¢ã¬ã€ã®ãŠããŒã¯ãªã¢ãŒããã¯ãã£ãšããŒã¿åŠçã¢ã«ãŽãªãºã ã«ãããåªããæ©èœïŒéè€æé€ãã¹ãããã·ã§ãããã·ã³ã ãŒã³ïŒãå®è£ ã§ããŸãã
æ®å¿µãªããããã¹ãã¯å®äºããŠããŸããã çµå±ã®ãšããã4ã€ã®X-Brickã§æ§æãããã·ã¹ãã ããæ倧ã®ããã©ãŒãã³ã¹ãæåŸ ãããŸãã ããã«ãããŒãžã§ã³2.4ãæäŸãããŸããããããŒãžã§ã³3.0ã¯ãã§ã«ãªãªãŒã¹ãããŠãããé 延ã®ååãèšèŒãããŠããŸãã ã¢ã¬ã€ã®å€§ããªãããã¯ïŒæ倧垯åå¹ ïŒã§ã®äœæ¥ãšãé 延ãéèŠãªåæI / Oã§ã®äœæ¥ã®åé¡ã¯ããŸã äžæã§ãã ãããã®ããã¯ã€ãã¹ããããããã¹ãŠãè¿œå ã®èª¿æ»ã§ããã«ééã§ããããšãé¡ã£ãŠããŸãã
PSèè ã¯ãPavel KatasonovãYuri Rakitinãããã³ãã®è³æã®æºåã«åå ããäŒç€Ÿã®ä»ã®ãã¹ãŠã®åŸæ¥å¡ã«æè¬ããŠããŸãã