系統環境mysql
# 查看系統版本 [root@mysql8 ~]# cat /etc/redhat-release CentOS Linux release 7.5.1804 (Core) # 查看內核 [root@mysql8 ~]# uname -r 3.10.0-862.11.6.el7.x86_64 # 查看內存 [root@mysql8 ~]# free -m total used free shared buff/cache available Mem: 1982 188 811 9 983 1599 Swap: 2047 0 2047 # 查看物理CPU個數 [root@mysql8 ~]# cat /proc/cpuinfo| grep "physical id"| sort| uniq| wc -l 2
sysbench介紹linux
sysbench是一個模塊化、跨平臺、多線程基準測試工具,主要用於評估測試各類不一樣系統參數下的數據庫負載狀況。git
sysbench目前能夠進行以下幾個方面的性能測試:github
fileio - File I/O test #磁盤I/O性能sql
CPU -CPU performance test #CPU性能shell
memory -Memory functions speed test #內存性能數據庫
threads -Threads subsystem performance test #POSIX線程性能vim
mutex -Mutex performance test #調度程序性能bash
OLTP -OLTP test #數據庫性能(OLTP基準測試)多線程
sysbench的缺點:
模擬的表格結構太簡單,不像tpcc-mysql那樣完整的事物系統,但對於MySQL性能壓縮對比仍是頗有用的。
下載地址
https://github.com/akopytov/sysbench/releases https://github.com/akopytov/sysbench/archive/1.0.16.tar.gz
sysbench 軟件安裝
# 安裝依賴包 [root@mysql8 ~]# yum install libtool pkgconfig libaio-devel libtool automake make -y [root@mysql8 software]# tar xf 1.0.16.tar.gz [root@mysql8 software]# cd sysbench-1.0.16/ [root@mysql8 sysbench-1.0.16]# ls autogen.sh configure.ac doc Makefile.am README.md rpm src ChangeLog COPYING install-sh missing README-Oracle.md scripts tests config debian m4 mkinstalldirs README-WIN.txt snap third_party [root@mysql8 sysbench-1.0.16]# ./autogen.sh ./autogen.sh: running `libtoolize --copy --force' libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, `config'. libtoolize: copying file `config/ltmain.sh' libtoolize: putting macros in AC_CONFIG_MACRO_DIR, `m4'. libtoolize: copying file `m4/libtool.m4' libtoolize: copying file `m4/ltoptions.m4' libtoolize: copying file `m4/ltsugar.m4' libtoolize: copying file `m4/ltversion.m4' libtoolize: copying file `m4/lt~obsolete.m4' ./autogen.sh: running `aclocal -I m4' ./autogen.sh: running `autoheader' ./autogen.sh: running `automake -c --foreign --add-missing' configure.ac:59: installing 'config/ar-lib' configure.ac:45: installing 'config/compile' configure.ac:27: installing 'config/config.guess' configure.ac:27: installing 'config/config.sub' configure.ac:32: installing 'config/install-sh' configure.ac:32: installing 'config/missing' src/Makefile.am: installing 'config/depcomp' parallel-tests: installing 'config/test-driver' ./autogen.sh: running `autoconf' Libtoolized with: libtoolize (GNU libtool) 2.4.2 Automade with: automake (GNU automake) 1.13.4 Configured with: autoconf (GNU Autoconf) 2.69 [root@mysql8 sysbench-1.0.16]# ./configure --prefix=/sysbench checking build system type... x86_64-unknown-linux-gnu checking host system type... x86_64-unknown-linux-gnu checking target system type... x86_64-unknown-linux-gnu checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a thread-safe mkdir -p... /usr/bin/mkdir -p checking for gawk... gawk checking whether make sets $(MAKE)... yes checking whether make supports nested variables... yes checking for style of include used by make... GNU checking for gcc... gcc checking whether the C compiler works... yes checking for C compiler default output file name... a.out checking for suffix of executables... checking whether we are cross compiling... no checking for suffix of object files... o checking whether we are using the GNU C compiler... yes checking whether gcc accepts -g... yes checking for gcc option to accept ISO C89... none needed checking dependency style of gcc... gcc3 checking how to run the C preprocessor... gcc -E checking for grep that handles long lines and -e... /usr/bin/grep checking for egrep... /usr/bin/grep -E checking for ANSI C header files... yes checking for sys/types.h... yes checking for sys/stat.h... yes checking for stdlib.h... yes checking for string.h... yes checking for memory.h... yes checking for strings.h... yes checking for inttypes.h... yes checking for stdint.h... yes checking for unistd.h... yes checking minix/config.h usability... no checking minix/config.h presence... no checking for minix/config.h... no checking whether it is safe to define __EXTENSIONS__... yes checking for gcc... (cached) gcc checking whether we are using the GNU C compiler... (cached) yes checking whether gcc accepts -g... (cached) yes checking for gcc option to accept ISO C89... (cached) none needed checking dependency style of gcc... (cached) gcc3 checking for gcc option to accept ISO C99... -std=gnu99 checking how to run the C preprocessor... gcc -E checking whether gcc -std=gnu99 and cc understand -c and -o together... yes checking for a sed that does not truncate output... /usr/bin/sed checking for C compiler vendor... gnu checking for gcc architecture flag... checking for x86 cpuid 0 output... 16:756e6547:6c65746e:49656e69 checking for x86 cpuid 1 output... 506e3:2010800:fffa3203:f8bfbff checking whether C compiler accepts -march=core2... yes checking for gcc architecture flag... -march=core2 checking for ar... ar checking the archiver (ar) interface... ar checking how to print strings... printf checking for a sed that does not truncate output... (cached) /usr/bin/sed checking for fgrep... /usr/bin/grep -F checking for ld used by gcc -std=gnu99... /usr/bin/ld checking if the linker (/usr/bin/ld) is GNU ld... yes checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B checking the name lister (/usr/bin/nm -B) interface... BSD nm checking whether ln -s works... yes checking the maximum length of command line arguments... 1572864 checking whether the shell understands some XSI constructs... yes checking whether the shell understands "+="... yes checking how to convert x86_64-unknown-linux-gnu file names to x86_64-unknown-linux-gnu format... func_convert_file_noop checking how to convert x86_64-unknown-linux-gnu file names to toolchain format... func_convert_file_noop checking for /usr/bin/ld option to reload object files... -r checking for objdump... objdump checking how to recognize dependent libraries... pass_all checking for dlltool... no checking how to associate runtime and link libraries... printf %s\n checking for archiver @FILE support... @ checking for strip... strip checking for ranlib... ranlib checking command to parse /usr/bin/nm -B output from gcc -std=gnu99 object... ok checking for sysroot... no checking for mt... no checking if : is a manifest tool... no checking for dlfcn.h... yes checking for objdir... .libs checking if gcc -std=gnu99 supports -fno-rtti -fno-exceptions... no checking for gcc -std=gnu99 option to produce PIC... -fPIC -DPIC checking if gcc -std=gnu99 PIC flag -fPIC -DPIC works... yes checking if gcc -std=gnu99 static flag -static works... no checking if gcc -std=gnu99 supports -c -o file.o... yes checking if gcc -std=gnu99 supports -c -o file.o... (cached) yes checking whether the gcc -std=gnu99 linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes checking whether -lc should be explicitly linked in... no checking dynamic linker characteristics... GNU/Linux ld.so checking how to hardcode library paths into programs... immediate checking whether stripping libraries is possible... yes checking if libtool supports shared libraries... yes checking whether to build shared libraries... yes checking whether to build static libraries... yes checking for pkg-config... yes checking for C compiler vendor... (cached) gnu checking whether to compile with MySQL support... yes checking whether to compile with Drizzle support... no checking whether to compile with libattachsql support... no checking whether to compile with Oracle support... no checking whether to compile with PostgreSQL support... no checking for pkg-config... /usr/bin/pkg-config checking pkg-config is at least version 0.9.0... yes checking whether to build with system or bundled LuaJIT... bundled checking whether to build with system or bundled Concurrency Kit... bundled checking whether SHM_HUGETLB is declared... yes checking whether O_SYNC is declared... yes checking for xsltproc... xsltproc checking whether xsltproc works... no checking for the pthreads library -lpthreads... no checking whether pthreads work without any flags... no checking whether pthreads work with -Kthread... no checking whether pthreads work with -kthread... no checking for the pthreads library -llthread... no checking whether pthreads work with -pthread... yes checking for joinable pthread attribute... PTHREAD_CREATE_JOINABLE checking if more special flags are required for pthreads... no checking for sqrt in -lm... yes checking for mysql_config... /usr/bin/mysql_config checking MySQL C flags... -I/usr/include/mysql -m64 checking MySQL linker flags... -L/usr/lib64/mysql -lmysqlclient -lpthread -lm -lrt -lssl -lcrypto -ldl checking for ld used by GCC... /usr/bin/ld -m elf_x86_64 checking if the linker (/usr/bin/ld -m elf_x86_64) is GNU ld... yes checking for shared library run path origin... done checking libaio.h usability... yes checking libaio.h presence... yes checking for libaio.h... yes checking for io_queue_init in -laio... yes checking if io_getevents() has an old interface... no checking for malloc in -lumem... no checking for malloc in -lmtmalloc... no checking for ANSI C header files... (cached) yes checking errno.h usability... yes checking errno.h presence... yes checking for errno.h... yes checking fcntl.h usability... yes checking fcntl.h presence... yes checking for fcntl.h... yes checking math.h usability... yes checking math.h presence... yes checking for math.h... yes checking pthread.h usability... yes checking pthread.h presence... yes checking for pthread.h... yes checking sched.h usability... yes checking sched.h presence... yes checking for sched.h... yes checking signal.h usability... yes checking signal.h presence... yes checking for signal.h... yes checking for stdlib.h... (cached) yes checking for string.h... (cached) yes checking sys/aio.h usability... no checking sys/aio.h presence... no checking for sys/aio.h... no checking sys/ipc.h usability... yes checking sys/ipc.h presence... yes checking for sys/ipc.h... yes checking sys/time.h usability... yes checking sys/time.h presence... yes checking for sys/time.h... yes checking sys/mman.h usability... yes checking sys/mman.h presence... yes checking for sys/mman.h... yes checking sys/shm.h usability... yes checking sys/shm.h presence... yes checking for sys/shm.h... yes checking thread.h usability... no checking thread.h presence... no checking for thread.h... no checking for unistd.h... (cached) yes checking limits.h usability... yes checking limits.h presence... yes checking for limits.h... yes checking libgen.h usability... yes checking libgen.h presence... yes checking for libgen.h... yes checking for off_t... yes checking whether time.h and sys/time.h may both be included... yes checking for thread local storage (TLS) class... __thread checking for __attribute__((format))... yes checking for __attribute__((unused))... yes checking for special C compiler options needed for large files... no checking for _FILE_OFFSET_BITS value needed for large files... no checking size of size_t... 8 checking size of bool... 1 checking for stdlib.h... (cached) yes checking for unistd.h... (cached) yes checking for sys/param.h... yes checking for getpagesize... yes checking for working mmap... yes checking whether strerror_r is declared... yes checking for strerror_r... yes checking whether strerror_r returns char *... yes checking for library containing clock_gettime... none required checking for alarm... yes checking for clock_gettime... yes checking for directio... no checking for fdatasync... yes checking for gettimeofday... yes checking for isatty... yes checking for memalign... yes checking for memset... yes checking for posix_memalign... yes checking for pthread_yield... yes checking for setvbuf... yes checking for sqrt... yes checking for strdup... yes checking for thr_setconcurrency... no checking for valloc... yes checking for pthread_once... yes checking that generated files are newer than configure... done configure: creating ./config.status config.status: creating Makefile config.status: creating doc/xsl/Makefile config.status: creating doc/xsl/catalog.xml config.status: creating doc/Makefile config.status: creating third_party/luajit/Makefile config.status: creating third_party/concurrency_kit/Makefile config.status: creating src/Makefile config.status: creating src/drivers/Makefile config.status: creating src/drivers/mysql/Makefile config.status: creating src/drivers/drizzle/Makefile config.status: creating src/drivers/oracle/Makefile config.status: creating src/drivers/pgsql/Makefile config.status: creating src/drivers/attachsql/Makefile config.status: creating src/tests/Makefile config.status: creating src/tests/cpu/Makefile config.status: creating src/tests/fileio/Makefile config.status: creating src/tests/memory/Makefile config.status: creating src/tests/threads/Makefile config.status: creating src/tests/mutex/Makefile config.status: creating src/lua/Makefile config.status: creating src/lua/internal/Makefile config.status: creating tests/Makefile config.status: creating tests/include/config.sh config.status: creating snap/snapcraft.yaml config.status: creating config/config.h config.status: executing depfiles commands config.status: executing libtool commands =============================================================================== sysbench version : 1.0.16 CC : gcc -std=gnu99 CFLAGS : -O2 -funroll-loops -ggdb3 -march=core2 -Wall -Wextra -Wpointer-arith -Wbad-function-cast -Wstrict-prototypes -Wnested-externs -Wno-format-zero-length -Wundef -Wstrict-prototypes -Wmissing-prototypes -Wmissing-declarations -Wredundant-decls -Wcast-align -Wvla -pthread CPPFLAGS : -D_GNU_SOURCE -I$(top_srcdir)/src -I$(abs_top_builddir)/third_party/luajit/inc -I$(abs_top_builddir)/third_party/concurrency_kit/include LDFLAGS : LIBS : -laio -lm EXTRA_LDFLAGS : prefix : /sysbench bindir : ${prefix}/bin libexecdir : ${prefix}/libexec mandir : ${prefix}/share/man datadir : ${prefix}/share MySQL support : yes Drizzle support : no AttachSQL support : no Oracle support : no PostgreSQL support : no LuaJIT : bundled LUAJIT_CFLAGS : -I$(abs_top_builddir)/third_party/luajit/inc LUAJIT_LIBS : $(abs_top_builddir)/third_party/luajit/lib/libluajit-5.1.a -ldl LUAJIT_LDFLAGS : -rdynamic Concurrency Kit : bundled CK_CFLAGS : -I$(abs_top_builddir)/third_party/concurrency_kit/include CK_LIBS : $(abs_top_builddir)/third_party/concurrency_kit/lib/libck.a configure flags : =============================================================================== [root@mysql8 sysbench-1.0.16]# make [root@mysql8 sysbench-1.0.16]# make install [root@mysql8 sysbench-1.0.16]# cd /sysbench/ [root@mysql8 sysbench]# ll 總用量 0 drwxr-xr-x. 2 root root 22 2月 24 21:06 bin drwxr-xr-x. 4 root root 33 2月 24 21:06 share [root@mysql8 sysbench]# vim /etc/profile export PATH=/sysbench/bin:$PATH root@mysql8 sysbench]# . /etc/profile [root@mysql8 sysbench]# sysbench --version sysbench 1.0.16
sysbench 命令與參數
[root@mysql8 sysbench]# sysbench --help Usage: sysbench [options]... [testname] [command] Commands implemented by most tests: prepare run cleanup help General options: --threads=N number of threads to use [1] # 建立測試線程的數量,默認是1 --events=N limit for total number of events [0] # 事件最大數量,0爲不限制 --time=N limit for total execution time in seconds [10] # 最大執行時間,單位是秒 --forced-shutdown=STRING number of seconds to wait after the --time limit before forcing shutdown, or 'off' to disable [off] --thread-stack-size=SIZE size of stack per thread [64K] --rate=N average transactions rate. 0 for unlimited rate [0] --report-interval=N periodically report intermediate statistics with a specified interval in seconds. 0 disables intermediate reports [0] --report-checkpoints=[LIST,...] dump full statistics and reset all counters at specified points in time. The argument is a list of comma-separated values representing the amount of time in seconds elapsed from start of test when report checkpoint(s) must be performed. Report checkpoints are off by default. [] --debug[=on|off] print more debugging info [off] --validate[=on|off] perform validation checks where possible [off] --help[=on|off] print help and exit [off] --version[=on|off] print version and exit [off] --config-file=FILENAME File containing command line options --tx-rate=N deprecated alias for --rate [0] --max-requests=N deprecated alias for --events [0] --max-time=N deprecated alias for --time [0] --num-threads=N deprecated alias for --threads [1] Pseudo-Random Numbers Generator options: --rand-type=STRING random numbers distribution {uniform,gaussian,special,pareto} [special] --rand-spec-iter=N number of iterations used for numbers generation [12] --rand-spec-pct=N percentage of values to be treated as 'special' (for special distribution) [1] --rand-spec-res=N percentage of 'special' values to use (for special distribution) [75] --rand-seed=N seed for random number generator. When 0, the current time is used as a RNG seed. [0] --rand-pareto-h=N parameter h for pareto distribution [0.2] Log options: --verbosity=N verbosity level {5 - debug, 0 - only critical messages} [3] --percentile=N percentile to calculate in latency statistics (1-100). Use the special value of 0 to disable percentile calculations [95] --histogram[=on|off] print latency histogram in report [off] General database options: --db-driver=STRING specifies database driver to use ('help' to get list of available drivers) [mysql] --db-ps-mode=STRING prepared statements usage mode {auto, disable} [auto] --db-debug[=on|off] print database-specific debug information [off] Compiled-in database drivers: mysql - MySQL driver mysql options: --mysql-host=[LIST,...] MySQL server host [localhost] --mysql-port=[LIST,...] MySQL server port [3306] --mysql-socket=[LIST,...] MySQL socket --mysql-user=STRING MySQL user [sbtest] --mysql-password=STRING MySQL password [] --mysql-db=STRING MySQL database name [sbtest] --mysql-ssl[=on|off] use SSL connections, if available in the client library [off] --mysql-ssl-cipher=STRING use specific cipher for SSL connections [] --mysql-compression[=on|off] use compression, if available in the client library [off] --mysql-debug[=on|off] trace all client library calls [off] --mysql-ignore-errors=[LIST,...] list of errors to ignore, or "all" [1213,1020,1205] --mysql-dry-run[=on|off] Dry run, pretend that all MySQL client API calls are successful without executing them [off] Compiled-in tests: fileio - File I/O test cpu - CPU performance test memory - Memory functions speed test threads - Threads subsystem performance test mutex - Mutex performance test See 'sysbenchhelp' for a list of options for each test.
sysbench使用[command]經常使用的有:
prepare 準備測試,生成數據
run 執行測試
cleanup 清理數據
help
version
sysbench 腳本名
路徑:/sysbench/share/sysbench/tests/include/oltp_legacy
[root@mysql8 oltp_legacy]# ls bulk_insert.lua delete.lua oltp.lua parallel_prepare.lua select_random_points.lua update_index.lua common.lua insert.lua oltp_simple.lua select.lua select_random_ranges.lua update_non_index.lua
sysbench 使用的一些建議
在開始測試以前,應該首先明確:應採用針對整個系統的基準測試,仍是針對MySQL的基準測試,仍是兩者都須要。
若是須要針對MySQL的基準測試,那麼還須要明確精度方面的要求:是否須要使用生產環境的真實數據,仍是使用工具生成也能夠,前者實施起來更加繁瑣。若是要使用真實數據,儘可能使用所有數據,而不是部分數據。
基準測試要進行屢次纔有意義。
測試時須要注意主從同步的狀態。
測試必須模擬多線程的狀況,單線程狀況不但沒法模擬真實的效率,也沒法模擬阻塞甚至死鎖狀況。
錯誤
錯誤1
configure: error: mysql_config executable not found
解決方法:
[root@mysql8 sysbench-1.0.16]# yum -y install mysql-devel